Nov 04 12:04:29 devstack cinder-volume[76025]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 04 12:04:29 devstack cinder-volume[76025]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 04 12:04:29 devstack cinder-volume[76025]: we strongly recommend against using it for new projects. Nov 04 12:04:29 devstack cinder-volume[76025]: If you are already using Eventlet, we recommend migrating to a different Nov 04 12:04:29 devstack cinder-volume[76025]: framework. For more detail see Nov 04 12:04:29 devstack cinder-volume[76025]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 04 12:04:29 devstack cinder-volume[76025]: import eventlet # noqa Nov 04 12:04:32 devstack cinder-volume[76025]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76025) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 04 12:04:32 devstack cinder-volume[76025]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76025) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 04 12:04:32 devstack cinder-volume[76025]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76025) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 04 12:04:33 devstack cinder-volume[76025]: INFO dbcounter [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] Registered counter for database cinder Nov 04 12:04:33 devstack cinder-volume[76025]: DEBUG oslo_db.sqlalchemy.engines [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76025) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 12:04:33 devstack cinder-volume[76025]: DEBUG dbcounter [-] [76025] Writer thread running {{(pid=76025) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 04 12:04:33 devstack cinder-volume[76025]: INFO cinder.rpc [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 04 12:04:33 devstack cinder-volume[76025]: INFO cinder.rpc [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 04 12:04:33 devstack cinder-volume[76025]: DEBUG oslo_db.sqlalchemy.engines [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76025) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 12:04:33 devstack cinder-volume[76025]: INFO cinder.volume.manager [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] Determined volume DB was empty at startup. Nov 04 12:04:33 devstack cinder-volume[76025]: DEBUG cinder.volume.manager [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76025) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 04 12:04:33 devstack cinder-volume[76025]: INFO cinder.volume.manager [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 04 12:04:33 devstack cinder-volume[76025]: WARNING stevedore.named [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 04 12:04:33 devstack cinder-volume[76025]: WARNING castellan.key_manager [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 04 12:04:33 devstack cinder-volume[76025]: WARNING cinder.keymgr.conf_key_mgr [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 04 12:04:33 devstack cinder-volume[76025]: DEBUG cinder.volume.drivers.lvm [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76025) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Nov 04 12:04:33 devstack cinder-volume[76025]: DEBUG oslo_concurrency.processutils [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76025) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:04:33 devstack cinder-volume[76025]: DEBUG oslo_concurrency.processutils [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] CMD "cinder-rtstool verify" returned: 0 in 0.380s {{(pid=76025) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_db.sqlalchemy.engines [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76025) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 12:04:34 devstack cinder-volume[76025]: INFO cinder.rpc [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Nov 04 12:04:34 devstack cinder-volume[76025]: INFO cinder.rpc [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Nov 04 12:04:34 devstack cinder-volume[76025]: WARNING stevedore.named [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 04 12:04:34 devstack cinder-volume[76025]: WARNING castellan.key_manager [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 04 12:04:34 devstack cinder-volume[76025]: INFO cinder.volume.manager [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] Image-volume cache enabled for host devstack@lvmdriver-1. Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_db.sqlalchemy.engines [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76025) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 12:04:34 devstack cinder-volume[76025]: INFO oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] Starting 1 workers Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] Started child 76171 {{(pid=76025) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] Full set of CONF: {{(pid=76025) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 04 12:04:34 devstack cinder-volume[76171]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] ******************************************************************************** {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] Configuration options gathered from: {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] ================================================================================ {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] allow_availability_zone_fallback = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] allow_compression_on_image_upload = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] allowed_direct_url_schemes = [] {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] api_rate_limit = True {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] auth_strategy = keystone {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] az_cache_duration = 3600 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] backend_availability_zone = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] backend_host = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] backend_name = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] backend_stats_polling_interval = 60 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] backup_api_class = cinder.backup.api.API {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] backup_name_template = backup-%s {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] backup_use_same_host = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] backup_use_temp_snapshot = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] chap_password = **** {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] chap_username = {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] cinder_internal_tenant_project_id = 98bacb5047f445489c2f103d4fb9aa7e {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] cinder_internal_tenant_user_id = 7b2c5889cb95402ebecd2d0176a9d581 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] cloned_volume_same_az = True {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] cluster = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] compression_format = gzip {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] compute_api_class = cinder.compute.nova.API {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] config_dir = [] {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] config_source = [] {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] control_exchange = openstack {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] debug = True {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] default_availability_zone = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] default_group_type = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] default_volume_type = lvmdriver-1 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] disk_geometry = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] driver_client_cert = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] driver_client_cert_key = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] driver_data_namespace = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] driver_ssl_cert_path = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] driver_ssl_cert_verify = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] driver_use_ssl = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] enable_force_upload = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] enable_new_services = True {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] enable_unsupported_driver = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] enabled_backends = ['lvmdriver-1'] {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] enforce_multipath_for_image_xfer = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] filter_function = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] glance_api_insecure = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] glance_api_servers = ['http://192.168.122.181/image'] {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] glance_api_ssl_compression = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] glance_ca_certificates_file = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] glance_catalog_info = image:glance:publicURL {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] glance_certfile = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] glance_keyfile = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] glance_num_retries = 3 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] glance_request_timeout = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] goodness_function = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] graceful_shutdown_timeout = 5 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] group_api_class = cinder.group.api.API {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] host = devstack {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] image_compress_on_upload = True {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] image_conversion_address_space_limit = 1 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] image_conversion_cpu_limit = 60 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] image_conversion_disable = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] image_introspection_address_space_limit = 1 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] image_introspection_cpu_limit = 60 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] image_upload_use_cinder_backend = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] image_upload_use_internal_tenant = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] image_volume_cache_enabled = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] image_volume_cache_max_count = 0 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] image_volume_cache_max_size_gb = 0 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] init_host_max_objects_retrieval = 0 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] instance_format = [instance: %(uuid)s] {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] iscsi_target_flags = {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] iscsi_write_cache = on {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] iser_helper = tgtadm {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] iser_ip_address = 192.168.122.181 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] iser_port = 3260 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] log_color = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] log_config_append = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] log_dir = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] log_file = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] log_options = True {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] log_rotate_interval = 1 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] log_rotate_interval_type = days {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] log_rotation_type = none {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] max_age = 0 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] max_logfile_count = 30 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] max_logfile_size_mb = 200 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] max_over_subscription_ratio = 20.0 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] message_reap_interval = 86400 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] message_ttl = 2592000 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] migration_create_volume_timeout_secs = 300 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] monkey_patch = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] monkey_patch_modules = [] {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] my_ip = 192.168.122.181 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] no_snapshot_gb_quota = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] num_iser_scan_tries = 3 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] num_shell_tries = 3 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] num_volume_device_scan_tries = 3 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] nvmeof_conn_info_version = 1 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] nvmet_ns_id = 10 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] nvmet_port_id = 1 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] osapi_max_limit = 1000 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76171]: INFO cinder.volume.manager [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] Starting volume driver LVMVolumeDriver (3.0.0) Nov 04 12:04:34 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] osapi_volume_ext_list = [] {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] osapi_volume_listen = 0.0.0.0 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] osapi_volume_listen_port = 8776 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] osapi_volume_use_ssl = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] osapi_volume_workers = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] per_volume_size_limit = -1 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] periodic_fuzzy_delay = 60 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] periodic_interval = 60 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] project_id_regex = [0-9a-f\-]+ {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] public_endpoint = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] publish_errors = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] quota_backup_gigabytes = 1000 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] quota_backups = 10 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] quota_gigabytes = 1000 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] quota_groups = 10 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] quota_snapshots = 10 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] quota_volumes = 10 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] rate_limit_burst = 0 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] rate_limit_except_level = CRITICAL {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] rate_limit_interval = 0 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] reinit_driver_count = 3 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] replication_device = **** {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] report_discard_supported = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] report_interval = 120 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] reservation_clean_interval = 86400 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] reservation_expire = 86400 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] reserved_image_namespaces = [] {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] reserved_percentage = 0 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] rpc_response_timeout = 120 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] run_external_periodic_tasks = True {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] scst_target_driver = iscsi {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] scst_target_iqn_name = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] service_down_time = 720 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] shell_completion = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] snapshot_name_template = snapshot-%s {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] snapshot_same_host = True {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] split_loggers = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] state_path = /opt/stack/data/cinder {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] storage_availability_zone = nova {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] storage_protocol = iSCSI {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] syslog_log_facility = LOG_USER {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] target_helper = lioadm {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] target_ip_address = 192.168.122.181 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] target_port = 3260 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] target_protocol = iscsi {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] target_secondary_ip_addresses = [] {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] trace_flags = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] transfer_api_class = cinder.transfer.api.API {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] transport_url = **** {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] until_refresh = 0 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:04:34 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] use_chap_auth = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] use_default_quota_class = True {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] use_journal = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] use_json = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] use_multipath_for_image_xfer = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] use_stderr = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] use_syslog = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] verify_glance_signatures = enabled {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] volume_api_class = cinder.volume.api.API {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] volume_backend_name = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] volume_clear = zero {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] volume_clear_ionice = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] volume_clear_size = 0 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] volume_copy_bps_limit = 0 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] volume_dd_blocksize = 1M {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] volume_name_template = volume-%s {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] volume_service_inithost_offload = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] volume_usage_audit_period = month {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] zoning_mode = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] oslo_concurrency.disable_process_locking = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:04:34 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] keystone_authtoken.auth_section = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] keystone_authtoken.auth_type = password {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] keystone_authtoken.auth_version = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] keystone_authtoken.cache = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] keystone_authtoken.certfile = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] keystone_authtoken.delay_auth_decision = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] keystone_authtoken.http_connect_timeout = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] keystone_authtoken.include_service_catalog = True {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] keystone_authtoken.insecure = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] keystone_authtoken.interface = public {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] keystone_authtoken.keyfile = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] keystone_authtoken.memcache_password = **** {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] keystone_authtoken.memcache_username = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack sudo[76177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Nov 04 12:04:34 devstack sudo[76177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] keystone_authtoken.region_name = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] keystone_authtoken.service_token_roles_required = True {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] keystone_authtoken.service_type = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] keystone_authtoken.token_cache_time = 300 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.181/identity {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] cache.backend = dogpile.cache.null {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] cache.backend_argument = **** {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] cache.backend_expiration_time = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] cache.config_prefix = cache.oslo {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] cache.debug_cache_backend = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] cache.enable_retry_client = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] cache.enable_socket_keepalive = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] cache.enabled = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] cache.expiration_time = 600 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] cache.hashclient_retry_attempts = 2 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] cache.memcache_dead_retry = 300 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] cache.memcache_pool_maxsize = 10 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] cache.memcache_sasl_enabled = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] cache.password = **** {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] cache.proxies = [] {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] cache.redis_db = 0 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] cache.redis_sentinel_service_name = mymaster {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] cache.redis_server = localhost:6379 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] cache.retry_attempts = 2 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] cache.retry_delay = 0.0 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] cache.socket_keepalive_count = 1 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] cache.socket_keepalive_idle = 1 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] cache.socket_keepalive_interval = 1 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] cache.socket_timeout = 1.0 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] cache.tls_allowed_ciphers = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] cache.tls_cafile = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] cache.tls_certfile = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] cache.tls_enabled = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] cache.tls_keyfile = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] cache.username = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] coordination.backend_url = **** {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] database.asyncio_connection = **** {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] database.asyncio_slave_connection = **** {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] database.backend = sqlalchemy {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] database.connection = **** {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] database.connection_debug = 0 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] database.connection_parameters = {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] database.connection_recycle_time = 3600 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] database.connection_trace = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] database.db_inc_retry_interval = True {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] database.db_max_retries = 20 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] database.db_max_retry_interval = 10 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] database.db_retry_interval = 1 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] database.max_overflow = 50 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] database.max_pool_size = 5 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] database.max_retries = 10 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] database.mysql_wsrep_sync_wait = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] database.pool_timeout = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] database.retry_interval = 10 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] database.slave_connection = **** {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] database.sqlite_synchronous = True {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] database.synchronous_reader = True {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] database.use_db_reconnect = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] oslo_messaging_tracing.insecure = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] profiler.connection_string = messaging:// {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] profiler.enabled = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] profiler.es_doc_type = notification {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] profiler.es_scroll_size = 10000 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] profiler.es_scroll_time = 2m {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] profiler.filter_error_trace = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] profiler.hmac_keys = **** {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] profiler.sentinel_service_name = mymaster {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] profiler.socket_timeout = 0.1 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] profiler.trace_requests = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] profiler.trace_sqlalchemy = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] profiler_jaeger.process_tags = {} {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] profiler_jaeger.service_name_prefix = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] profiler_otlp.service_name_prefix = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] oslo_policy.enforce_new_defaults = True {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] oslo_policy.policy_default_rule = default {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] oslo_policy.policy_file = policy.yaml {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] oslo_policy.remote_timeout = 60.0 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] privsep_osbrick.group = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] privsep_osbrick.helper_command = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] privsep_osbrick.user = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] cinder_sys_admin.group = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] cinder_sys_admin.helper_command = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] cinder_sys_admin.user = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] service_user.auth_section = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] service_user.auth_type = password {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] service_user.cafile = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] service_user.certfile = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] service_user.collect_timing = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] service_user.insecure = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] service_user.keyfile = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] service_user.send_service_user_token = True {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] service_user.split_loggers = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] service_user.timeout = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] service_user.tls_ciphers = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] service_user.tls_min_version = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] glance.auth_section = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] glance.auth_type = password {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] glance.certfile = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] glance.collect_timing = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] glance.insecure = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] glance.keyfile = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] glance.region_name = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] glance.split_loggers = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] glance.timeout = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] glance.tls_ciphers = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] glance.tls_min_version = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] backend_defaults.backend_availability_zone = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] backend_defaults.chap_password = **** {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] backend_defaults.chap_username = {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] backend_defaults.disk_geometry = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] backend_defaults.driver_client_cert = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] backend_defaults.driver_client_cert_key = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] backend_defaults.driver_data_namespace = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] backend_defaults.driver_use_ssl = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] backend_defaults.enable_unsupported_driver = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] backend_defaults.extra_capabilities = {} {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] backend_defaults.filter_function = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] backend_defaults.goodness_function = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] backend_defaults.iscsi_target_flags = {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] backend_defaults.iscsi_write_cache = on {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] backend_defaults.iser_helper = tgtadm {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] backend_defaults.iser_ip_address = 192.168.122.181 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] backend_defaults.iser_port = 3260 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] backend_defaults.lvm_mirrors = 0 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] backend_defaults.lvm_share_target = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] backend_defaults.lvm_type = auto {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] backend_defaults.num_shell_tries = 3 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] backend_defaults.nvmet_port_id = 1 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] backend_defaults.replication_device = **** {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] backend_defaults.report_discard_supported = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] backend_defaults.reserved_percentage = 0 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] backend_defaults.scst_target_driver = iscsi {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] backend_defaults.scst_target_iqn_name = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] backend_defaults.storage_protocol = iSCSI {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] backend_defaults.target_helper = tgtadm {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] backend_defaults.target_ip_address = 192.168.122.181 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] backend_defaults.target_port = 3260 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] backend_defaults.target_protocol = iscsi {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] backend_defaults.trace_flags = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] backend_defaults.unique_fqdn_network = True {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] backend_defaults.use_chap_auth = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] backend_defaults.volume_backend_name = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] backend_defaults.volume_clear = zero {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] backend_defaults.volume_clear_ionice = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] backend_defaults.volume_clear_size = 0 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] backend_defaults.volume_group = cinder-volumes {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] oslo_reports.file_event_handler = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] oslo_reports.log_dir = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] lvmdriver-1.backend_availability_zone = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] lvmdriver-1.backend_host = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] lvmdriver-1.chap_password = **** {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] lvmdriver-1.chap_username = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] lvmdriver-1.chiscsi_conf = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] lvmdriver-1.disk_geometry = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] lvmdriver-1.driver_client_cert = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] lvmdriver-1.driver_data_namespace = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] lvmdriver-1.driver_use_ssl = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] lvmdriver-1.extra_capabilities = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] lvmdriver-1.filter_function = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] lvmdriver-1.goodness_function = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] lvmdriver-1.iser_helper = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] lvmdriver-1.iser_ip_address = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] lvmdriver-1.iser_port = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] lvmdriver-1.iser_target_prefix = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] lvmdriver-1.lvm_conf_file = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] lvmdriver-1.lvm_mirrors = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] lvmdriver-1.lvm_share_target = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] lvmdriver-1.lvm_type = auto {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] lvmdriver-1.num_shell_tries = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] lvmdriver-1.nvmet_port_id = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] lvmdriver-1.replication_device = **** {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] lvmdriver-1.report_discard_supported = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] lvmdriver-1.reserved_percentage = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] lvmdriver-1.scst_target_driver = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] lvmdriver-1.storage_protocol = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] lvmdriver-1.target_helper = lioadm {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] lvmdriver-1.target_ip_address = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] lvmdriver-1.target_port = 3260 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] lvmdriver-1.target_protocol = iscsi {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] lvmdriver-1.trace_flags = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] lvmdriver-1.use_chap_auth = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] lvmdriver-1.volume_clear = zero {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] lvmdriver-1.volume_clear_size = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] lvmdriver-1.volumes_dir = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] oslo_messaging_rabbit.ssl = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] oslo_messaging_rabbit.ssl_version = {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] oslo_messaging_notifications.driver = [] {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] oslo_messaging_notifications.retry = -1 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] oslo_messaging_notifications.transport_url = **** {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] key_manager.fixed_key = **** {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] barbican.barbican_api_version = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] barbican.barbican_endpoint = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] barbican.barbican_endpoint_type = public {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] barbican.barbican_region_name = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] barbican.cafile = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] barbican.certfile = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] barbican.collect_timing = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] barbican.insecure = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] barbican.keyfile = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] barbican.number_of_retries = 60 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] barbican.retry_delay = 1 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] barbican.send_service_user_token = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] barbican.split_loggers = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] barbican.timeout = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] barbican.tls_ciphers = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] barbican.tls_min_version = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] barbican.verify_ssl = True {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] barbican.verify_ssl_path = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] barbican_service_user.auth_section = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] barbican_service_user.auth_type = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] barbican_service_user.cafile = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] barbican_service_user.certfile = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] barbican_service_user.collect_timing = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] barbican_service_user.insecure = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] barbican_service_user.keyfile = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] barbican_service_user.split_loggers = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] barbican_service_user.timeout = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] barbican_service_user.tls_ciphers = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] barbican_service_user.tls_min_version = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] vault.approle_role_id = **** {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] vault.approle_secret_id = **** {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] vault.auth_method = approle {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] vault.auth_path = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] vault.kv_mountpoint = secret {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] vault.kv_path = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] vault.kv_version = 2 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] vault.namespace = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] vault.root_token_id = **** {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] vault.ssl_ca_crt_file = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] vault.timeout = 60.0 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] vault.token_file = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] vault.token_role = None {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] vault.use_ssl = False {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:04:34 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] ******************************************************************************** {{(pid=76025) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 04 12:04:34 devstack sudo[76177]: pam_unix(sudo:session): session closed for user root Nov 04 12:04:34 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.344s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:04:34 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:04:34 devstack sudo[76183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 12:04:34 devstack sudo[76183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:04:34 devstack sudo[76183]: pam_unix(sudo:session): session closed for user root Nov 04 12:04:34 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.327s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:04:34 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 12:04:34 devstack cinder-volume[76171]: INFO cinder.brick.local_dev.lvm [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Nov 04 12:04:34 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:04:35 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:04:35 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:04:35 devstack sudo[76230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 04 12:04:35 devstack sudo[76230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:04:35 devstack sudo[76230]: pam_unix(sudo:session): session closed for user root Nov 04 12:04:35 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:04:35 devstack cinder-volume[76171]: DEBUG cinder.brick.local_dev.lvm [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76171) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Nov 04 12:04:35 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:04:35 devstack sudo[76356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 12:04:35 devstack sudo[76356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:04:35 devstack sudo[76356]: pam_unix(sudo:session): session closed for user root Nov 04 12:04:35 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.489s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:04:35 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:04:35 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:04:35 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:04:35 devstack sudo[76548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 12:04:35 devstack sudo[76548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:04:36 devstack sudo[76548]: pam_unix(sudo:session): session closed for user root Nov 04 12:04:36 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.264s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:04:36 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:04:36 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:04:36 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:04:36 devstack sudo[76644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Nov 04 12:04:36 devstack sudo[76644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:04:36 devstack sudo[76644]: pam_unix(sudo:session): session closed for user root Nov 04 12:04:36 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.273s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:04:36 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:04:36 devstack sudo[76722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 04 12:04:36 devstack sudo[76722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:04:36 devstack sudo[76722]: pam_unix(sudo:session): session closed for user root Nov 04 12:04:36 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.304s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:04:36 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:04:36 devstack sudo[76795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 04 12:04:36 devstack sudo[76795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:04:36 devstack sudo[76795]: pam_unix(sudo:session): session closed for user root Nov 04 12:04:36 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:04:36 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:04:36 devstack sudo[76802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 12:04:36 devstack sudo[76802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:04:37 devstack sudo[76802]: pam_unix(sudo:session): session closed for user root Nov 04 12:04:37 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.308s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:04:37 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:04:37 devstack sudo[76883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 12:04:37 devstack sudo[76883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:04:37 devstack sudo[76883]: pam_unix(sudo:session): session closed for user root Nov 04 12:04:37 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.250s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:04:37 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:04:37 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.039s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:04:37 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:04:37 devstack sudo[76893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 12:04:37 devstack sudo[76893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:04:37 devstack sudo[76893]: pam_unix(sudo:session): session closed for user root Nov 04 12:04:37 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.326s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:04:37 devstack cinder-volume[76171]: INFO cinder.volume.drivers.lvm [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] Enabling LVM thin provisioning by default because a thin pool exists. Nov 04 12:04:37 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:04:37 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:04:37 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:04:37 devstack sudo[76977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 12:04:37 devstack sudo[76977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:04:38 devstack sudo[76977]: pam_unix(sudo:session): session closed for user root Nov 04 12:04:38 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:04:38 devstack cinder-volume[76171]: DEBUG cinder.volume.drivers.lvm [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] Updating volume stats {{(pid=76171) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 04 12:04:38 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:04:38 devstack sudo[76980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 04 12:04:38 devstack sudo[76980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:04:38 devstack sudo[76980]: pam_unix(sudo:session): session closed for user root Nov 04 12:04:38 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:04:38 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:04:38 devstack sudo[76989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 12:04:38 devstack sudo[76989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:04:38 devstack sudo[76989]: pam_unix(sudo:session): session closed for user root Nov 04 12:04:38 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:04:38 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:04:38 devstack sudo[76992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 12:04:38 devstack sudo[76992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:04:38 devstack sudo[76992]: pam_unix(sudo:session): session closed for user root Nov 04 12:04:38 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.250s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:04:38 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:04:38 devstack sudo[76995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 12:04:38 devstack sudo[76995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:04:39 devstack sudo[76995]: pam_unix(sudo:session): session closed for user root Nov 04 12:04:39 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:04:39 devstack cinder-volume[76171]: INFO cinder.volume.driver [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] Driver hasn't implemented _init_vendor_properties() Nov 04 12:04:39 devstack cinder-volume[76171]: DEBUG cinder.volume.driver [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76171) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 04 12:04:39 devstack cinder-volume[76171]: DEBUG oslo_db.sqlalchemy.engines [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76171) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 12:04:39 devstack cinder-volume[76171]: DEBUG dbcounter [-] [76171] Writer thread running {{(pid=76171) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 04 12:04:39 devstack cinder-volume[76171]: DEBUG cinder.db.api [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] Building query based on filter {{(pid=76171) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 04 12:04:39 devstack cinder-volume[76171]: DEBUG cinder.image.image_utils [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76171) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 04 12:04:39 devstack cinder-volume[76171]: INFO cinder.keymgr.migration [None req-a3376365-3180-4c17-b656-41d61d8865c0 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 04 12:04:39 devstack cinder-volume[76171]: DEBUG cinder.volume.drivers.lvm [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] Updating volume stats {{(pid=76171) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 04 12:04:39 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:04:39 devstack sudo[76999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 04 12:04:39 devstack sudo[76999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:04:39 devstack sudo[76999]: pam_unix(sudo:session): session closed for user root Nov 04 12:04:39 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:04:39 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:04:39 devstack sudo[77002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 12:04:39 devstack sudo[77002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:04:39 devstack sudo[77002]: pam_unix(sudo:session): session closed for user root Nov 04 12:04:39 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:04:39 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:04:39 devstack sudo[77005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 12:04:39 devstack sudo[77005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:04:40 devstack sudo[77005]: pam_unix(sudo:session): session closed for user root Nov 04 12:04:40 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.279s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:04:40 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:04:40 devstack sudo[77011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 12:04:40 devstack sudo[77011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:04:40 devstack sudo[77011]: pam_unix(sudo:session): session closed for user root Nov 04 12:04:40 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:04:40 devstack cinder-volume[76171]: DEBUG cinder.manager [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] Notifying Schedulers of capabilities ... {{(pid=76171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:04:40 devstack cinder-volume[76171]: INFO cinder.volume.manager [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] Driver initialization completed successfully. Nov 04 12:04:40 devstack cinder-volume[76171]: INFO cinder.manager [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] Initiating service 2 cleanup Nov 04 12:04:40 devstack cinder-volume[76171]: INFO cinder.manager [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] Service 2 cleanup completed. Nov 04 12:04:40 devstack cinder-volume[76171]: DEBUG cinder.service [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] Creating RPC server for service cinder-volume {{(pid=76171) start /opt/stack/cinder/cinder/service.py:231}} Nov 04 12:04:40 devstack cinder-volume[76171]: DEBUG cinder.service [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76171) start /opt/stack/cinder/cinder/service.py:237}} Nov 04 12:04:40 devstack cinder-volume[76171]: INFO cinder.volume.manager [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Nov 04 12:04:40 devstack cinder-volume[76171]: DEBUG cinder.volume.drivers.lvm [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] Updating volume stats {{(pid=76171) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 04 12:04:40 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:04:40 devstack sudo[77014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 04 12:04:40 devstack sudo[77014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:04:40 devstack sudo[77014]: pam_unix(sudo:session): session closed for user root Nov 04 12:04:40 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:04:40 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:04:40 devstack sudo[77017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 12:04:40 devstack sudo[77017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:04:41 devstack sudo[77017]: pam_unix(sudo:session): session closed for user root Nov 04 12:04:41 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:04:41 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:04:41 devstack sudo[77020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 12:04:41 devstack sudo[77020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:04:41 devstack sudo[77020]: pam_unix(sudo:session): session closed for user root Nov 04 12:04:41 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.240s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:04:41 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:04:41 devstack sudo[77027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 12:04:41 devstack sudo[77027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:04:41 devstack sudo[77027]: pam_unix(sudo:session): session closed for user root Nov 04 12:04:41 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:04:41 devstack cinder-volume[76171]: INFO cinder.volume.manager [None req-89f70fa2-48f1-4259-a562-7232f537db3a None None] Driver post RPC initialization completed successfully. Nov 04 12:04:44 devstack cinder-volume[76025]: DEBUG dbcounter [-] [76025] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76025) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 12:04:48 devstack cinder-volume[76171]: DEBUG oslo_service.periodic_task [None req-5504d483-01c3-47c9-b455-06191acea02a None None] Running periodic task VolumeManager._thread_info {{(pid=76171) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 12:04:48 devstack cinder-volume[76171]: DEBUG cinder.volume.manager [None req-5504d483-01c3-47c9-b455-06191acea02a None None] thread count: 6 {{(pid=76171) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 12:04:48 devstack cinder-volume[76171]: DEBUG cinder.volume.manager [None req-5504d483-01c3-47c9-b455-06191acea02a None None] thread info: [<_MainThread(MainThread, started 140059131318400)>, , , , , ] {{(pid=76171) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 12:04:51 devstack cinder-volume[76171]: DEBUG dbcounter [-] [76171] Writing DB stats cinder:SELECT=4 {{(pid=76171) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 12:04:51 devstack cinder-volume[76171]: DEBUG dbcounter [-] [76171] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76171) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 12:05:48 devstack cinder-volume[76171]: DEBUG oslo_service.periodic_task [None req-5504d483-01c3-47c9-b455-06191acea02a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76171) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 12:05:48 devstack cinder-volume[76171]: DEBUG cinder.volume.drivers.lvm [None req-5504d483-01c3-47c9-b455-06191acea02a None None] Updating volume stats {{(pid=76171) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 04 12:05:48 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-5504d483-01c3-47c9-b455-06191acea02a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:05:48 devstack sudo[79276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 04 12:05:48 devstack sudo[79276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:05:48 devstack sudo[79276]: pam_unix(sudo:session): session closed for user root Nov 04 12:05:48 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-5504d483-01c3-47c9-b455-06191acea02a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:05:48 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-5504d483-01c3-47c9-b455-06191acea02a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:05:48 devstack sudo[79279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 12:05:48 devstack sudo[79279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:05:49 devstack sudo[79279]: pam_unix(sudo:session): session closed for user root Nov 04 12:05:49 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-5504d483-01c3-47c9-b455-06191acea02a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:05:49 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-5504d483-01c3-47c9-b455-06191acea02a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:05:49 devstack sudo[79282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 12:05:49 devstack sudo[79282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:05:49 devstack sudo[79282]: pam_unix(sudo:session): session closed for user root Nov 04 12:05:49 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-5504d483-01c3-47c9-b455-06191acea02a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:05:49 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-5504d483-01c3-47c9-b455-06191acea02a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:05:49 devstack sudo[79285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 12:05:49 devstack sudo[79285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:05:49 devstack sudo[79285]: pam_unix(sudo:session): session closed for user root Nov 04 12:05:49 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-5504d483-01c3-47c9-b455-06191acea02a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.242s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:05:49 devstack cinder-volume[76171]: DEBUG cinder.manager [None req-5504d483-01c3-47c9-b455-06191acea02a None None] Notifying Schedulers of capabilities ... {{(pid=76171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:05:49 devstack cinder-volume[76171]: DEBUG oslo_service.periodic_task [None req-5504d483-01c3-47c9-b455-06191acea02a None None] Running periodic task VolumeManager._thread_info {{(pid=76171) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 12:05:49 devstack cinder-volume[76171]: DEBUG cinder.volume.manager [None req-5504d483-01c3-47c9-b455-06191acea02a None None] thread count: 6 {{(pid=76171) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 12:05:49 devstack cinder-volume[76171]: DEBUG cinder.volume.manager [None req-5504d483-01c3-47c9-b455-06191acea02a None None] thread info: [<_MainThread(MainThread, started 140059131318400)>, , , , , ] {{(pid=76171) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 12:06:48 devstack cinder-volume[76171]: DEBUG oslo_service.periodic_task [None req-5504d483-01c3-47c9-b455-06191acea02a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76171) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 12:06:48 devstack cinder-volume[76171]: DEBUG cinder.volume.drivers.lvm [None req-5504d483-01c3-47c9-b455-06191acea02a None None] Updating volume stats {{(pid=76171) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 04 12:06:48 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-5504d483-01c3-47c9-b455-06191acea02a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:06:48 devstack sudo[82487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 04 12:06:48 devstack sudo[82487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:06:48 devstack sudo[82487]: pam_unix(sudo:session): session closed for user root Nov 04 12:06:48 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-5504d483-01c3-47c9-b455-06191acea02a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:06:48 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-5504d483-01c3-47c9-b455-06191acea02a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:06:48 devstack sudo[82494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 12:06:48 devstack sudo[82494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:06:49 devstack sudo[82494]: pam_unix(sudo:session): session closed for user root Nov 04 12:06:49 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-5504d483-01c3-47c9-b455-06191acea02a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:06:49 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-5504d483-01c3-47c9-b455-06191acea02a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:06:49 devstack sudo[82498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 12:06:49 devstack sudo[82498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:06:49 devstack sudo[82498]: pam_unix(sudo:session): session closed for user root Nov 04 12:06:49 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-5504d483-01c3-47c9-b455-06191acea02a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:06:49 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-5504d483-01c3-47c9-b455-06191acea02a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:06:49 devstack sudo[82504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 12:06:49 devstack sudo[82504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:06:49 devstack sudo[82504]: pam_unix(sudo:session): session closed for user root Nov 04 12:06:49 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-5504d483-01c3-47c9-b455-06191acea02a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:06:49 devstack cinder-volume[76171]: DEBUG cinder.manager [None req-5504d483-01c3-47c9-b455-06191acea02a None None] Notifying Schedulers of capabilities ... {{(pid=76171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:06:49 devstack cinder-volume[76171]: DEBUG oslo_service.periodic_task [None req-5504d483-01c3-47c9-b455-06191acea02a None None] Running periodic task VolumeManager._thread_info {{(pid=76171) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 12:06:49 devstack cinder-volume[76171]: DEBUG cinder.volume.manager [None req-5504d483-01c3-47c9-b455-06191acea02a None None] thread count: 6 {{(pid=76171) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 12:06:49 devstack cinder-volume[76171]: DEBUG cinder.volume.manager [None req-5504d483-01c3-47c9-b455-06191acea02a None None] thread info: [<_MainThread(MainThread, started 140059131318400)>, , , , , ] {{(pid=76171) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 12:06:51 devstack cinder-volume[76171]: DEBUG dbcounter [-] [76171] Writing DB stats cinder:SELECT=1 {{(pid=76171) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 12:06:51 devstack cinder-volume[76171]: DEBUG dbcounter [-] [76171] Writing DB stats cinder:UPDATE=1 {{(pid=76171) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 12:07:48 devstack cinder-volume[76171]: DEBUG oslo_service.periodic_task [None req-5504d483-01c3-47c9-b455-06191acea02a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76171) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 12:07:48 devstack cinder-volume[76171]: DEBUG cinder.volume.drivers.lvm [None req-5504d483-01c3-47c9-b455-06191acea02a None None] Updating volume stats {{(pid=76171) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 04 12:07:48 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-5504d483-01c3-47c9-b455-06191acea02a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:07:48 devstack sudo[84610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 04 12:07:48 devstack sudo[84610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:07:48 devstack sudo[84610]: pam_unix(sudo:session): session closed for user root Nov 04 12:07:48 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-5504d483-01c3-47c9-b455-06191acea02a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:07:48 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-5504d483-01c3-47c9-b455-06191acea02a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:07:48 devstack sudo[84614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 12:07:48 devstack sudo[84614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:07:49 devstack sudo[84614]: pam_unix(sudo:session): session closed for user root Nov 04 12:07:49 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-5504d483-01c3-47c9-b455-06191acea02a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:07:49 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-5504d483-01c3-47c9-b455-06191acea02a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:07:49 devstack sudo[84618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 12:07:49 devstack sudo[84618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:07:49 devstack sudo[84618]: pam_unix(sudo:session): session closed for user root Nov 04 12:07:49 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-5504d483-01c3-47c9-b455-06191acea02a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.267s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:07:49 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-5504d483-01c3-47c9-b455-06191acea02a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:07:49 devstack sudo[84621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 12:07:49 devstack sudo[84621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:07:49 devstack sudo[84621]: pam_unix(sudo:session): session closed for user root Nov 04 12:07:49 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-5504d483-01c3-47c9-b455-06191acea02a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:07:49 devstack cinder-volume[76171]: DEBUG cinder.manager [None req-5504d483-01c3-47c9-b455-06191acea02a None None] Notifying Schedulers of capabilities ... {{(pid=76171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:08:48 devstack cinder-volume[76171]: DEBUG oslo_service.periodic_task [None req-5504d483-01c3-47c9-b455-06191acea02a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76171) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 12:08:48 devstack cinder-volume[76171]: DEBUG cinder.volume.drivers.lvm [None req-5504d483-01c3-47c9-b455-06191acea02a None None] Updating volume stats {{(pid=76171) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 04 12:08:48 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-5504d483-01c3-47c9-b455-06191acea02a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:08:48 devstack sudo[85792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 04 12:08:48 devstack sudo[85792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:08:48 devstack sudo[85792]: pam_unix(sudo:session): session closed for user root Nov 04 12:08:48 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-5504d483-01c3-47c9-b455-06191acea02a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:08:48 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-5504d483-01c3-47c9-b455-06191acea02a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:08:48 devstack sudo[85796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 12:08:48 devstack sudo[85796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:08:49 devstack sudo[85796]: pam_unix(sudo:session): session closed for user root Nov 04 12:08:49 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-5504d483-01c3-47c9-b455-06191acea02a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:08:49 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-5504d483-01c3-47c9-b455-06191acea02a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:08:49 devstack sudo[85799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 12:08:49 devstack sudo[85799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:08:49 devstack sudo[85799]: pam_unix(sudo:session): session closed for user root Nov 04 12:08:49 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-5504d483-01c3-47c9-b455-06191acea02a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:08:49 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-5504d483-01c3-47c9-b455-06191acea02a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:08:49 devstack sudo[85813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 12:08:49 devstack sudo[85813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:08:49 devstack sudo[85813]: pam_unix(sudo:session): session closed for user root Nov 04 12:08:49 devstack cinder-volume[76171]: DEBUG oslo_concurrency.processutils [None req-5504d483-01c3-47c9-b455-06191acea02a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:08:49 devstack cinder-volume[76171]: DEBUG cinder.manager [None req-5504d483-01c3-47c9-b455-06191acea02a None None] Notifying Schedulers of capabilities ... {{(pid=76171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:08:49 devstack cinder-volume[76171]: DEBUG oslo_service.periodic_task [None req-5504d483-01c3-47c9-b455-06191acea02a None None] Running periodic task VolumeManager._thread_info {{(pid=76171) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 12:08:49 devstack cinder-volume[76171]: DEBUG cinder.volume.manager [None req-5504d483-01c3-47c9-b455-06191acea02a None None] thread count: 6 {{(pid=76171) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 12:08:49 devstack cinder-volume[76171]: DEBUG cinder.volume.manager [None req-5504d483-01c3-47c9-b455-06191acea02a None None] thread info: [<_MainThread(MainThread, started 140059131318400)>, , , , , ] {{(pid=76171) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 12:08:51 devstack cinder-volume[76171]: DEBUG dbcounter [-] [76171] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76171) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 12:09:01 devstack cinder-volume[76025]: INFO oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] Caught SIGTERM, stopping children Nov 04 12:09:01 devstack cinder-volume[76025]: DEBUG oslo_concurrency.lockutils [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] Acquiring lock "singleton_lock" {{(pid=76025) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 04 12:09:01 devstack cinder-volume[76025]: DEBUG oslo_concurrency.lockutils [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] Acquired lock "singleton_lock" {{(pid=76025) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 04 12:09:01 devstack cinder-volume[76025]: DEBUG oslo_concurrency.lockutils [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] Releasing lock "singleton_lock" {{(pid=76025) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 04 12:09:01 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] Stop services. {{(pid=76025) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 04 12:09:01 devstack cinder-volume[76025]: DEBUG oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] Killing children. {{(pid=76025) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 04 12:09:01 devstack cinder-volume[76025]: INFO oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] Waiting on 1 children to exit Nov 04 12:09:05 devstack cinder-volume[76171]: DEBUG oslo_concurrency.lockutils [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] Acquiring lock "singleton_lock" {{(pid=76171) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 04 12:09:05 devstack cinder-volume[76171]: DEBUG oslo_concurrency.lockutils [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] Acquired lock "singleton_lock" {{(pid=76171) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 04 12:09:05 devstack cinder-volume[76171]: DEBUG oslo_concurrency.lockutils [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] Releasing lock "singleton_lock" {{(pid=76171) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 04 12:09:05 devstack cinder-volume[76171]: WARNING amqp [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 04 12:09:05 devstack cinder-volume[76171]: WARNING amqp [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 04 12:09:05 devstack cinder-volume[76025]: INFO oslo_service.backend._eventlet.service [None req-719775cf-24fc-4249-b6ee-72417e8ed70f None None] Child 76171 exited with status 0 Nov 04 12:09:05 devstack cinder-volume[86214]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 04 12:09:05 devstack cinder-volume[86214]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 04 12:09:05 devstack cinder-volume[86214]: we strongly recommend against using it for new projects. Nov 04 12:09:05 devstack cinder-volume[86214]: If you are already using Eventlet, we recommend migrating to a different Nov 04 12:09:05 devstack cinder-volume[86214]: framework. For more detail see Nov 04 12:09:05 devstack cinder-volume[86214]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 04 12:09:05 devstack cinder-volume[86214]: import eventlet # noqa Nov 04 12:09:08 devstack cinder-volume[86214]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86214) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 04 12:09:08 devstack cinder-volume[86214]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86214) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 04 12:09:08 devstack cinder-volume[86214]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86214) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 04 12:09:08 devstack cinder-volume[86214]: INFO dbcounter [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] Registered counter for database cinder Nov 04 12:09:08 devstack cinder-volume[86214]: DEBUG oslo_db.sqlalchemy.engines [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86214) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG dbcounter [-] [86214] Writer thread running {{(pid=86214) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 04 12:09:09 devstack cinder-volume[86214]: INFO cinder.rpc [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 04 12:09:09 devstack cinder-volume[86214]: INFO cinder.rpc [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_db.sqlalchemy.engines [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86214) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 12:09:09 devstack cinder-volume[86214]: INFO cinder.volume.manager [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] Determined volume DB was empty at startup. Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG cinder.volume.manager [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86214) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 04 12:09:09 devstack cinder-volume[86214]: INFO cinder.volume.manager [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 04 12:09:09 devstack cinder-volume[86214]: WARNING stevedore.named [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 04 12:09:09 devstack cinder-volume[86214]: WARNING castellan.key_manager [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 04 12:09:09 devstack cinder-volume[86214]: WARNING cinder.keymgr.conf_key_mgr [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 04 12:09:09 devstack cinder-volume[86214]: INFO cinder.volume.manager [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_db.sqlalchemy.engines [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86214) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 12:09:09 devstack cinder-volume[86214]: INFO oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] Starting 1 workers Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] Started child 86431 {{(pid=86214) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] Full set of CONF: {{(pid=86214) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] ******************************************************************************** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] Configuration options gathered from: {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] ================================================================================ {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] allow_availability_zone_fallback = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] allow_compression_on_image_upload = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86431]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] allowed_direct_url_schemes = [] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] api_rate_limit = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] auth_strategy = keystone {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_availability_zone = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_host = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_name = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_stats_polling_interval = 60 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backup_api_class = cinder.backup.api.API {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backup_name_template = backup-%s {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backup_use_same_host = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backup_use_temp_snapshot = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] chap_password = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] chap_username = {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] cinder_internal_tenant_project_id = 98bacb5047f445489c2f103d4fb9aa7e {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] cinder_internal_tenant_user_id = 7b2c5889cb95402ebecd2d0176a9d581 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] cluster = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] compression_format = gzip {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] compute_api_class = cinder.compute.nova.API {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] config_dir = [] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] config_source = [] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] control_exchange = openstack {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] debug = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] default_availability_zone = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] default_group_type = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] default_volume_type = QuobyteHD {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] disk_geometry = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] driver_client_cert = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] driver_client_cert_key = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] driver_data_namespace = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] driver_ssl_cert_path = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] driver_ssl_cert_verify = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] driver_use_ssl = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] enable_new_services = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] enable_unsupported_driver = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] enabled_backends = ['QuobyteHD'] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] enforce_multipath_for_image_xfer = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] filter_function = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] glance_api_insecure = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] glance_api_servers = ['http://192.168.122.181/image'] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] glance_api_ssl_compression = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] glance_ca_certificates_file = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] glance_catalog_info = image:glance:publicURL {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] glance_certfile = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] glance_keyfile = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] glance_num_retries = 3 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] glance_request_timeout = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] goodness_function = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] graceful_shutdown_timeout = 5 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] group_api_class = cinder.group.api.API {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] host = devstack {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] image_compress_on_upload = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] image_conversion_address_space_limit = 1 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] image_conversion_cpu_limit = 60 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] image_conversion_disable = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] image_introspection_address_space_limit = 1 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] image_introspection_cpu_limit = 60 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] image_upload_use_cinder_backend = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] image_upload_use_internal_tenant = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] image_volume_cache_enabled = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] image_volume_cache_max_count = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] image_volume_cache_max_size_gb = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] init_host_max_objects_retrieval = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] instance_format = [instance: %(uuid)s] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] iscsi_target_flags = {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-7055d5f3-be7e-49aa-b3ea-dfa75cdc5863 None None] Starting volume driver QuobyteDriver (1.2.1) Nov 04 12:09:09 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-7055d5f3-be7e-49aa-b3ea-dfa75cdc5863 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86431) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] iscsi_write_cache = on {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] iser_helper = tgtadm {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] iser_ip_address = 192.168.122.181 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] iser_port = 3260 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] log_color = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] log_config_append = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] log_dir = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] log_file = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] log_options = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] log_rotate_interval = 1 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] log_rotate_interval_type = days {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] log_rotation_type = none {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] max_age = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] max_logfile_count = 30 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] max_logfile_size_mb = 200 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] max_over_subscription_ratio = 20.0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] message_reap_interval = 86400 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] message_ttl = 2592000 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] migration_create_volume_timeout_secs = 300 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] monkey_patch = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] monkey_patch_modules = [] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] my_ip = 192.168.122.181 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] no_snapshot_gb_quota = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] num_iser_scan_tries = 3 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] num_shell_tries = 3 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] num_volume_device_scan_tries = 3 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] nvmeof_conn_info_version = 1 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] nvmet_ns_id = 10 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] nvmet_port_id = 1 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] osapi_max_limit = 1000 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] osapi_volume_ext_list = [] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] osapi_volume_listen = 0.0.0.0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] osapi_volume_listen_port = 8776 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] osapi_volume_use_ssl = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] osapi_volume_workers = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] per_volume_size_limit = -1 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] periodic_fuzzy_delay = 60 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] periodic_interval = 60 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] project_id_regex = [0-9a-f\-]+ {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] public_endpoint = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] publish_errors = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] quota_backup_gigabytes = 1000 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] quota_backups = 10 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] quota_gigabytes = 1000 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] quota_groups = 10 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] quota_snapshots = 10 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] quota_volumes = 10 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] rate_limit_burst = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] rate_limit_except_level = CRITICAL {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] rate_limit_interval = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] reinit_driver_count = 3 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] replication_device = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] report_discard_supported = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] report_interval = 120 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] reservation_clean_interval = 86400 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] reservation_expire = 86400 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] reserved_image_namespaces = [] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] reserved_percentage = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] rpc_response_timeout = 120 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] run_external_periodic_tasks = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] scst_target_driver = iscsi {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] scst_target_iqn_name = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] service_down_time = 720 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] shell_completion = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] snapshot_name_template = snapshot-%s {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] split_loggers = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] state_path = /opt/stack/data/cinder {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] storage_availability_zone = nova {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] storage_protocol = iSCSI {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] syslog_log_facility = LOG_USER {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] target_helper = lioadm {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] target_ip_address = 192.168.122.181 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] target_port = 3260 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] target_protocol = iscsi {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] target_secondary_ip_addresses = [] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] trace_flags = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] transfer_api_class = cinder.transfer.api.API {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] transport_url = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] until_refresh = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] use_chap_auth = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] use_default_quota_class = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] use_journal = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] use_json = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] use_multipath_for_image_xfer = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] use_stderr = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] use_syslog = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] verify_glance_signatures = enabled {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] volume_api_class = cinder.volume.api.API {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] volume_backend_name = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] volume_clear = zero {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] volume_clear_ionice = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] volume_clear_size = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] volume_copy_bps_limit = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] volume_dd_blocksize = 1M {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] volume_name_template = volume-%s {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] volume_service_inithost_offload = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] volume_usage_audit_period = month {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] zoning_mode = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] oslo_concurrency.disable_process_locking = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] keystone_authtoken.auth_section = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] keystone_authtoken.auth_type = password {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] keystone_authtoken.auth_version = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] keystone_authtoken.cache = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] keystone_authtoken.certfile = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] keystone_authtoken.delay_auth_decision = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] keystone_authtoken.http_connect_timeout = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] keystone_authtoken.include_service_catalog = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] keystone_authtoken.insecure = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] keystone_authtoken.interface = public {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] keystone_authtoken.keyfile = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] keystone_authtoken.memcache_password = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-7055d5f3-be7e-49aa-b3ea-dfa75cdc5863 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86431) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] keystone_authtoken.memcache_username = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.quobyte [None req-7055d5f3-be7e-49aa-b3ea-dfa75cdc5863 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 04 12:09:09 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.quobyte [None req-7055d5f3-be7e-49aa-b3ea-dfa75cdc5863 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] keystone_authtoken.region_name = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] keystone_authtoken.service_token_roles_required = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] keystone_authtoken.service_type = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] keystone_authtoken.token_cache_time = 300 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.181/identity {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] cache.backend = dogpile.cache.null {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] cache.backend_argument = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] cache.backend_expiration_time = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] cache.config_prefix = cache.oslo {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] cache.debug_cache_backend = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] cache.enable_retry_client = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] cache.enable_socket_keepalive = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] cache.enabled = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] cache.expiration_time = 600 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-7055d5f3-be7e-49aa-b3ea-dfa75cdc5863 None None] Running cmd (subprocess): mount.quobyte {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] cache.hashclient_retry_attempts = 2 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] cache.memcache_dead_retry = 300 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] cache.memcache_pool_maxsize = 10 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] cache.memcache_sasl_enabled = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] cache.password = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] cache.proxies = [] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] cache.redis_db = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] cache.redis_sentinel_service_name = mymaster {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] cache.redis_server = localhost:6379 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] cache.retry_attempts = 2 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] cache.retry_delay = 0.0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] cache.socket_keepalive_count = 1 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] cache.socket_keepalive_idle = 1 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] cache.socket_keepalive_interval = 1 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] cache.socket_timeout = 1.0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] cache.tls_allowed_ciphers = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] cache.tls_cafile = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] cache.tls_certfile = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] cache.tls_enabled = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] cache.tls_keyfile = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] cache.username = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] coordination.backend_url = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] database.asyncio_connection = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] database.asyncio_slave_connection = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] database.backend = sqlalchemy {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] database.connection = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] database.connection_debug = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] database.connection_parameters = {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] database.connection_recycle_time = 3600 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] database.connection_trace = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] database.db_inc_retry_interval = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] database.db_max_retries = 20 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] database.db_max_retry_interval = 10 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] database.db_retry_interval = 1 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] database.max_overflow = 50 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] database.max_pool_size = 5 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] database.max_retries = 10 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] database.mysql_wsrep_sync_wait = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] database.pool_timeout = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] database.retry_interval = 10 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] database.slave_connection = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] database.sqlite_synchronous = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] database.synchronous_reader = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] database.use_db_reconnect = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] oslo_messaging_tracing.insecure = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] profiler.connection_string = messaging:// {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] profiler.enabled = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] profiler.es_doc_type = notification {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] profiler.es_scroll_size = 10000 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] profiler.es_scroll_time = 2m {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] profiler.filter_error_trace = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] profiler.hmac_keys = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] profiler.sentinel_service_name = mymaster {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] profiler.socket_timeout = 0.1 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] profiler.trace_requests = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] profiler.trace_sqlalchemy = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] profiler_jaeger.process_tags = {} {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] profiler_jaeger.service_name_prefix = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] profiler_otlp.service_name_prefix = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] oslo_policy.enforce_new_defaults = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] oslo_policy.policy_default_rule = default {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] oslo_policy.policy_file = policy.yaml {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] oslo_policy.remote_timeout = 60.0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] privsep_osbrick.group = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] privsep_osbrick.helper_command = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] privsep_osbrick.user = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] cinder_sys_admin.group = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] cinder_sys_admin.helper_command = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] cinder_sys_admin.user = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] service_user.auth_section = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] service_user.auth_type = password {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] service_user.cafile = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] service_user.certfile = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] service_user.collect_timing = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] service_user.insecure = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] service_user.keyfile = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] service_user.send_service_user_token = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] service_user.split_loggers = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] service_user.timeout = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] service_user.tls_ciphers = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] service_user.tls_min_version = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] glance.auth_section = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] glance.auth_type = password {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] glance.certfile = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] glance.collect_timing = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] glance.insecure = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] glance.keyfile = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] glance.region_name = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] glance.split_loggers = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] glance.timeout = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] glance.tls_ciphers = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] glance.tls_min_version = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.backend_availability_zone = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.chap_password = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.chap_username = {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.disk_geometry = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.driver_client_cert = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.driver_client_cert_key = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.driver_data_namespace = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.driver_use_ssl = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.enable_unsupported_driver = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.extra_capabilities = {} {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.filter_function = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.goodness_function = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.iscsi_target_flags = {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.iscsi_write_cache = on {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.iser_helper = tgtadm {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.iser_ip_address = 192.168.122.181 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.iser_port = 3260 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.nas_host = {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.nas_login = admin {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.nas_mount_options = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.nas_password = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.nas_private_key = {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.nas_share_path = {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.nas_ssh_port = 22 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.num_shell_tries = 3 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.nvmet_port_id = 1 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.quobyte_client_cfg = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack quobyte-client[86432]: Reading configuration file: /etc/quobyte/client.cfg Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.quobyte_volume_url = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.replication_device = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.report_discard_supported = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.reserved_percentage = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.scst_target_driver = iscsi {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack quobyte-client[86432]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.scst_target_iqn_name = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.storage_protocol = iSCSI {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.target_helper = tgtadm {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.target_ip_address = 192.168.122.181 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.target_port = 3260 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.target_protocol = iscsi {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.trace_flags = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.unique_fqdn_network = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.use_chap_auth = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.volume_backend_name = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.volume_clear = zero {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.volume_clear_ionice = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.volume_clear_size = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] oslo_reports.file_event_handler = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] oslo_reports.log_dir = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.backend_availability_zone = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.backend_host = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.chap_password = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.chap_username = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.chiscsi_conf = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.disk_geometry = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.driver_client_cert = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.driver_client_cert_key = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.driver_data_namespace = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.driver_use_ssl = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-7055d5f3-be7e-49aa-b3ea-dfa75cdc5863 None None] CMD "mount.quobyte" returned: 1 in 0.149s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.extra_capabilities = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-7055d5f3-be7e-49aa-b3ea-dfa75cdc5863 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.filter_function = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-7055d5f3-be7e-49aa-b3ea-dfa75cdc5863 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.goodness_function = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.iscsi_target_flags = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.iscsi_write_cache = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-7055d5f3-be7e-49aa-b3ea-dfa75cdc5863 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.iser_helper = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.iser_ip_address = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.iser_port = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.iser_target_prefix = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.nas_host = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.nas_login = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.nas_mount_options = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.nas_password = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.nas_private_key = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86431]: INFO cinder.volume.drivers.quobyte [None req-7055d5f3-be7e-49aa-b3ea-dfa75cdc5863 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 ... Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.nas_share_path = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.nas_ssh_port = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-7055d5f3-be7e-49aa-b3ea-dfa75cdc5863 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa -c /etc/quobyte/client-cinder.cfg {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.num_shell_tries = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.nvmet_ns_id = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.nvmet_port_id = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.replication_device = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.report_discard_supported = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.reserved_percentage = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.scst_target_driver = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.storage_protocol = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.target_helper = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.target_ip_address = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.target_port = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.target_prefix = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.target_protocol = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.trace_flags = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.unique_fqdn_network = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.use_chap_auth = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.volume_clear = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.volume_clear_ionice = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.volume_clear_size = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] QuobyteHD.volumes_dir = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] oslo_messaging_rabbit.ssl = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] oslo_messaging_rabbit.ssl_version = {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] oslo_messaging_notifications.driver = [] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] oslo_messaging_notifications.retry = -1 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] oslo_messaging_notifications.transport_url = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] key_manager.fixed_key = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] barbican.barbican_api_version = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] barbican.barbican_endpoint = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] barbican.barbican_endpoint_type = public {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] barbican.barbican_region_name = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] barbican.cafile = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] barbican.certfile = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] barbican.collect_timing = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] barbican.insecure = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] barbican.keyfile = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] barbican.number_of_retries = 60 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] barbican.retry_delay = 1 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] barbican.send_service_user_token = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] barbican.split_loggers = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] barbican.timeout = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] barbican.tls_ciphers = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] barbican.tls_min_version = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] barbican.verify_ssl = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] barbican.verify_ssl_path = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] barbican_service_user.auth_section = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] barbican_service_user.auth_type = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] barbican_service_user.cafile = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] barbican_service_user.certfile = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] barbican_service_user.collect_timing = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] barbican_service_user.insecure = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] barbican_service_user.keyfile = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] barbican_service_user.split_loggers = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] barbican_service_user.timeout = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] barbican_service_user.tls_ciphers = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] barbican_service_user.tls_min_version = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] vault.approle_role_id = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] vault.approle_secret_id = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] vault.auth_method = approle {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] vault.auth_path = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] vault.kv_mountpoint = secret {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] vault.kv_path = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] vault.kv_version = 2 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] vault.namespace = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] vault.root_token_id = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] vault.ssl_ca_crt_file = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] vault.timeout = 60.0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] vault.token_file = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] vault.token_role = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] vault.use_ssl = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:09 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] ******************************************************************************** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 04 12:09:09 devstack sudo[86437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa -c /etc/quobyte/client-cinder.cfg Nov 04 12:09:09 devstack sudo[86437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:09:10 devstack sudo[86437]: pam_unix(sudo:session): session closed for user root Nov 04 12:09:10 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-7055d5f3-be7e-49aa-b3ea-dfa75cdc5863 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.473s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:09:10 devstack cinder-volume[86431]: INFO cinder.volume.drivers.quobyte [None req-7055d5f3-be7e-49aa-b3ea-dfa75cdc5863 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 succeeded Nov 04 12:09:10 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-7055d5f3-be7e-49aa-b3ea-dfa75cdc5863 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:09:10 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-7055d5f3-be7e-49aa-b3ea-dfa75cdc5863 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.493s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:09:10 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-7055d5f3-be7e-49aa-b3ea-dfa75cdc5863 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:09:10 devstack sudo[86573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:09:10 devstack sudo[86573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:09:10 devstack sudo[86573]: pam_unix(sudo:session): session closed for user root Nov 04 12:09:10 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-7055d5f3-be7e-49aa-b3ea-dfa75cdc5863 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.249s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:09:10 devstack cinder-volume[86431]: INFO cinder.volume.driver [None req-7055d5f3-be7e-49aa-b3ea-dfa75cdc5863 None None] Driver hasn't implemented _init_vendor_properties() Nov 04 12:09:10 devstack cinder-volume[86431]: DEBUG cinder.volume.driver [None req-7055d5f3-be7e-49aa-b3ea-dfa75cdc5863 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6071128845215, 'free_capacity_gb': 1773.6071128845215, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86431) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 04 12:09:10 devstack cinder-volume[86431]: DEBUG oslo_db.sqlalchemy.engines [None req-7055d5f3-be7e-49aa-b3ea-dfa75cdc5863 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86431) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 12:09:10 devstack cinder-volume[86431]: DEBUG dbcounter [-] [86431] Writer thread running {{(pid=86431) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 04 12:09:10 devstack cinder-volume[86431]: DEBUG cinder.db.api [None req-7055d5f3-be7e-49aa-b3ea-dfa75cdc5863 None None] Building query based on filter {{(pid=86431) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 04 12:09:10 devstack cinder-volume[86431]: DEBUG cinder.image.image_utils [None req-7055d5f3-be7e-49aa-b3ea-dfa75cdc5863 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86431) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 04 12:09:10 devstack cinder-volume[86431]: INFO cinder.keymgr.migration [None req-43c6f4b1-940b-4b15-a351-5476a4e857ad None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 04 12:09:10 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-7055d5f3-be7e-49aa-b3ea-dfa75cdc5863 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:09:10 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-7055d5f3-be7e-49aa-b3ea-dfa75cdc5863 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:09:10 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-7055d5f3-be7e-49aa-b3ea-dfa75cdc5863 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:09:10 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-7055d5f3-be7e-49aa-b3ea-dfa75cdc5863 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:09:10 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-7055d5f3-be7e-49aa-b3ea-dfa75cdc5863 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:09:10 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-7055d5f3-be7e-49aa-b3ea-dfa75cdc5863 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:09:10 devstack sudo[86578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:09:10 devstack sudo[86578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:09:10 devstack sudo[86578]: pam_unix(sudo:session): session closed for user root Nov 04 12:09:10 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-7055d5f3-be7e-49aa-b3ea-dfa75cdc5863 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.235s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:09:10 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-7055d5f3-be7e-49aa-b3ea-dfa75cdc5863 None None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:09:10 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-7055d5f3-be7e-49aa-b3ea-dfa75cdc5863 None None] Driver initialization completed successfully. Nov 04 12:09:10 devstack cinder-volume[86431]: INFO cinder.manager [None req-7055d5f3-be7e-49aa-b3ea-dfa75cdc5863 None None] Initiating service 3 cleanup Nov 04 12:09:10 devstack cinder-volume[86431]: INFO cinder.manager [None req-7055d5f3-be7e-49aa-b3ea-dfa75cdc5863 None None] Service 3 cleanup completed. Nov 04 12:09:10 devstack cinder-volume[86431]: DEBUG cinder.service [None req-7055d5f3-be7e-49aa-b3ea-dfa75cdc5863 None None] Creating RPC server for service cinder-volume {{(pid=86431) start /opt/stack/cinder/cinder/service.py:231}} Nov 04 12:09:10 devstack cinder-volume[86431]: DEBUG cinder.service [None req-7055d5f3-be7e-49aa-b3ea-dfa75cdc5863 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86431) start /opt/stack/cinder/cinder/service.py:237}} Nov 04 12:09:11 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-7055d5f3-be7e-49aa-b3ea-dfa75cdc5863 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 04 12:09:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-7055d5f3-be7e-49aa-b3ea-dfa75cdc5863 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:09:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-7055d5f3-be7e-49aa-b3ea-dfa75cdc5863 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:09:11 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-7055d5f3-be7e-49aa-b3ea-dfa75cdc5863 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:09:11 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-7055d5f3-be7e-49aa-b3ea-dfa75cdc5863 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:09:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-7055d5f3-be7e-49aa-b3ea-dfa75cdc5863 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:09:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-7055d5f3-be7e-49aa-b3ea-dfa75cdc5863 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:09:11 devstack sudo[86581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:09:11 devstack sudo[86581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:09:11 devstack sudo[86581]: pam_unix(sudo:session): session closed for user root Nov 04 12:09:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-7055d5f3-be7e-49aa-b3ea-dfa75cdc5863 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.277s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:09:11 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-7055d5f3-be7e-49aa-b3ea-dfa75cdc5863 None None] Driver post RPC initialization completed successfully. Nov 04 12:09:15 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-fd015e6a-a6b1-4880-b655-ea369d7e39bd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:09:15 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-fd015e6a-a6b1-4880-b655-ea369d7e39bd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:09:15 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-fd015e6a-a6b1-4880-b655-ea369d7e39bd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:09:15 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-fd015e6a-a6b1-4880-b655-ea369d7e39bd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:09:15 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-fd015e6a-a6b1-4880-b655-ea369d7e39bd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:09:15 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-fd015e6a-a6b1-4880-b655-ea369d7e39bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:09:15 devstack sudo[86731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:09:15 devstack sudo[86731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:09:16 devstack sudo[86731]: pam_unix(sudo:session): session closed for user root Nov 04 12:09:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-fd015e6a-a6b1-4880-b655-ea369d7e39bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.253s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:09:16 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-fd015e6a-a6b1-4880-b655-ea369d7e39bd None None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:09:16 devstack cinder-volume[86214]: INFO oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] Caught SIGTERM, stopping children Nov 04 12:09:16 devstack cinder-volume[86214]: DEBUG oslo_concurrency.lockutils [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] Acquiring lock "singleton_lock" {{(pid=86214) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 04 12:09:16 devstack cinder-volume[86214]: DEBUG oslo_concurrency.lockutils [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] Acquired lock "singleton_lock" {{(pid=86214) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 04 12:09:16 devstack cinder-volume[86214]: DEBUG oslo_concurrency.lockutils [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] Releasing lock "singleton_lock" {{(pid=86214) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 04 12:09:16 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] Stop services. {{(pid=86214) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 04 12:09:16 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] Killing children. {{(pid=86214) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 04 12:09:16 devstack cinder-volume[86214]: INFO oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] Waiting on 1 children to exit Nov 04 12:09:19 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] Acquiring lock "singleton_lock" {{(pid=86431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 04 12:09:19 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] Acquired lock "singleton_lock" {{(pid=86431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 04 12:09:19 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] Releasing lock "singleton_lock" {{(pid=86431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 04 12:09:19 devstack cinder-volume[86431]: WARNING amqp [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 04 12:09:19 devstack cinder-volume[86431]: WARNING amqp [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 04 12:09:19 devstack cinder-volume[86214]: INFO oslo_service.backend._eventlet.service [None req-e96cd88a-ddba-4077-8c3c-c9ddc8b1b6ab None None] Child 86431 exited with status 0 Nov 04 12:09:20 devstack cinder-volume[86791]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 04 12:09:20 devstack cinder-volume[86791]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 04 12:09:20 devstack cinder-volume[86791]: we strongly recommend against using it for new projects. Nov 04 12:09:20 devstack cinder-volume[86791]: If you are already using Eventlet, we recommend migrating to a different Nov 04 12:09:20 devstack cinder-volume[86791]: framework. For more detail see Nov 04 12:09:20 devstack cinder-volume[86791]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 04 12:09:20 devstack cinder-volume[86791]: import eventlet # noqa Nov 04 12:09:22 devstack cinder-volume[86791]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86791) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 04 12:09:22 devstack cinder-volume[86791]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86791) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 04 12:09:22 devstack cinder-volume[86791]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86791) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 04 12:09:23 devstack cinder-volume[86791]: INFO dbcounter [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] Registered counter for database cinder Nov 04 12:09:23 devstack cinder-volume[86791]: DEBUG oslo_db.sqlalchemy.engines [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86791) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG dbcounter [-] [86791] Writer thread running {{(pid=86791) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 04 12:09:24 devstack cinder-volume[86791]: INFO cinder.rpc [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 04 12:09:24 devstack cinder-volume[86791]: INFO cinder.rpc [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_db.sqlalchemy.engines [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86791) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 12:09:24 devstack cinder-volume[86791]: INFO cinder.volume.manager [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] Determined volume DB was empty at startup. Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG cinder.volume.manager [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86791) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 04 12:09:24 devstack cinder-volume[86791]: WARNING stevedore.named [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 04 12:09:24 devstack cinder-volume[86791]: WARNING castellan.key_manager [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 04 12:09:24 devstack cinder-volume[86791]: WARNING cinder.keymgr.conf_key_mgr [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 04 12:09:24 devstack cinder-volume[86791]: INFO cinder.volume.manager [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_db.sqlalchemy.engines [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86791) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 12:09:24 devstack cinder-volume[86791]: INFO oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] Starting 1 workers Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] Started child 87095 {{(pid=86791) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] Full set of CONF: {{(pid=86791) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] ******************************************************************************** {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] Configuration options gathered from: {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] ================================================================================ {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] allow_availability_zone_fallback = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] allow_compression_on_image_upload = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[87095]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] allowed_direct_url_schemes = [] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] api_rate_limit = True {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] auth_strategy = keystone {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_availability_zone = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_host = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_name = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_stats_polling_interval = 60 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backup_api_class = cinder.backup.api.API {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backup_name_template = backup-%s {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backup_use_same_host = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backup_use_temp_snapshot = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] chap_password = **** {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] chap_username = {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] cinder_internal_tenant_project_id = 98bacb5047f445489c2f103d4fb9aa7e {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] cinder_internal_tenant_user_id = 7b2c5889cb95402ebecd2d0176a9d581 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] cluster = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] compression_format = gzip {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] compute_api_class = cinder.compute.nova.API {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] config_dir = [] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] config_source = [] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] control_exchange = openstack {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] debug = True {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] default_availability_zone = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] default_group_type = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] default_volume_type = QuobyteHD {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] disk_geometry = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] driver_client_cert = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] driver_client_cert_key = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] driver_data_namespace = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] driver_ssl_cert_path = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] driver_ssl_cert_verify = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] driver_use_ssl = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] enable_new_services = True {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] enable_unsupported_driver = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] enabled_backends = ['QuobyteHD'] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] enforce_multipath_for_image_xfer = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] filter_function = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] glance_api_insecure = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] glance_api_servers = ['http://192.168.122.181/image'] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] glance_api_ssl_compression = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] glance_ca_certificates_file = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] glance_catalog_info = image:glance:publicURL {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] glance_certfile = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] glance_keyfile = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] glance_num_retries = 3 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] glance_request_timeout = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] goodness_function = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] graceful_shutdown_timeout = 5 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] group_api_class = cinder.group.api.API {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] host = devstack {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] image_compress_on_upload = True {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] image_conversion_address_space_limit = 1 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] image_conversion_cpu_limit = 60 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] image_conversion_disable = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] image_introspection_address_space_limit = 1 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] image_introspection_cpu_limit = 60 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] image_upload_use_cinder_backend = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] image_upload_use_internal_tenant = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] image_volume_cache_enabled = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] image_volume_cache_max_count = 0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] image_volume_cache_max_size_gb = 0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] init_host_max_objects_retrieval = 0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] instance_format = [instance: %(uuid)s] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] iscsi_target_flags = {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] iscsi_write_cache = on {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] iser_helper = tgtadm {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] iser_ip_address = 192.168.122.181 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] iser_port = 3260 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] log_color = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] log_config_append = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] log_dir = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] log_file = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] log_options = True {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] log_rotate_interval = 1 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] log_rotate_interval_type = days {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] log_rotation_type = none {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] max_age = 0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] max_logfile_count = 30 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] max_logfile_size_mb = 200 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] max_over_subscription_ratio = 20.0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] message_reap_interval = 86400 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] message_ttl = 2592000 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] migration_create_volume_timeout_secs = 300 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] monkey_patch = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] monkey_patch_modules = [] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] my_ip = 192.168.122.181 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] no_snapshot_gb_quota = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] num_iser_scan_tries = 3 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] num_shell_tries = 3 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] num_volume_device_scan_tries = 3 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] nvmeof_conn_info_version = 1 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] nvmet_ns_id = 10 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] nvmet_port_id = 1 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-429757b8-09f1-4f2e-9b78-35709cd8e105 None None] Starting volume driver QuobyteDriver (1.2.1) Nov 04 12:09:24 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-429757b8-09f1-4f2e-9b78-35709cd8e105 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87095) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] osapi_max_limit = 1000 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] osapi_volume_ext_list = [] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] osapi_volume_listen_port = 8776 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] osapi_volume_use_ssl = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] osapi_volume_workers = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] per_volume_size_limit = -1 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] periodic_fuzzy_delay = 60 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] periodic_interval = 60 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] public_endpoint = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] publish_errors = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] quota_backup_gigabytes = 1000 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] quota_backups = 10 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] quota_gigabytes = 1000 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] quota_groups = 10 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] quota_snapshots = 10 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] quota_volumes = 10 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] rate_limit_burst = 0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] rate_limit_except_level = CRITICAL {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] rate_limit_interval = 0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] reinit_driver_count = 3 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] replication_device = **** {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] report_discard_supported = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] report_interval = 120 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] reservation_clean_interval = 86400 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] reservation_expire = 86400 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] reserved_image_namespaces = [] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] reserved_percentage = 0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] rpc_response_timeout = 120 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] run_external_periodic_tasks = True {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] scst_target_driver = iscsi {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] scst_target_iqn_name = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] service_down_time = 720 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] shell_completion = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] snapshot_name_template = snapshot-%s {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] split_loggers = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] state_path = /opt/stack/data/cinder {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] storage_availability_zone = nova {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] storage_protocol = iSCSI {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] syslog_log_facility = LOG_USER {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] target_helper = lioadm {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] target_ip_address = 192.168.122.181 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] target_port = 3260 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] target_protocol = iscsi {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] target_secondary_ip_addresses = [] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] trace_flags = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] transport_url = **** {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] until_refresh = 0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] use_chap_auth = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] use_default_quota_class = True {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] use_journal = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] use_json = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] use_multipath_for_image_xfer = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] use_stderr = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] use_syslog = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] verify_glance_signatures = enabled {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] volume_api_class = cinder.volume.api.API {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] volume_backend_name = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] volume_clear = zero {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] volume_clear_ionice = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] volume_clear_size = 0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] volume_copy_bps_limit = 0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] volume_dd_blocksize = 1M {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] volume_name_template = volume-%s {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] volume_service_inithost_offload = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] volume_usage_audit_period = month {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] zoning_mode = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] oslo_concurrency.disable_process_locking = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] keystone_authtoken.auth_section = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] keystone_authtoken.auth_type = password {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] keystone_authtoken.auth_version = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] keystone_authtoken.cache = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] keystone_authtoken.certfile = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] keystone_authtoken.include_service_catalog = True {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] keystone_authtoken.insecure = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] keystone_authtoken.interface = public {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] keystone_authtoken.keyfile = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] keystone_authtoken.memcache_password = **** {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] keystone_authtoken.memcache_username = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] keystone_authtoken.region_name = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] keystone_authtoken.service_type = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.181/identity {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] cache.backend = dogpile.cache.null {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] cache.backend_argument = **** {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] cache.backend_expiration_time = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] cache.config_prefix = cache.oslo {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] cache.debug_cache_backend = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] cache.enable_retry_client = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] cache.enable_socket_keepalive = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] cache.enabled = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] cache.expiration_time = 600 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] cache.hashclient_retry_attempts = 2 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] cache.memcache_dead_retry = 300 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] cache.memcache_pool_maxsize = 10 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] cache.memcache_sasl_enabled = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] cache.password = **** {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] cache.proxies = [] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] cache.redis_db = 0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] cache.redis_server = localhost:6379 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] cache.retry_attempts = 2 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] cache.retry_delay = 0.0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] cache.socket_keepalive_count = 1 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] cache.socket_keepalive_idle = 1 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] cache.socket_keepalive_interval = 1 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] cache.socket_timeout = 1.0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] cache.tls_allowed_ciphers = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] cache.tls_cafile = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] cache.tls_certfile = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-429757b8-09f1-4f2e-9b78-35709cd8e105 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87095) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 04 12:09:24 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.quobyte [None req-429757b8-09f1-4f2e-9b78-35709cd8e105 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] cache.tls_enabled = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] cache.tls_keyfile = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] cache.username = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] coordination.backend_url = **** {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] database.asyncio_connection = **** {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.quobyte [None req-429757b8-09f1-4f2e-9b78-35709cd8e105 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] database.asyncio_slave_connection = **** {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] database.backend = sqlalchemy {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] database.connection = **** {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-429757b8-09f1-4f2e-9b78-35709cd8e105 None None] Running cmd (subprocess): mount.quobyte {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] database.connection_debug = 0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] database.connection_parameters = {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] database.connection_recycle_time = 3600 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] database.connection_trace = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] database.db_inc_retry_interval = True {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] database.db_max_retries = 20 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] database.db_max_retry_interval = 10 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] database.db_retry_interval = 1 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] database.max_overflow = 50 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] database.max_pool_size = 5 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] database.max_retries = 10 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] database.mysql_wsrep_sync_wait = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] database.pool_timeout = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] database.retry_interval = 10 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] database.slave_connection = **** {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] database.sqlite_synchronous = True {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] database.synchronous_reader = True {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] database.use_db_reconnect = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] oslo_messaging_tracing.insecure = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] profiler.connection_string = messaging:// {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] profiler.enabled = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] profiler.es_doc_type = notification {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] profiler.es_scroll_size = 10000 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] profiler.es_scroll_time = 2m {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] profiler.filter_error_trace = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] profiler.hmac_keys = **** {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] profiler.sentinel_service_name = mymaster {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] profiler.socket_timeout = 0.1 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] profiler.trace_requests = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] profiler.trace_sqlalchemy = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] profiler_jaeger.process_tags = {} {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] profiler_jaeger.service_name_prefix = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] profiler_otlp.service_name_prefix = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] oslo_policy.enforce_new_defaults = True {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] oslo_policy.policy_default_rule = default {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] oslo_policy.policy_file = policy.yaml {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] privsep_osbrick.group = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] privsep_osbrick.helper_command = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] privsep_osbrick.user = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] cinder_sys_admin.group = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] cinder_sys_admin.helper_command = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] cinder_sys_admin.user = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] service_user.auth_section = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] service_user.auth_type = password {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] service_user.cafile = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] service_user.certfile = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] service_user.collect_timing = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] service_user.insecure = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] service_user.keyfile = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] service_user.send_service_user_token = True {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] service_user.split_loggers = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] service_user.timeout = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] service_user.tls_ciphers = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] service_user.tls_min_version = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] glance.auth_section = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] glance.auth_type = password {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] glance.certfile = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] glance.collect_timing = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] glance.insecure = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] glance.keyfile = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] glance.region_name = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] glance.split_loggers = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] glance.timeout = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] glance.tls_ciphers = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] glance.tls_min_version = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.backend_availability_zone = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.chap_password = **** {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.chap_username = {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.disk_geometry = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.driver_client_cert = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.driver_client_cert_key = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.driver_data_namespace = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.driver_use_ssl = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.extra_capabilities = {} {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.filter_function = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.goodness_function = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack quobyte-client[87096]: Reading configuration file: /etc/quobyte/client.cfg Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack quobyte-client[87096]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.iscsi_target_flags = {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.iscsi_write_cache = on {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.iser_helper = tgtadm {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.iser_ip_address = 192.168.122.181 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.iser_port = 3260 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-429757b8-09f1-4f2e-9b78-35709cd8e105 None None] CMD "mount.quobyte" returned: 1 in 0.052s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-429757b8-09f1-4f2e-9b78-35709cd8e105 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.nas_host = {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-429757b8-09f1-4f2e-9b78-35709cd8e105 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.nas_login = admin {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-429757b8-09f1-4f2e-9b78-35709cd8e105 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.nas_mount_options = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.nas_password = **** {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.nas_private_key = {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.nas_share_path = {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.num_shell_tries = 3 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-429757b8-09f1-4f2e-9b78-35709cd8e105 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-429757b8-09f1-4f2e-9b78-35709cd8e105 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-429757b8-09f1-4f2e-9b78-35709cd8e105 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.quobyte_volume_url = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.replication_device = **** {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.report_discard_supported = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.reserved_percentage = 0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.target_helper = tgtadm {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.target_ip_address = 192.168.122.181 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.target_port = 3260 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.target_protocol = iscsi {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.trace_flags = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.unique_fqdn_network = True {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.use_chap_auth = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.volume_backend_name = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.volume_clear = zero {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.volume_clear_ionice = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.volume_clear_size = 0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] oslo_reports.file_event_handler = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] oslo_reports.log_dir = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.backend_availability_zone = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.backend_host = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.chap_password = **** {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.chap_username = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.chiscsi_conf = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.disk_geometry = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.driver_client_cert = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.driver_data_namespace = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.driver_use_ssl = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.extra_capabilities = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.filter_function = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.goodness_function = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack sudo[87097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack sudo[87097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.iser_helper = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.iser_ip_address = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.iser_port = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.iser_target_prefix = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.nas_host = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.nas_login = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.nas_mount_options = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.nas_password = **** {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.nas_private_key = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.nas_share_path = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.nas_ssh_port = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.num_shell_tries = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.nvmet_port_id = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.replication_device = **** {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.report_discard_supported = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.reserved_percentage = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.scst_target_driver = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.storage_protocol = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.target_helper = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.target_ip_address = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.target_port = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.target_prefix = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.target_protocol = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.trace_flags = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.use_chap_auth = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.volume_clear = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.volume_clear_size = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] QuobyteHD.volumes_dir = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] oslo_messaging_rabbit.ssl = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] oslo_messaging_notifications.driver = [] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] oslo_messaging_notifications.retry = -1 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] key_manager.fixed_key = **** {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] barbican.barbican_api_version = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] barbican.barbican_endpoint = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] barbican.barbican_endpoint_type = public {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] barbican.barbican_region_name = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] barbican.cafile = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] barbican.certfile = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] barbican.collect_timing = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] barbican.insecure = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] barbican.keyfile = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] barbican.number_of_retries = 60 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] barbican.retry_delay = 1 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] barbican.send_service_user_token = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] barbican.split_loggers = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] barbican.timeout = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] barbican.tls_ciphers = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] barbican.tls_min_version = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] barbican.verify_ssl = True {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] barbican.verify_ssl_path = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] barbican_service_user.auth_section = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] barbican_service_user.auth_type = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] barbican_service_user.cafile = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] barbican_service_user.certfile = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] barbican_service_user.collect_timing = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] barbican_service_user.insecure = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] barbican_service_user.keyfile = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] barbican_service_user.split_loggers = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] barbican_service_user.timeout = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] barbican_service_user.tls_ciphers = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] barbican_service_user.tls_min_version = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] vault.approle_role_id = **** {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] vault.approle_secret_id = **** {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] vault.auth_method = approle {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] vault.auth_path = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] vault.kv_mountpoint = secret {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] vault.kv_path = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] vault.kv_version = 2 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] vault.namespace = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] vault.root_token_id = **** {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] vault.ssl_ca_crt_file = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] vault.timeout = 60.0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] vault.token_file = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] vault.token_role = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] vault.use_ssl = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 12:09:24 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-6eade0b1-ca12-4b56-81e0-c3839363ac59 None None] ******************************************************************************** {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 04 12:09:24 devstack sudo[87097]: pam_unix(sudo:session): session closed for user root Nov 04 12:09:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-429757b8-09f1-4f2e-9b78-35709cd8e105 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.235s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:09:24 devstack cinder-volume[87095]: INFO cinder.volume.driver [None req-429757b8-09f1-4f2e-9b78-35709cd8e105 None None] Driver hasn't implemented _init_vendor_properties() Nov 04 12:09:24 devstack cinder-volume[87095]: DEBUG cinder.volume.driver [None req-429757b8-09f1-4f2e-9b78-35709cd8e105 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6071128845215, 'free_capacity_gb': 1773.6071128845215, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87095) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 04 12:09:25 devstack cinder-volume[87095]: DEBUG oslo_db.sqlalchemy.engines [None req-429757b8-09f1-4f2e-9b78-35709cd8e105 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87095) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 12:09:25 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writer thread running {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 04 12:09:25 devstack cinder-volume[87095]: DEBUG cinder.db.api [None req-429757b8-09f1-4f2e-9b78-35709cd8e105 None None] Building query based on filter {{(pid=87095) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 04 12:09:25 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-429757b8-09f1-4f2e-9b78-35709cd8e105 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87095) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 04 12:09:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-429757b8-09f1-4f2e-9b78-35709cd8e105 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:09:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-429757b8-09f1-4f2e-9b78-35709cd8e105 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:09:25 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-429757b8-09f1-4f2e-9b78-35709cd8e105 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:09:25 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-429757b8-09f1-4f2e-9b78-35709cd8e105 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:09:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-429757b8-09f1-4f2e-9b78-35709cd8e105 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:09:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-429757b8-09f1-4f2e-9b78-35709cd8e105 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:09:25 devstack cinder-volume[87095]: INFO cinder.keymgr.migration [None req-b4b0e59d-5bda-45cf-8ba2-bb8b1cf769bc None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 04 12:09:25 devstack sudo[87108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:09:25 devstack sudo[87108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:09:25 devstack sudo[87108]: pam_unix(sudo:session): session closed for user root Nov 04 12:09:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-429757b8-09f1-4f2e-9b78-35709cd8e105 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.241s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:09:25 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-429757b8-09f1-4f2e-9b78-35709cd8e105 None None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:09:25 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-429757b8-09f1-4f2e-9b78-35709cd8e105 None None] Driver initialization completed successfully. Nov 04 12:09:25 devstack cinder-volume[87095]: INFO cinder.manager [None req-429757b8-09f1-4f2e-9b78-35709cd8e105 None None] Initiating service 3 cleanup Nov 04 12:09:25 devstack cinder-volume[87095]: INFO cinder.manager [None req-429757b8-09f1-4f2e-9b78-35709cd8e105 None None] Service 3 cleanup completed. Nov 04 12:09:25 devstack cinder-volume[87095]: DEBUG cinder.service [None req-429757b8-09f1-4f2e-9b78-35709cd8e105 None None] Creating RPC server for service cinder-volume {{(pid=87095) start /opt/stack/cinder/cinder/service.py:231}} Nov 04 12:09:25 devstack cinder-volume[87095]: DEBUG cinder.service [None req-429757b8-09f1-4f2e-9b78-35709cd8e105 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87095) start /opt/stack/cinder/cinder/service.py:237}} Nov 04 12:09:25 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-429757b8-09f1-4f2e-9b78-35709cd8e105 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 04 12:09:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-429757b8-09f1-4f2e-9b78-35709cd8e105 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:09:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-429757b8-09f1-4f2e-9b78-35709cd8e105 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:09:25 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-429757b8-09f1-4f2e-9b78-35709cd8e105 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:09:25 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-429757b8-09f1-4f2e-9b78-35709cd8e105 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:09:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-429757b8-09f1-4f2e-9b78-35709cd8e105 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:09:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-429757b8-09f1-4f2e-9b78-35709cd8e105 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:09:25 devstack sudo[87121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:09:25 devstack sudo[87121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:09:25 devstack sudo[87121]: pam_unix(sudo:session): session closed for user root Nov 04 12:09:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-429757b8-09f1-4f2e-9b78-35709cd8e105 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.246s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:09:25 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-429757b8-09f1-4f2e-9b78-35709cd8e105 None None] Driver post RPC initialization completed successfully. Nov 04 12:09:34 devstack cinder-volume[86791]: DEBUG dbcounter [-] [86791] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86791) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 12:09:35 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 12:09:35 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=1 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 12:10:01 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Running periodic task VolumeManager._thread_info {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 12:10:01 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] thread count: 6 {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 12:10:01 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] thread info: [<_MainThread(MainThread, started 140610387472512)>, , , , , ] {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 12:10:24 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c6ba5c5-57a9-43fc-8414-3baabba1909d tempest-TaggedAttachmentsTest-1730865996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:10:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2c6ba5c5-57a9-43fc-8414-3baabba1909d tempest-TaggedAttachmentsTest-1730865996 None] Flow 'volume_create_manager' (b75228cb-115c-49e1-9324-714e1ddc0f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:10:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2c6ba5c5-57a9-43fc-8414-3baabba1909d tempest-TaggedAttachmentsTest-1730865996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2470d3a7-cfb1-41fc-9658-ee508ccc9ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:10:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2c6ba5c5-57a9-43fc-8414-3baabba1909d tempest-TaggedAttachmentsTest-1730865996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2470d3a7-cfb1-41fc-9658-ee508ccc9ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:10:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-2096311687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fad154d2-ae1f-461f-8231-b20d4b2dc5a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3715e01155f8462ab64821e7a7f9ef27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:10:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:10:25Z,use_quota=True,user_id='d208f0c789444f1da3db6d139b20f0f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:10:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2c6ba5c5-57a9-43fc-8414-3baabba1909d tempest-TaggedAttachmentsTest-1730865996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aa1bb87-d645-47e3-b509-86965d5b0b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:10:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2c6ba5c5-57a9-43fc-8414-3baabba1909d tempest-TaggedAttachmentsTest-1730865996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aa1bb87-d645-47e3-b509-86965d5b0b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:10:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2c6ba5c5-57a9-43fc-8414-3baabba1909d tempest-TaggedAttachmentsTest-1730865996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3b9415f-978a-4f84-94a6-8da1571db0a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:10:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2c6ba5c5-57a9-43fc-8414-3baabba1909d tempest-TaggedAttachmentsTest-1730865996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3b9415f-978a-4f84-94a6-8da1571db0a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fad154d2-ae1f-461f-8231-b20d4b2dc5a4', 'volume_name': 'volume-fad154d2-ae1f-461f-8231-b20d4b2dc5a4', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:10:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2c6ba5c5-57a9-43fc-8414-3baabba1909d tempest-TaggedAttachmentsTest-1730865996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2ecf9da-d484-4888-91b9-61210fdb6da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:10:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2c6ba5c5-57a9-43fc-8414-3baabba1909d tempest-TaggedAttachmentsTest-1730865996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2ecf9da-d484-4888-91b9-61210fdb6da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:10:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2c6ba5c5-57a9-43fc-8414-3baabba1909d tempest-TaggedAttachmentsTest-1730865996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb54a2c6-9836-4bfb-885a-09cc91b35561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:10:25 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-2c6ba5c5-57a9-43fc-8414-3baabba1909d tempest-TaggedAttachmentsTest-1730865996 None] Volume fad154d2-ae1f-461f-8231-b20d4b2dc5a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fad154d2-ae1f-461f-8231-b20d4b2dc5a4', 'volume_size': 1} Nov 04 12:10:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2c6ba5c5-57a9-43fc-8414-3baabba1909d tempest-TaggedAttachmentsTest-1730865996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:10:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2c6ba5c5-57a9-43fc-8414-3baabba1909d tempest-TaggedAttachmentsTest-1730865996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:10:25 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2c6ba5c5-57a9-43fc-8414-3baabba1909d tempest-TaggedAttachmentsTest-1730865996 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:10:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-2096311687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fad154d2-ae1f-461f-8231-b20d4b2dc5a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3715e01155f8462ab64821e7a7f9ef27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:10:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:10:25Z,use_quota=True,user_id='d208f0c789444f1da3db6d139b20f0f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:10:25 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-2c6ba5c5-57a9-43fc-8414-3baabba1909d tempest-TaggedAttachmentsTest-1730865996 None] Creating volume fad154d2-ae1f-461f-8231-b20d4b2dc5a4 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:10:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2c6ba5c5-57a9-43fc-8414-3baabba1909d tempest-TaggedAttachmentsTest-1730865996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:10:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2c6ba5c5-57a9-43fc-8414-3baabba1909d tempest-TaggedAttachmentsTest-1730865996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:10:25 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2c6ba5c5-57a9-43fc-8414-3baabba1909d tempest-TaggedAttachmentsTest-1730865996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:10:25 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2c6ba5c5-57a9-43fc-8414-3baabba1909d tempest-TaggedAttachmentsTest-1730865996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:10:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2c6ba5c5-57a9-43fc-8414-3baabba1909d tempest-TaggedAttachmentsTest-1730865996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:10:25 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2c6ba5c5-57a9-43fc-8414-3baabba1909d tempest-TaggedAttachmentsTest-1730865996 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:10:25 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-2c6ba5c5-57a9-43fc-8414-3baabba1909d tempest-TaggedAttachmentsTest-1730865996 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:10:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2c6ba5c5-57a9-43fc-8414-3baabba1909d tempest-TaggedAttachmentsTest-1730865996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fad154d2-ae1f-461f-8231-b20d4b2dc5a4 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:10:25 devstack sudo[87781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fad154d2-ae1f-461f-8231-b20d4b2dc5a4 1073741824 Nov 04 12:10:25 devstack sudo[87781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:10:26 devstack sudo[87781]: pam_unix(sudo:session): session closed for user root Nov 04 12:10:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2c6ba5c5-57a9-43fc-8414-3baabba1909d tempest-TaggedAttachmentsTest-1730865996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fad154d2-ae1f-461f-8231-b20d4b2dc5a4 1073741824" returned: 0 in 1.338s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:10:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2c6ba5c5-57a9-43fc-8414-3baabba1909d tempest-TaggedAttachmentsTest-1730865996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fad154d2-ae1f-461f-8231-b20d4b2dc5a4 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:10:26 devstack sudo[88106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fad154d2-ae1f-461f-8231-b20d4b2dc5a4 Nov 04 12:10:26 devstack sudo[88106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:10:27 devstack sudo[88106]: pam_unix(sudo:session): session closed for user root Nov 04 12:10:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2c6ba5c5-57a9-43fc-8414-3baabba1909d tempest-TaggedAttachmentsTest-1730865996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fad154d2-ae1f-461f-8231-b20d4b2dc5a4" returned: 0 in 0.790s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:10:27 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2c6ba5c5-57a9-43fc-8414-3baabba1909d tempest-TaggedAttachmentsTest-1730865996 None] <== create_volume: return (2337ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:10:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2c6ba5c5-57a9-43fc-8414-3baabba1909d tempest-TaggedAttachmentsTest-1730865996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.340s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:10:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2c6ba5c5-57a9-43fc-8414-3baabba1909d tempest-TaggedAttachmentsTest-1730865996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb54a2c6-9836-4bfb-885a-09cc91b35561) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fad154d2-ae1f-461f-8231-b20d4b2dc5a4', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:10:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2c6ba5c5-57a9-43fc-8414-3baabba1909d tempest-TaggedAttachmentsTest-1730865996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36ae72cc-0e62-4f8c-9b77-d84451f8622b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:10:27 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-2c6ba5c5-57a9-43fc-8414-3baabba1909d tempest-TaggedAttachmentsTest-1730865996 None] Volume volume-fad154d2-ae1f-461f-8231-b20d4b2dc5a4 (fad154d2-ae1f-461f-8231-b20d4b2dc5a4): created successfully Nov 04 12:10:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2c6ba5c5-57a9-43fc-8414-3baabba1909d tempest-TaggedAttachmentsTest-1730865996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36ae72cc-0e62-4f8c-9b77-d84451f8622b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:10:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2c6ba5c5-57a9-43fc-8414-3baabba1909d tempest-TaggedAttachmentsTest-1730865996 None] Flow 'volume_create_manager' (b75228cb-115c-49e1-9324-714e1ddc0f0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:10:27 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-2c6ba5c5-57a9-43fc-8414-3baabba1909d tempest-TaggedAttachmentsTest-1730865996 None] Created volume successfully. Nov 04 12:10:37 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 12:10:37 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 12:10:47 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-c094f4e1-6891-44f6-9421-10974b1fe425 tempest-ServerRescueNegativeTestJSON-223041579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:10:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c094f4e1-6891-44f6-9421-10974b1fe425 tempest-ServerRescueNegativeTestJSON-223041579 None] Flow 'volume_create_manager' (a6b2d48d-97d9-4038-9c7c-12c43dfbc0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:10:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c094f4e1-6891-44f6-9421-10974b1fe425 tempest-ServerRescueNegativeTestJSON-223041579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b021581d-301d-4b3d-ab4c-08c375472a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:10:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c094f4e1-6891-44f6-9421-10974b1fe425 tempest-ServerRescueNegativeTestJSON-223041579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b021581d-301d-4b3d-ab4c-08c375472a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:10:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1161055114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cd83abe-a75d-49b2-874c-4e1b7c42177d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73b1fdd3e2da4a76a44f24dfe5f00cf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:10:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:10:47Z,use_quota=True,user_id='38f5769631a34f1b977bfa0cf011acf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:10:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c094f4e1-6891-44f6-9421-10974b1fe425 tempest-ServerRescueNegativeTestJSON-223041579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f020a44c-6913-4a42-b88d-7a20e121d9dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:10:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c094f4e1-6891-44f6-9421-10974b1fe425 tempest-ServerRescueNegativeTestJSON-223041579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f020a44c-6913-4a42-b88d-7a20e121d9dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:10:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c094f4e1-6891-44f6-9421-10974b1fe425 tempest-ServerRescueNegativeTestJSON-223041579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaa22a3a-4065-41dd-be9e-dfbf41c4ab56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:10:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c094f4e1-6891-44f6-9421-10974b1fe425 tempest-ServerRescueNegativeTestJSON-223041579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaa22a3a-4065-41dd-be9e-dfbf41c4ab56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cd83abe-a75d-49b2-874c-4e1b7c42177d', 'volume_name': 'volume-0cd83abe-a75d-49b2-874c-4e1b7c42177d', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:10:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c094f4e1-6891-44f6-9421-10974b1fe425 tempest-ServerRescueNegativeTestJSON-223041579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (666e468e-b588-4b80-9673-e3989b511e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:10:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c094f4e1-6891-44f6-9421-10974b1fe425 tempest-ServerRescueNegativeTestJSON-223041579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (666e468e-b588-4b80-9673-e3989b511e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:10:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c094f4e1-6891-44f6-9421-10974b1fe425 tempest-ServerRescueNegativeTestJSON-223041579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07a4f9a3-0e31-49ba-b663-36eb0bc2edf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:10:47 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-c094f4e1-6891-44f6-9421-10974b1fe425 tempest-ServerRescueNegativeTestJSON-223041579 None] Volume 0cd83abe-a75d-49b2-874c-4e1b7c42177d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cd83abe-a75d-49b2-874c-4e1b7c42177d', 'volume_size': 1} Nov 04 12:10:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c094f4e1-6891-44f6-9421-10974b1fe425 tempest-ServerRescueNegativeTestJSON-223041579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:10:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c094f4e1-6891-44f6-9421-10974b1fe425 tempest-ServerRescueNegativeTestJSON-223041579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:10:47 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c094f4e1-6891-44f6-9421-10974b1fe425 tempest-ServerRescueNegativeTestJSON-223041579 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:10:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1161055114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cd83abe-a75d-49b2-874c-4e1b7c42177d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73b1fdd3e2da4a76a44f24dfe5f00cf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:10:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:10:47Z,use_quota=True,user_id='38f5769631a34f1b977bfa0cf011acf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:10:47 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-c094f4e1-6891-44f6-9421-10974b1fe425 tempest-ServerRescueNegativeTestJSON-223041579 None] Creating volume 0cd83abe-a75d-49b2-874c-4e1b7c42177d {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:10:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c094f4e1-6891-44f6-9421-10974b1fe425 tempest-ServerRescueNegativeTestJSON-223041579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:10:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c094f4e1-6891-44f6-9421-10974b1fe425 tempest-ServerRescueNegativeTestJSON-223041579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:10:47 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c094f4e1-6891-44f6-9421-10974b1fe425 tempest-ServerRescueNegativeTestJSON-223041579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:10:47 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c094f4e1-6891-44f6-9421-10974b1fe425 tempest-ServerRescueNegativeTestJSON-223041579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:10:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c094f4e1-6891-44f6-9421-10974b1fe425 tempest-ServerRescueNegativeTestJSON-223041579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:10:47 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c094f4e1-6891-44f6-9421-10974b1fe425 tempest-ServerRescueNegativeTestJSON-223041579 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:10:47 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-c094f4e1-6891-44f6-9421-10974b1fe425 tempest-ServerRescueNegativeTestJSON-223041579 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:10:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c094f4e1-6891-44f6-9421-10974b1fe425 tempest-ServerRescueNegativeTestJSON-223041579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0cd83abe-a75d-49b2-874c-4e1b7c42177d 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:10:47 devstack sudo[88348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0cd83abe-a75d-49b2-874c-4e1b7c42177d 1073741824 Nov 04 12:10:47 devstack sudo[88348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:10:47 devstack sudo[88348]: pam_unix(sudo:session): session closed for user root Nov 04 12:10:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c094f4e1-6891-44f6-9421-10974b1fe425 tempest-ServerRescueNegativeTestJSON-223041579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0cd83abe-a75d-49b2-874c-4e1b7c42177d 1073741824" returned: 0 in 0.644s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:10:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c094f4e1-6891-44f6-9421-10974b1fe425 tempest-ServerRescueNegativeTestJSON-223041579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0cd83abe-a75d-49b2-874c-4e1b7c42177d {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:10:47 devstack sudo[88355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0cd83abe-a75d-49b2-874c-4e1b7c42177d Nov 04 12:10:47 devstack sudo[88355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:10:48 devstack sudo[88355]: pam_unix(sudo:session): session closed for user root Nov 04 12:10:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c094f4e1-6891-44f6-9421-10974b1fe425 tempest-ServerRescueNegativeTestJSON-223041579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0cd83abe-a75d-49b2-874c-4e1b7c42177d" returned: 0 in 0.335s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:10:48 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c094f4e1-6891-44f6-9421-10974b1fe425 tempest-ServerRescueNegativeTestJSON-223041579 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:10:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c094f4e1-6891-44f6-9421-10974b1fe425 tempest-ServerRescueNegativeTestJSON-223041579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:10:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c094f4e1-6891-44f6-9421-10974b1fe425 tempest-ServerRescueNegativeTestJSON-223041579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07a4f9a3-0e31-49ba-b663-36eb0bc2edf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cd83abe-a75d-49b2-874c-4e1b7c42177d', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:10:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c094f4e1-6891-44f6-9421-10974b1fe425 tempest-ServerRescueNegativeTestJSON-223041579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf406103-df68-467b-9449-18ca101db6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:10:48 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-c094f4e1-6891-44f6-9421-10974b1fe425 tempest-ServerRescueNegativeTestJSON-223041579 None] Volume volume-0cd83abe-a75d-49b2-874c-4e1b7c42177d (0cd83abe-a75d-49b2-874c-4e1b7c42177d): created successfully Nov 04 12:10:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c094f4e1-6891-44f6-9421-10974b1fe425 tempest-ServerRescueNegativeTestJSON-223041579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf406103-df68-467b-9449-18ca101db6ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:10:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c094f4e1-6891-44f6-9421-10974b1fe425 tempest-ServerRescueNegativeTestJSON-223041579 None] Flow 'volume_create_manager' (a6b2d48d-97d9-4038-9c7c-12c43dfbc0b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:10:48 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-c094f4e1-6891-44f6-9421-10974b1fe425 tempest-ServerRescueNegativeTestJSON-223041579 None] Created volume successfully. Nov 04 12:10:58 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:UPDATE=5 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 12:10:58 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=4,cinder:INSERT=1,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 12:11:01 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 12:11:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:11:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:11:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:11:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:11:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:11:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:11:01 devstack sudo[88545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:11:01 devstack sudo[88545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:11:02 devstack sudo[88545]: pam_unix(sudo:session): session closed for user root Nov 04 12:11:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.778s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:11:02 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:11:02 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Running periodic task VolumeManager._thread_info {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 12:11:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] thread count: 6 {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 12:11:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] thread info: [<_MainThread(MainThread, started 140610387472512)>, , , , , ] {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 12:11:07 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dddef4d-3da1-44fc-a876-0a6e8aba68f4 tempest-ServersNegativeTestJSON-149214978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:11:07 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6dddef4d-3da1-44fc-a876-0a6e8aba68f4 tempest-ServersNegativeTestJSON-149214978 None] Flow 'volume_create_manager' (cc4e3f95-6a35-4197-b83a-3a7b4fcb49be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:11:07 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6dddef4d-3da1-44fc-a876-0a6e8aba68f4 tempest-ServersNegativeTestJSON-149214978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee711f54-6cf4-4a15-a88d-5554c3f87f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:11:07 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6dddef4d-3da1-44fc-a876-0a6e8aba68f4 tempest-ServersNegativeTestJSON-149214978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee711f54-6cf4-4a15-a88d-5554c3f87f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:11:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1949620346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc4472a4-b768-4a9d-969f-5b3fe27ed00e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='261f0a2fd8e14e568806ac7018c0696e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:11:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:11:07Z,use_quota=True,user_id='ca68b7ba4406499082019c31786ae66b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:11:07 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6dddef4d-3da1-44fc-a876-0a6e8aba68f4 tempest-ServersNegativeTestJSON-149214978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f08b4c1-2e73-45ad-be3d-102c79c68d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:11:07 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6dddef4d-3da1-44fc-a876-0a6e8aba68f4 tempest-ServersNegativeTestJSON-149214978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f08b4c1-2e73-45ad-be3d-102c79c68d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:11:07 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6dddef4d-3da1-44fc-a876-0a6e8aba68f4 tempest-ServersNegativeTestJSON-149214978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e22ce70d-b760-4254-8570-5b4bc3dcb5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:11:07 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6dddef4d-3da1-44fc-a876-0a6e8aba68f4 tempest-ServersNegativeTestJSON-149214978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e22ce70d-b760-4254-8570-5b4bc3dcb5f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc4472a4-b768-4a9d-969f-5b3fe27ed00e', 'volume_name': 'volume-cc4472a4-b768-4a9d-969f-5b3fe27ed00e', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:11:07 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6dddef4d-3da1-44fc-a876-0a6e8aba68f4 tempest-ServersNegativeTestJSON-149214978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38fd00c6-57a2-4bc2-824c-7e4e36f60053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:11:07 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6dddef4d-3da1-44fc-a876-0a6e8aba68f4 tempest-ServersNegativeTestJSON-149214978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38fd00c6-57a2-4bc2-824c-7e4e36f60053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:11:07 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6dddef4d-3da1-44fc-a876-0a6e8aba68f4 tempest-ServersNegativeTestJSON-149214978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3121b90-e75c-43a2-8779-0bafd7a48ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:11:07 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-6dddef4d-3da1-44fc-a876-0a6e8aba68f4 tempest-ServersNegativeTestJSON-149214978 None] Volume cc4472a4-b768-4a9d-969f-5b3fe27ed00e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc4472a4-b768-4a9d-969f-5b3fe27ed00e', 'volume_size': 1} Nov 04 12:11:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6dddef4d-3da1-44fc-a876-0a6e8aba68f4 tempest-ServersNegativeTestJSON-149214978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:11:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6dddef4d-3da1-44fc-a876-0a6e8aba68f4 tempest-ServersNegativeTestJSON-149214978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:11:07 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6dddef4d-3da1-44fc-a876-0a6e8aba68f4 tempest-ServersNegativeTestJSON-149214978 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:11:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1949620346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc4472a4-b768-4a9d-969f-5b3fe27ed00e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='261f0a2fd8e14e568806ac7018c0696e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:11:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:11:07Z,use_quota=True,user_id='ca68b7ba4406499082019c31786ae66b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:11:07 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-6dddef4d-3da1-44fc-a876-0a6e8aba68f4 tempest-ServersNegativeTestJSON-149214978 None] Creating volume cc4472a4-b768-4a9d-969f-5b3fe27ed00e {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:11:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6dddef4d-3da1-44fc-a876-0a6e8aba68f4 tempest-ServersNegativeTestJSON-149214978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:11:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6dddef4d-3da1-44fc-a876-0a6e8aba68f4 tempest-ServersNegativeTestJSON-149214978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:11:07 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6dddef4d-3da1-44fc-a876-0a6e8aba68f4 tempest-ServersNegativeTestJSON-149214978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:11:07 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6dddef4d-3da1-44fc-a876-0a6e8aba68f4 tempest-ServersNegativeTestJSON-149214978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:11:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6dddef4d-3da1-44fc-a876-0a6e8aba68f4 tempest-ServersNegativeTestJSON-149214978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:11:07 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6dddef4d-3da1-44fc-a876-0a6e8aba68f4 tempest-ServersNegativeTestJSON-149214978 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:11:07 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-6dddef4d-3da1-44fc-a876-0a6e8aba68f4 tempest-ServersNegativeTestJSON-149214978 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:11:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6dddef4d-3da1-44fc-a876-0a6e8aba68f4 tempest-ServersNegativeTestJSON-149214978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cc4472a4-b768-4a9d-969f-5b3fe27ed00e 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:11:07 devstack sudo[88578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cc4472a4-b768-4a9d-969f-5b3fe27ed00e 1073741824 Nov 04 12:11:07 devstack sudo[88578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:11:08 devstack sudo[88578]: pam_unix(sudo:session): session closed for user root Nov 04 12:11:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6dddef4d-3da1-44fc-a876-0a6e8aba68f4 tempest-ServersNegativeTestJSON-149214978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cc4472a4-b768-4a9d-969f-5b3fe27ed00e 1073741824" returned: 0 in 0.825s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:11:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6dddef4d-3da1-44fc-a876-0a6e8aba68f4 tempest-ServersNegativeTestJSON-149214978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cc4472a4-b768-4a9d-969f-5b3fe27ed00e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:11:08 devstack sudo[88584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cc4472a4-b768-4a9d-969f-5b3fe27ed00e Nov 04 12:11:08 devstack sudo[88584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:11:08 devstack sudo[88584]: pam_unix(sudo:session): session closed for user root Nov 04 12:11:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6dddef4d-3da1-44fc-a876-0a6e8aba68f4 tempest-ServersNegativeTestJSON-149214978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cc4472a4-b768-4a9d-969f-5b3fe27ed00e" returned: 0 in 0.304s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:11:08 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6dddef4d-3da1-44fc-a876-0a6e8aba68f4 tempest-ServersNegativeTestJSON-149214978 None] <== create_volume: return (1264ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:11:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6dddef4d-3da1-44fc-a876-0a6e8aba68f4 tempest-ServersNegativeTestJSON-149214978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.269s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:11:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6dddef4d-3da1-44fc-a876-0a6e8aba68f4 tempest-ServersNegativeTestJSON-149214978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3121b90-e75c-43a2-8779-0bafd7a48ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc4472a4-b768-4a9d-969f-5b3fe27ed00e', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:11:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6dddef4d-3da1-44fc-a876-0a6e8aba68f4 tempest-ServersNegativeTestJSON-149214978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d1a0930-2598-4011-a089-920de363054b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:11:08 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-6dddef4d-3da1-44fc-a876-0a6e8aba68f4 tempest-ServersNegativeTestJSON-149214978 None] Volume volume-cc4472a4-b768-4a9d-969f-5b3fe27ed00e (cc4472a4-b768-4a9d-969f-5b3fe27ed00e): created successfully Nov 04 12:11:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6dddef4d-3da1-44fc-a876-0a6e8aba68f4 tempest-ServersNegativeTestJSON-149214978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d1a0930-2598-4011-a089-920de363054b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:11:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6dddef4d-3da1-44fc-a876-0a6e8aba68f4 tempest-ServersNegativeTestJSON-149214978 None] Flow 'volume_create_manager' (cc4e3f95-6a35-4197-b83a-3a7b4fcb49be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:11:08 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-6dddef4d-3da1-44fc-a876-0a6e8aba68f4 tempest-ServersNegativeTestJSON-149214978 None] Created volume successfully. Nov 04 12:11:12 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bf64744-e6be-473f-9abc-4151033474e2 tempest-ServersNegativeTestJSON-149214978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:11:12 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3bf64744-e6be-473f-9abc-4151033474e2 tempest-ServersNegativeTestJSON-149214978 None] Flow 'volume_create_manager' (b0dcd4d9-5741-47f5-875e-2f25b2206026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:11:12 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3bf64744-e6be-473f-9abc-4151033474e2 tempest-ServersNegativeTestJSON-149214978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5815d6ce-0e56-43df-bb1f-87490091c908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:11:12 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-40da9ea8-e2a5-47c0-ae5c-df39aad3aefb tempest-ServerRescueNegativeTestJSON-223041579 None] Acquiring lock "cinder-0cd83abe-a75d-49b2-874c-4e1b7c42177d-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:11:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3bf64744-e6be-473f-9abc-4151033474e2 tempest-ServersNegativeTestJSON-149214978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5815d6ce-0e56-43df-bb1f-87490091c908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:11:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-528236769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8cb9733-7f65-4f14-8988-0aadde6f08f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='261f0a2fd8e14e568806ac7018c0696e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:11:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:11:13Z,use_quota=True,user_id='ca68b7ba4406499082019c31786ae66b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:11:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3bf64744-e6be-473f-9abc-4151033474e2 tempest-ServersNegativeTestJSON-149214978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1da0e28-7782-496c-8620-319327cb4e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:11:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3bf64744-e6be-473f-9abc-4151033474e2 tempest-ServersNegativeTestJSON-149214978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1da0e28-7782-496c-8620-319327cb4e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:11:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3bf64744-e6be-473f-9abc-4151033474e2 tempest-ServersNegativeTestJSON-149214978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d109c46-b94b-4ce2-b7ba-8a073a59c39d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:11:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3bf64744-e6be-473f-9abc-4151033474e2 tempest-ServersNegativeTestJSON-149214978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d109c46-b94b-4ce2-b7ba-8a073a59c39d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8cb9733-7f65-4f14-8988-0aadde6f08f3', 'volume_name': 'volume-f8cb9733-7f65-4f14-8988-0aadde6f08f3', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:11:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3bf64744-e6be-473f-9abc-4151033474e2 tempest-ServersNegativeTestJSON-149214978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7d2a32c-0355-49ea-a7b3-4b424df29c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:11:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3bf64744-e6be-473f-9abc-4151033474e2 tempest-ServersNegativeTestJSON-149214978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7d2a32c-0355-49ea-a7b3-4b424df29c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:11:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3bf64744-e6be-473f-9abc-4151033474e2 tempest-ServersNegativeTestJSON-149214978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ad338e4-4e27-41d2-84b3-0a1af1a9c1e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:11:13 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-3bf64744-e6be-473f-9abc-4151033474e2 tempest-ServersNegativeTestJSON-149214978 None] Volume f8cb9733-7f65-4f14-8988-0aadde6f08f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8cb9733-7f65-4f14-8988-0aadde6f08f3', 'volume_size': 1} Nov 04 12:11:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3bf64744-e6be-473f-9abc-4151033474e2 tempest-ServersNegativeTestJSON-149214978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:11:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3bf64744-e6be-473f-9abc-4151033474e2 tempest-ServersNegativeTestJSON-149214978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:11:13 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3bf64744-e6be-473f-9abc-4151033474e2 tempest-ServersNegativeTestJSON-149214978 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:11:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-528236769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8cb9733-7f65-4f14-8988-0aadde6f08f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='261f0a2fd8e14e568806ac7018c0696e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:11:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:11:13Z,use_quota=True,user_id='ca68b7ba4406499082019c31786ae66b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:11:13 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-3bf64744-e6be-473f-9abc-4151033474e2 tempest-ServersNegativeTestJSON-149214978 None] Creating volume f8cb9733-7f65-4f14-8988-0aadde6f08f3 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:11:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3bf64744-e6be-473f-9abc-4151033474e2 tempest-ServersNegativeTestJSON-149214978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:11:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3bf64744-e6be-473f-9abc-4151033474e2 tempest-ServersNegativeTestJSON-149214978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:11:13 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3bf64744-e6be-473f-9abc-4151033474e2 tempest-ServersNegativeTestJSON-149214978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:11:13 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3bf64744-e6be-473f-9abc-4151033474e2 tempest-ServersNegativeTestJSON-149214978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:11:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3bf64744-e6be-473f-9abc-4151033474e2 tempest-ServersNegativeTestJSON-149214978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:11:13 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3bf64744-e6be-473f-9abc-4151033474e2 tempest-ServersNegativeTestJSON-149214978 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:11:13 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-3bf64744-e6be-473f-9abc-4151033474e2 tempest-ServersNegativeTestJSON-149214978 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:11:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3bf64744-e6be-473f-9abc-4151033474e2 tempest-ServersNegativeTestJSON-149214978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f8cb9733-7f65-4f14-8988-0aadde6f08f3 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:11:13 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-40da9ea8-e2a5-47c0-ae5c-df39aad3aefb tempest-ServerRescueNegativeTestJSON-223041579 None] Lock "cinder-0cd83abe-a75d-49b2-874c-4e1b7c42177d-delete_volume" acquired by "delete_volume" :: waited 0.154s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:11:13 devstack sudo[88655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f8cb9733-7f65-4f14-8988-0aadde6f08f3 1073741824 Nov 04 12:11:13 devstack sudo[88655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:11:13 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-40da9ea8-e2a5-47c0-ae5c-df39aad3aefb tempest-ServerRescueNegativeTestJSON-223041579 None] Acquiring lock "cinder-quobyte-0cd83abe-a75d-49b2-874c-4e1b7c42177d" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:11:13 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-40da9ea8-e2a5-47c0-ae5c-df39aad3aefb tempest-ServerRescueNegativeTestJSON-223041579 None] Lock "cinder-quobyte-0cd83abe-a75d-49b2-874c-4e1b7c42177d" acquired by "delete_volume" :: waited 0.046s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:11:13 devstack cinder-volume[87095]: INFO oslo.privsep.daemon [None req-40da9ea8-e2a5-47c0-ae5c-df39aad3aefb tempest-ServerRescueNegativeTestJSON-223041579 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp1rj0bkxr/privsep.sock'] Nov 04 12:11:13 devstack sudo[88657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp1rj0bkxr/privsep.sock Nov 04 12:11:13 devstack sudo[88657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:11:14 devstack sudo[88655]: pam_unix(sudo:session): session closed for user root Nov 04 12:11:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3bf64744-e6be-473f-9abc-4151033474e2 tempest-ServersNegativeTestJSON-149214978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f8cb9733-7f65-4f14-8988-0aadde6f08f3 1073741824" returned: 0 in 0.955s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:11:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3bf64744-e6be-473f-9abc-4151033474e2 tempest-ServersNegativeTestJSON-149214978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f8cb9733-7f65-4f14-8988-0aadde6f08f3 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:11:14 devstack sudo[88668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f8cb9733-7f65-4f14-8988-0aadde6f08f3 Nov 04 12:11:14 devstack sudo[88668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:11:14 devstack sudo[88668]: pam_unix(sudo:session): session closed for user root Nov 04 12:11:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3bf64744-e6be-473f-9abc-4151033474e2 tempest-ServersNegativeTestJSON-149214978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f8cb9733-7f65-4f14-8988-0aadde6f08f3" returned: 0 in 0.708s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:11:14 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3bf64744-e6be-473f-9abc-4151033474e2 tempest-ServersNegativeTestJSON-149214978 None] <== create_volume: return (1735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:11:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3bf64744-e6be-473f-9abc-4151033474e2 tempest-ServersNegativeTestJSON-149214978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.747s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:11:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3bf64744-e6be-473f-9abc-4151033474e2 tempest-ServersNegativeTestJSON-149214978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ad338e4-4e27-41d2-84b3-0a1af1a9c1e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8cb9733-7f65-4f14-8988-0aadde6f08f3', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:11:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3bf64744-e6be-473f-9abc-4151033474e2 tempest-ServersNegativeTestJSON-149214978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bebc762a-dc46-4b7f-8537-418b89d16e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:11:14 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-3bf64744-e6be-473f-9abc-4151033474e2 tempest-ServersNegativeTestJSON-149214978 None] Volume volume-f8cb9733-7f65-4f14-8988-0aadde6f08f3 (f8cb9733-7f65-4f14-8988-0aadde6f08f3): created successfully Nov 04 12:11:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3bf64744-e6be-473f-9abc-4151033474e2 tempest-ServersNegativeTestJSON-149214978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bebc762a-dc46-4b7f-8537-418b89d16e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:11:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3bf64744-e6be-473f-9abc-4151033474e2 tempest-ServersNegativeTestJSON-149214978 None] Flow 'volume_create_manager' (b0dcd4d9-5741-47f5-875e-2f25b2206026) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:11:14 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-3bf64744-e6be-473f-9abc-4151033474e2 tempest-ServersNegativeTestJSON-149214978 None] Created volume successfully. Nov 04 12:11:14 devstack cinder-volume[87095]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Nov 04 12:11:14 devstack cinder-volume[87095]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 04 12:11:14 devstack cinder-volume[87095]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Nov 04 12:11:14 devstack cinder-volume[87095]: WARNING oslo.privsep.daemon [-] privsep log: Nov 04 12:11:14 devstack cinder-volume[87095]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Nov 04 12:11:14 devstack cinder-volume[87095]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Nov 04 12:11:14 devstack cinder-volume[87095]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 04 12:11:14 devstack cinder-volume[87095]: WARNING oslo.privsep.daemon [-] privsep log: Nov 04 12:11:14 devstack cinder-volume[87095]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Nov 04 12:11:15 devstack sudo[88657]: pam_unix(sudo:session): session closed for user root Nov 04 12:11:15 devstack cinder-volume[87095]: INFO oslo.privsep.daemon [None req-40da9ea8-e2a5-47c0-ae5c-df39aad3aefb tempest-ServerRescueNegativeTestJSON-223041579 None] Spawned new privsep daemon via rootwrap Nov 04 12:11:15 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [None req-40da9ea8-e2a5-47c0-ae5c-df39aad3aefb tempest-ServerRescueNegativeTestJSON-223041579 None] Accepted privsep connection to /tmp/tmp1rj0bkxr/privsep.sock {{(pid=87095) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Nov 04 12:11:15 devstack cinder-volume[87095]: INFO oslo.privsep.daemon [-] privsep daemon starting Nov 04 12:11:15 devstack cinder-volume[87095]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Nov 04 12:11:15 devstack cinder-volume[87095]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Nov 04 12:11:15 devstack cinder-volume[87095]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88720 Nov 04 12:11:15 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e08f33-0cff-4b91-807f-5bd781b86eaa]: (2,) {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:11:15 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c081796c-cb9c-40f5-90ba-fbf6723667fc]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:11:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-40da9ea8-e2a5-47c0-ae5c-df39aad3aefb tempest-ServerRescueNegativeTestJSON-223041579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0cd83abe-a75d-49b2-874c-4e1b7c42177d {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:11:15 devstack sudo[88722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0cd83abe-a75d-49b2-874c-4e1b7c42177d Nov 04 12:11:15 devstack sudo[88722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:11:15 devstack sudo[88722]: pam_unix(sudo:session): session closed for user root Nov 04 12:11:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-40da9ea8-e2a5-47c0-ae5c-df39aad3aefb tempest-ServerRescueNegativeTestJSON-223041579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0cd83abe-a75d-49b2-874c-4e1b7c42177d" returned: 0 in 0.453s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:11:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-40da9ea8-e2a5-47c0-ae5c-df39aad3aefb tempest-ServerRescueNegativeTestJSON-223041579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0cd83abe-a75d-49b2-874c-4e1b7c42177d {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:11:15 devstack sudo[88728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0cd83abe-a75d-49b2-874c-4e1b7c42177d Nov 04 12:11:15 devstack sudo[88728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:11:16 devstack sudo[88728]: pam_unix(sudo:session): session closed for user root Nov 04 12:11:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-40da9ea8-e2a5-47c0-ae5c-df39aad3aefb tempest-ServerRescueNegativeTestJSON-223041579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0cd83abe-a75d-49b2-874c-4e1b7c42177d" returned: 0 in 0.359s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:11:16 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-40da9ea8-e2a5-47c0-ae5c-df39aad3aefb tempest-ServerRescueNegativeTestJSON-223041579 None] Lock "cinder-quobyte-0cd83abe-a75d-49b2-874c-4e1b7c42177d" released by "delete_volume" :: held 2.899s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:11:16 devstack cinder-volume[87095]: WARNING cinder.quota [None req-40da9ea8-e2a5-47c0-ae5c-df39aad3aefb tempest-ServerRescueNegativeTestJSON-223041579 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 04 12:11:16 devstack cinder-volume[87095]: WARNING cinder.quota [None req-40da9ea8-e2a5-47c0-ae5c-df39aad3aefb tempest-ServerRescueNegativeTestJSON-223041579 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 04 12:11:16 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-40da9ea8-e2a5-47c0-ae5c-df39aad3aefb tempest-ServerRescueNegativeTestJSON-223041579 None] Created reservations ['2f752fa5-c0e9-41cb-ab99-aad020773741', '3bb13edf-ea18-412f-8205-94b2a8a91afe', '8f6ca494-94fd-4847-8306-bdcbb98d21ee', '521f7cfe-debe-489b-b2bd-09c7aa49f503'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:11:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-40da9ea8-e2a5-47c0-ae5c-df39aad3aefb tempest-ServerRescueNegativeTestJSON-223041579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:11:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-40da9ea8-e2a5-47c0-ae5c-df39aad3aefb tempest-ServerRescueNegativeTestJSON-223041579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:11:16 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-40da9ea8-e2a5-47c0-ae5c-df39aad3aefb tempest-ServerRescueNegativeTestJSON-223041579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:11:16 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-40da9ea8-e2a5-47c0-ae5c-df39aad3aefb tempest-ServerRescueNegativeTestJSON-223041579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:11:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-40da9ea8-e2a5-47c0-ae5c-df39aad3aefb tempest-ServerRescueNegativeTestJSON-223041579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:11:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-40da9ea8-e2a5-47c0-ae5c-df39aad3aefb tempest-ServerRescueNegativeTestJSON-223041579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:11:16 devstack sudo[88731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:11:16 devstack sudo[88731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:11:16 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-d0c716ce-4d9f-43b3-9b67-6667e0ee4f71 tempest-ServersNegativeTestJSON-149214978 None] Acquiring lock "cinder-f8cb9733-7f65-4f14-8988-0aadde6f08f3-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:11:16 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-d0c716ce-4d9f-43b3-9b67-6667e0ee4f71 tempest-ServersNegativeTestJSON-149214978 None] Lock "cinder-f8cb9733-7f65-4f14-8988-0aadde6f08f3-delete_volume" acquired by "delete_volume" :: waited 0.113s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:11:16 devstack sudo[88731]: pam_unix(sudo:session): session closed for user root Nov 04 12:11:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-40da9ea8-e2a5-47c0-ae5c-df39aad3aefb tempest-ServerRescueNegativeTestJSON-223041579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.507s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:11:16 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-40da9ea8-e2a5-47c0-ae5c-df39aad3aefb tempest-ServerRescueNegativeTestJSON-223041579 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:11:16 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-40da9ea8-e2a5-47c0-ae5c-df39aad3aefb tempest-ServerRescueNegativeTestJSON-223041579 None] Deleted volume successfully. Nov 04 12:11:17 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-d0c716ce-4d9f-43b3-9b67-6667e0ee4f71 tempest-ServersNegativeTestJSON-149214978 None] Acquiring lock "cinder-quobyte-f8cb9733-7f65-4f14-8988-0aadde6f08f3" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:11:17 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-40da9ea8-e2a5-47c0-ae5c-df39aad3aefb tempest-ServerRescueNegativeTestJSON-223041579 None] Lock "cinder-0cd83abe-a75d-49b2-874c-4e1b7c42177d-delete_volume" released by "delete_volume" :: held 4.100s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:11:17 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-d0c716ce-4d9f-43b3-9b67-6667e0ee4f71 tempest-ServersNegativeTestJSON-149214978 None] Lock "cinder-quobyte-f8cb9733-7f65-4f14-8988-0aadde6f08f3" acquired by "delete_volume" :: waited 0.039s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:11:17 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[88dd817e-c7ae-4319-906a-5a6af2589ff8]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:11:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d0c716ce-4d9f-43b3-9b67-6667e0ee4f71 tempest-ServersNegativeTestJSON-149214978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f8cb9733-7f65-4f14-8988-0aadde6f08f3 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:11:17 devstack sudo[88748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f8cb9733-7f65-4f14-8988-0aadde6f08f3 Nov 04 12:11:17 devstack sudo[88748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:11:17 devstack sudo[88748]: pam_unix(sudo:session): session closed for user root Nov 04 12:11:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d0c716ce-4d9f-43b3-9b67-6667e0ee4f71 tempest-ServersNegativeTestJSON-149214978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f8cb9733-7f65-4f14-8988-0aadde6f08f3" returned: 0 in 0.610s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:11:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d0c716ce-4d9f-43b3-9b67-6667e0ee4f71 tempest-ServersNegativeTestJSON-149214978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f8cb9733-7f65-4f14-8988-0aadde6f08f3 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:11:17 devstack sudo[88768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f8cb9733-7f65-4f14-8988-0aadde6f08f3 Nov 04 12:11:17 devstack sudo[88768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:11:18 devstack sudo[88768]: pam_unix(sudo:session): session closed for user root Nov 04 12:11:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d0c716ce-4d9f-43b3-9b67-6667e0ee4f71 tempest-ServersNegativeTestJSON-149214978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f8cb9733-7f65-4f14-8988-0aadde6f08f3" returned: 0 in 0.463s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:11:18 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-d0c716ce-4d9f-43b3-9b67-6667e0ee4f71 tempest-ServersNegativeTestJSON-149214978 None] Lock "cinder-quobyte-f8cb9733-7f65-4f14-8988-0aadde6f08f3" released by "delete_volume" :: held 1.151s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:11:18 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-d0c716ce-4d9f-43b3-9b67-6667e0ee4f71 tempest-ServersNegativeTestJSON-149214978 None] Created reservations ['3760c65a-25cd-48c9-b9aa-1dc4dc6cfb07', 'a2e542e6-bae9-40d4-986c-debecf025bb9', '8cf40831-0773-45fa-bacc-0eed31e51dc3', '193bb83f-080d-4d7d-b2cd-c386fe90dedd'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:11:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d0c716ce-4d9f-43b3-9b67-6667e0ee4f71 tempest-ServersNegativeTestJSON-149214978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:11:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d0c716ce-4d9f-43b3-9b67-6667e0ee4f71 tempest-ServersNegativeTestJSON-149214978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:11:18 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d0c716ce-4d9f-43b3-9b67-6667e0ee4f71 tempest-ServersNegativeTestJSON-149214978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:11:18 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d0c716ce-4d9f-43b3-9b67-6667e0ee4f71 tempest-ServersNegativeTestJSON-149214978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:11:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d0c716ce-4d9f-43b3-9b67-6667e0ee4f71 tempest-ServersNegativeTestJSON-149214978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:11:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d0c716ce-4d9f-43b3-9b67-6667e0ee4f71 tempest-ServersNegativeTestJSON-149214978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:11:18 devstack sudo[88774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:11:18 devstack sudo[88774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:11:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d0c716ce-4d9f-43b3-9b67-6667e0ee4f71 tempest-ServersNegativeTestJSON-149214978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.358s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:11:19 devstack sudo[88774]: pam_unix(sudo:session): session closed for user root Nov 04 12:11:19 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-d0c716ce-4d9f-43b3-9b67-6667e0ee4f71 tempest-ServersNegativeTestJSON-149214978 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:11:19 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-d0c716ce-4d9f-43b3-9b67-6667e0ee4f71 tempest-ServersNegativeTestJSON-149214978 None] Deleted volume successfully. Nov 04 12:11:19 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-d0c716ce-4d9f-43b3-9b67-6667e0ee4f71 tempest-ServersNegativeTestJSON-149214978 None] Lock "cinder-f8cb9733-7f65-4f14-8988-0aadde6f08f3-delete_volume" released by "delete_volume" :: held 2.222s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:11:19 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-cc041b31-0204-4b37-8ac9-b41733da94a2 tempest-ServersNegativeTestJSON-149214978 None] Acquiring lock "cinder-cc4472a4-b768-4a9d-969f-5b3fe27ed00e-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:11:19 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-cc041b31-0204-4b37-8ac9-b41733da94a2 tempest-ServersNegativeTestJSON-149214978 None] Lock "cinder-cc4472a4-b768-4a9d-969f-5b3fe27ed00e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:11:19 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-cc041b31-0204-4b37-8ac9-b41733da94a2 tempest-ServersNegativeTestJSON-149214978 None] Acquiring lock "cinder-quobyte-cc4472a4-b768-4a9d-969f-5b3fe27ed00e" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:11:19 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-cc041b31-0204-4b37-8ac9-b41733da94a2 tempest-ServersNegativeTestJSON-149214978 None] Lock "cinder-quobyte-cc4472a4-b768-4a9d-969f-5b3fe27ed00e" acquired by "delete_volume" :: waited 0.017s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:11:19 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[45496429-a70c-45ed-946d-4f9673fb4a70]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:11:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cc041b31-0204-4b37-8ac9-b41733da94a2 tempest-ServersNegativeTestJSON-149214978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cc4472a4-b768-4a9d-969f-5b3fe27ed00e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:11:19 devstack sudo[88780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cc4472a4-b768-4a9d-969f-5b3fe27ed00e Nov 04 12:11:19 devstack sudo[88780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:11:19 devstack sudo[88780]: pam_unix(sudo:session): session closed for user root Nov 04 12:11:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cc041b31-0204-4b37-8ac9-b41733da94a2 tempest-ServersNegativeTestJSON-149214978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cc4472a4-b768-4a9d-969f-5b3fe27ed00e" returned: 0 in 0.547s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:11:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cc041b31-0204-4b37-8ac9-b41733da94a2 tempest-ServersNegativeTestJSON-149214978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cc4472a4-b768-4a9d-969f-5b3fe27ed00e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:11:19 devstack sudo[88786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cc4472a4-b768-4a9d-969f-5b3fe27ed00e Nov 04 12:11:19 devstack sudo[88786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:11:20 devstack sudo[88786]: pam_unix(sudo:session): session closed for user root Nov 04 12:11:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cc041b31-0204-4b37-8ac9-b41733da94a2 tempest-ServersNegativeTestJSON-149214978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cc4472a4-b768-4a9d-969f-5b3fe27ed00e" returned: 0 in 0.312s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:11:20 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-cc041b31-0204-4b37-8ac9-b41733da94a2 tempest-ServersNegativeTestJSON-149214978 None] Lock "cinder-quobyte-cc4472a4-b768-4a9d-969f-5b3fe27ed00e" released by "delete_volume" :: held 0.915s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:11:20 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-cc041b31-0204-4b37-8ac9-b41733da94a2 tempest-ServersNegativeTestJSON-149214978 None] Created reservations ['31f85566-da54-4d0f-a994-5485d52ca818', '335cc21a-b347-44a7-a9f1-09e639a3097a', '86f4142b-4231-4712-9639-d1c16cafa338', '00a42a90-c5db-4bef-867f-1d944324aaf4'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:11:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cc041b31-0204-4b37-8ac9-b41733da94a2 tempest-ServersNegativeTestJSON-149214978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:11:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cc041b31-0204-4b37-8ac9-b41733da94a2 tempest-ServersNegativeTestJSON-149214978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:11:20 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-cc041b31-0204-4b37-8ac9-b41733da94a2 tempest-ServersNegativeTestJSON-149214978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:11:20 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-cc041b31-0204-4b37-8ac9-b41733da94a2 tempest-ServersNegativeTestJSON-149214978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:11:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cc041b31-0204-4b37-8ac9-b41733da94a2 tempest-ServersNegativeTestJSON-149214978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:11:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cc041b31-0204-4b37-8ac9-b41733da94a2 tempest-ServersNegativeTestJSON-149214978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:11:20 devstack sudo[88790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:11:20 devstack sudo[88790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:11:20 devstack sudo[88790]: pam_unix(sudo:session): session closed for user root Nov 04 12:11:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cc041b31-0204-4b37-8ac9-b41733da94a2 tempest-ServersNegativeTestJSON-149214978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.452s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:11:20 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-cc041b31-0204-4b37-8ac9-b41733da94a2 tempest-ServersNegativeTestJSON-149214978 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:11:20 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-cc041b31-0204-4b37-8ac9-b41733da94a2 tempest-ServersNegativeTestJSON-149214978 None] Deleted volume successfully. Nov 04 12:11:20 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-cc041b31-0204-4b37-8ac9-b41733da94a2 tempest-ServersNegativeTestJSON-149214978 None] Lock "cinder-cc4472a4-b768-4a9d-969f-5b3fe27ed00e-delete_volume" released by "delete_volume" :: held 1.713s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:11:35 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:UPDATE=28,cinder:SELECT=19,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 12:11:35 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=20,cinder:UPDATE=33,cinder:INSERT=8,cinder:DELETE=3 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 12:11:43 devstack cinder-volume[87095]: WARNING py.warnings [req-f5eb4f5c-5743-48e8-a45a-70f3298f4022 req-7ea62778-f701-4695-b35c-8a5522d2f33a tempest-TaggedAttachmentsTest-1730865996 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Nov 04 12:11:43 devstack cinder-volume[87095]: .first() Nov 04 12:11:43 devstack cinder-volume[87095]: Nov 04 12:11:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-f5eb4f5c-5743-48e8-a45a-70f3298f4022 req-7ea62778-f701-4695-b35c-8a5522d2f33a tempest-TaggedAttachmentsTest-1730865996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:11:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-f5eb4f5c-5743-48e8-a45a-70f3298f4022 req-7ea62778-f701-4695-b35c-8a5522d2f33a tempest-TaggedAttachmentsTest-1730865996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:11:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-f5eb4f5c-5743-48e8-a45a-70f3298f4022 req-7ea62778-f701-4695-b35c-8a5522d2f33a tempest-TaggedAttachmentsTest-1730865996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:11:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-f5eb4f5c-5743-48e8-a45a-70f3298f4022 req-7ea62778-f701-4695-b35c-8a5522d2f33a tempest-TaggedAttachmentsTest-1730865996 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784', 'name': 'volume-fad154d2-ae1f-461f-8231-b20d4b2dc5a4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd5cf934e-a8ff-4a13-baab-5d8f1d7175bf', 'enforce_multipath': True} {{(pid=87095) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 12:11:43 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-f5eb4f5c-5743-48e8-a45a-70f3298f4022 req-7ea62778-f701-4695-b35c-8a5522d2f33a tempest-TaggedAttachmentsTest-1730865996 None] attachment_update completed successfully. Nov 04 12:11:47 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-34be0c9f-0718-4d15-b615-b2ef938ee465 req-db867a96-f9fa-449f-88ba-3c06c8cab561 tempest-TaggedAttachmentsTest-1730865996 None] Terminate volume connection completed successfully. Nov 04 12:11:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-34be0c9f-0718-4d15-b615-b2ef938ee465 req-db867a96-f9fa-449f-88ba-3c06c8cab561 tempest-TaggedAttachmentsTest-1730865996 None] Deleting attachment d5cf934e-a8ff-4a13-baab-5d8f1d7175bf. {{(pid=87095) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 12:11:57 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 12:11:57 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 12:12:01 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 12:12:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:12:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:12:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:12:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:12:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:12:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:12:01 devstack sudo[89466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:12:01 devstack sudo[89466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:12:02 devstack sudo[89466]: pam_unix(sudo:session): session closed for user root Nov 04 12:12:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.386s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:12:02 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:12:07 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-8ddce14e-c205-4347-a64e-dee793cba73b tempest-TaggedAttachmentsTest-1730865996 None] Acquiring lock "cinder-fad154d2-ae1f-461f-8231-b20d4b2dc5a4-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:12:08 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-8ddce14e-c205-4347-a64e-dee793cba73b tempest-TaggedAttachmentsTest-1730865996 None] Lock "cinder-fad154d2-ae1f-461f-8231-b20d4b2dc5a4-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:12:08 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-8ddce14e-c205-4347-a64e-dee793cba73b tempest-TaggedAttachmentsTest-1730865996 None] Acquiring lock "cinder-quobyte-fad154d2-ae1f-461f-8231-b20d4b2dc5a4" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:12:08 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-8ddce14e-c205-4347-a64e-dee793cba73b tempest-TaggedAttachmentsTest-1730865996 None] Lock "cinder-quobyte-fad154d2-ae1f-461f-8231-b20d4b2dc5a4" acquired by "delete_volume" :: waited 0.021s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:12:08 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8857cd1-5c3b-4454-a4d5-3e7823ab3688]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:12:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8ddce14e-c205-4347-a64e-dee793cba73b tempest-TaggedAttachmentsTest-1730865996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fad154d2-ae1f-461f-8231-b20d4b2dc5a4 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:12:08 devstack sudo[89484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fad154d2-ae1f-461f-8231-b20d4b2dc5a4 Nov 04 12:12:08 devstack sudo[89484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:12:08 devstack sudo[89484]: pam_unix(sudo:session): session closed for user root Nov 04 12:12:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8ddce14e-c205-4347-a64e-dee793cba73b tempest-TaggedAttachmentsTest-1730865996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fad154d2-ae1f-461f-8231-b20d4b2dc5a4" returned: 0 in 0.753s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:12:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8ddce14e-c205-4347-a64e-dee793cba73b tempest-TaggedAttachmentsTest-1730865996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fad154d2-ae1f-461f-8231-b20d4b2dc5a4 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:12:09 devstack sudo[89529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fad154d2-ae1f-461f-8231-b20d4b2dc5a4 Nov 04 12:12:09 devstack sudo[89529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:12:09 devstack sudo[89529]: pam_unix(sudo:session): session closed for user root Nov 04 12:12:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8ddce14e-c205-4347-a64e-dee793cba73b tempest-TaggedAttachmentsTest-1730865996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fad154d2-ae1f-461f-8231-b20d4b2dc5a4" returned: 0 in 0.623s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:12:09 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-8ddce14e-c205-4347-a64e-dee793cba73b tempest-TaggedAttachmentsTest-1730865996 None] Lock "cinder-quobyte-fad154d2-ae1f-461f-8231-b20d4b2dc5a4" released by "delete_volume" :: held 1.488s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:12:09 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-8ddce14e-c205-4347-a64e-dee793cba73b tempest-TaggedAttachmentsTest-1730865996 None] Created reservations ['ba68001d-29e7-42e2-a29a-091113041fcd', 'daeb4900-6c28-4308-955b-18ecbea292e7', '7300ad4b-0da2-4ebd-827e-2541876a5cd4', '22a58380-d971-4efe-9341-3558dffec733'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:12:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-8ddce14e-c205-4347-a64e-dee793cba73b tempest-TaggedAttachmentsTest-1730865996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:12:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-8ddce14e-c205-4347-a64e-dee793cba73b tempest-TaggedAttachmentsTest-1730865996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:12:09 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-8ddce14e-c205-4347-a64e-dee793cba73b tempest-TaggedAttachmentsTest-1730865996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:12:09 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-8ddce14e-c205-4347-a64e-dee793cba73b tempest-TaggedAttachmentsTest-1730865996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:12:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-8ddce14e-c205-4347-a64e-dee793cba73b tempest-TaggedAttachmentsTest-1730865996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:12:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8ddce14e-c205-4347-a64e-dee793cba73b tempest-TaggedAttachmentsTest-1730865996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:12:09 devstack sudo[89558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:12:09 devstack sudo[89558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:12:10 devstack sudo[89558]: pam_unix(sudo:session): session closed for user root Nov 04 12:12:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8ddce14e-c205-4347-a64e-dee793cba73b tempest-TaggedAttachmentsTest-1730865996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.449s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:12:10 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-8ddce14e-c205-4347-a64e-dee793cba73b tempest-TaggedAttachmentsTest-1730865996 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:12:10 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-8ddce14e-c205-4347-a64e-dee793cba73b tempest-TaggedAttachmentsTest-1730865996 None] Deleted volume successfully. Nov 04 12:12:10 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-8ddce14e-c205-4347-a64e-dee793cba73b tempest-TaggedAttachmentsTest-1730865996 None] Lock "cinder-fad154d2-ae1f-461f-8231-b20d4b2dc5a4-delete_volume" released by "delete_volume" :: held 2.240s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:12:19 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=5,cinder:INSERT=1,cinder:UPDATE=8 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 12:12:20 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=5,cinder:UPDATE=8,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 12:12:23 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-b57c4fc1-8177-45a4-91d7-b105c1698476 tempest-VolumesAdminNegativeTest-935612459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:12:23 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b57c4fc1-8177-45a4-91d7-b105c1698476 tempest-VolumesAdminNegativeTest-935612459 None] Flow 'volume_create_manager' (f8d9d603-4f16-49bd-982d-c0cb5c15acbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:12:23 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b57c4fc1-8177-45a4-91d7-b105c1698476 tempest-VolumesAdminNegativeTest-935612459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90ab1289-ebf0-489b-af02-de1651b831e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:12:23 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b57c4fc1-8177-45a4-91d7-b105c1698476 tempest-VolumesAdminNegativeTest-935612459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90ab1289-ebf0-489b-af02-de1651b831e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1469190334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a46e2223-4cae-4e66-9478-4aaade4b9e3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='922084d24e9c4e2884157714694c7cc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:12:24Z,use_quota=True,user_id='dfefc14c951c4dedaefd45552ae2529a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:12:23 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b57c4fc1-8177-45a4-91d7-b105c1698476 tempest-VolumesAdminNegativeTest-935612459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a824411d-0c1b-4a1f-bd7b-94bbee00b86a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:12:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b57c4fc1-8177-45a4-91d7-b105c1698476 tempest-VolumesAdminNegativeTest-935612459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a824411d-0c1b-4a1f-bd7b-94bbee00b86a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:12:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b57c4fc1-8177-45a4-91d7-b105c1698476 tempest-VolumesAdminNegativeTest-935612459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6824045-6240-4268-8c5a-00a86ae35df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:12:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b57c4fc1-8177-45a4-91d7-b105c1698476 tempest-VolumesAdminNegativeTest-935612459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6824045-6240-4268-8c5a-00a86ae35df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a46e2223-4cae-4e66-9478-4aaade4b9e3c', 'volume_name': 'volume-a46e2223-4cae-4e66-9478-4aaade4b9e3c', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:12:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b57c4fc1-8177-45a4-91d7-b105c1698476 tempest-VolumesAdminNegativeTest-935612459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40da6b65-9a8a-48f9-9f04-36b49620da5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:12:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b57c4fc1-8177-45a4-91d7-b105c1698476 tempest-VolumesAdminNegativeTest-935612459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40da6b65-9a8a-48f9-9f04-36b49620da5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:12:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b57c4fc1-8177-45a4-91d7-b105c1698476 tempest-VolumesAdminNegativeTest-935612459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdd110da-fa21-402b-8afa-34ee1805d7c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:12:24 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-b57c4fc1-8177-45a4-91d7-b105c1698476 tempest-VolumesAdminNegativeTest-935612459 None] Volume a46e2223-4cae-4e66-9478-4aaade4b9e3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a46e2223-4cae-4e66-9478-4aaade4b9e3c', 'volume_size': 1} Nov 04 12:12:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b57c4fc1-8177-45a4-91d7-b105c1698476 tempest-VolumesAdminNegativeTest-935612459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:12:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b57c4fc1-8177-45a4-91d7-b105c1698476 tempest-VolumesAdminNegativeTest-935612459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:12:24 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b57c4fc1-8177-45a4-91d7-b105c1698476 tempest-VolumesAdminNegativeTest-935612459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1469190334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a46e2223-4cae-4e66-9478-4aaade4b9e3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='922084d24e9c4e2884157714694c7cc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:12:24Z,use_quota=True,user_id='dfefc14c951c4dedaefd45552ae2529a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:12:24 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-b57c4fc1-8177-45a4-91d7-b105c1698476 tempest-VolumesAdminNegativeTest-935612459 None] Creating volume a46e2223-4cae-4e66-9478-4aaade4b9e3c {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:12:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b57c4fc1-8177-45a4-91d7-b105c1698476 tempest-VolumesAdminNegativeTest-935612459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:12:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b57c4fc1-8177-45a4-91d7-b105c1698476 tempest-VolumesAdminNegativeTest-935612459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:12:24 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b57c4fc1-8177-45a4-91d7-b105c1698476 tempest-VolumesAdminNegativeTest-935612459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:12:24 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b57c4fc1-8177-45a4-91d7-b105c1698476 tempest-VolumesAdminNegativeTest-935612459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:12:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b57c4fc1-8177-45a4-91d7-b105c1698476 tempest-VolumesAdminNegativeTest-935612459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:12:24 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b57c4fc1-8177-45a4-91d7-b105c1698476 tempest-VolumesAdminNegativeTest-935612459 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:12:24 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-b57c4fc1-8177-45a4-91d7-b105c1698476 tempest-VolumesAdminNegativeTest-935612459 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:12:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b57c4fc1-8177-45a4-91d7-b105c1698476 tempest-VolumesAdminNegativeTest-935612459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a46e2223-4cae-4e66-9478-4aaade4b9e3c 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:12:24 devstack sudo[89739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a46e2223-4cae-4e66-9478-4aaade4b9e3c 1073741824 Nov 04 12:12:24 devstack sudo[89739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:12:24 devstack sudo[89739]: pam_unix(sudo:session): session closed for user root Nov 04 12:12:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b57c4fc1-8177-45a4-91d7-b105c1698476 tempest-VolumesAdminNegativeTest-935612459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a46e2223-4cae-4e66-9478-4aaade4b9e3c 1073741824" returned: 0 in 0.530s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:12:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b57c4fc1-8177-45a4-91d7-b105c1698476 tempest-VolumesAdminNegativeTest-935612459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a46e2223-4cae-4e66-9478-4aaade4b9e3c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:12:24 devstack sudo[89745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a46e2223-4cae-4e66-9478-4aaade4b9e3c Nov 04 12:12:24 devstack sudo[89745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:12:25 devstack sudo[89745]: pam_unix(sudo:session): session closed for user root Nov 04 12:12:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b57c4fc1-8177-45a4-91d7-b105c1698476 tempest-VolumesAdminNegativeTest-935612459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a46e2223-4cae-4e66-9478-4aaade4b9e3c" returned: 0 in 0.451s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:12:25 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b57c4fc1-8177-45a4-91d7-b105c1698476 tempest-VolumesAdminNegativeTest-935612459 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:12:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b57c4fc1-8177-45a4-91d7-b105c1698476 tempest-VolumesAdminNegativeTest-935612459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:12:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b57c4fc1-8177-45a4-91d7-b105c1698476 tempest-VolumesAdminNegativeTest-935612459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdd110da-fa21-402b-8afa-34ee1805d7c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a46e2223-4cae-4e66-9478-4aaade4b9e3c', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:12:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b57c4fc1-8177-45a4-91d7-b105c1698476 tempest-VolumesAdminNegativeTest-935612459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6cb3d76-a53a-4e77-8353-edbb3900b22e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:12:25 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-b57c4fc1-8177-45a4-91d7-b105c1698476 tempest-VolumesAdminNegativeTest-935612459 None] Volume volume-a46e2223-4cae-4e66-9478-4aaade4b9e3c (a46e2223-4cae-4e66-9478-4aaade4b9e3c): created successfully Nov 04 12:12:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b57c4fc1-8177-45a4-91d7-b105c1698476 tempest-VolumesAdminNegativeTest-935612459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6cb3d76-a53a-4e77-8353-edbb3900b22e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:12:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b57c4fc1-8177-45a4-91d7-b105c1698476 tempest-VolumesAdminNegativeTest-935612459 None] Flow 'volume_create_manager' (f8d9d603-4f16-49bd-982d-c0cb5c15acbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:12:25 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-b57c4fc1-8177-45a4-91d7-b105c1698476 tempest-VolumesAdminNegativeTest-935612459 None] Created volume successfully. Nov 04 12:12:27 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-5bdab9b9-a6fb-4712-b2c2-55389379cd0b tempest-VolumesAdminNegativeTest-935612459 None] Acquiring lock "cinder-a46e2223-4cae-4e66-9478-4aaade4b9e3c-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:12:27 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-5bdab9b9-a6fb-4712-b2c2-55389379cd0b tempest-VolumesAdminNegativeTest-935612459 None] Lock "cinder-a46e2223-4cae-4e66-9478-4aaade4b9e3c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:12:27 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-5bdab9b9-a6fb-4712-b2c2-55389379cd0b tempest-VolumesAdminNegativeTest-935612459 None] Acquiring lock "cinder-quobyte-a46e2223-4cae-4e66-9478-4aaade4b9e3c" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:12:27 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-5bdab9b9-a6fb-4712-b2c2-55389379cd0b tempest-VolumesAdminNegativeTest-935612459 None] Lock "cinder-quobyte-a46e2223-4cae-4e66-9478-4aaade4b9e3c" acquired by "delete_volume" :: waited 0.022s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:12:27 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a45d252-2737-4069-88f3-1e1d348ed32b]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:12:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5bdab9b9-a6fb-4712-b2c2-55389379cd0b tempest-VolumesAdminNegativeTest-935612459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a46e2223-4cae-4e66-9478-4aaade4b9e3c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:12:27 devstack sudo[89774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a46e2223-4cae-4e66-9478-4aaade4b9e3c Nov 04 12:12:27 devstack sudo[89774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:12:27 devstack sudo[89774]: pam_unix(sudo:session): session closed for user root Nov 04 12:12:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5bdab9b9-a6fb-4712-b2c2-55389379cd0b tempest-VolumesAdminNegativeTest-935612459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a46e2223-4cae-4e66-9478-4aaade4b9e3c" returned: 0 in 0.571s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:12:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5bdab9b9-a6fb-4712-b2c2-55389379cd0b tempest-VolumesAdminNegativeTest-935612459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a46e2223-4cae-4e66-9478-4aaade4b9e3c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:12:27 devstack sudo[89779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a46e2223-4cae-4e66-9478-4aaade4b9e3c Nov 04 12:12:27 devstack sudo[89779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:12:28 devstack sudo[89779]: pam_unix(sudo:session): session closed for user root Nov 04 12:12:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5bdab9b9-a6fb-4712-b2c2-55389379cd0b tempest-VolumesAdminNegativeTest-935612459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a46e2223-4cae-4e66-9478-4aaade4b9e3c" returned: 0 in 0.336s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:12:28 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-5bdab9b9-a6fb-4712-b2c2-55389379cd0b tempest-VolumesAdminNegativeTest-935612459 None] Lock "cinder-quobyte-a46e2223-4cae-4e66-9478-4aaade4b9e3c" released by "delete_volume" :: held 0.985s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:12:28 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-5bdab9b9-a6fb-4712-b2c2-55389379cd0b tempest-VolumesAdminNegativeTest-935612459 None] Created reservations ['65c8d9df-2640-4253-b965-1fe77c201e4f', '81430bc8-d654-48d7-aa57-e7abde0ff948', '70480514-57e0-4006-b3d2-c40a275b9c36', '47d4beb5-8bb1-4b60-82ac-fa0e9c6c31cb'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:12:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5bdab9b9-a6fb-4712-b2c2-55389379cd0b tempest-VolumesAdminNegativeTest-935612459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:12:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5bdab9b9-a6fb-4712-b2c2-55389379cd0b tempest-VolumesAdminNegativeTest-935612459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:12:28 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-5bdab9b9-a6fb-4712-b2c2-55389379cd0b tempest-VolumesAdminNegativeTest-935612459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:12:28 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-5bdab9b9-a6fb-4712-b2c2-55389379cd0b tempest-VolumesAdminNegativeTest-935612459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:12:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5bdab9b9-a6fb-4712-b2c2-55389379cd0b tempest-VolumesAdminNegativeTest-935612459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:12:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5bdab9b9-a6fb-4712-b2c2-55389379cd0b tempest-VolumesAdminNegativeTest-935612459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:12:28 devstack sudo[89782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:12:28 devstack sudo[89782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:12:28 devstack sudo[89782]: pam_unix(sudo:session): session closed for user root Nov 04 12:12:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5bdab9b9-a6fb-4712-b2c2-55389379cd0b tempest-VolumesAdminNegativeTest-935612459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.319s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:12:28 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-5bdab9b9-a6fb-4712-b2c2-55389379cd0b tempest-VolumesAdminNegativeTest-935612459 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:12:28 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-5bdab9b9-a6fb-4712-b2c2-55389379cd0b tempest-VolumesAdminNegativeTest-935612459 None] Deleted volume successfully. Nov 04 12:12:28 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-5bdab9b9-a6fb-4712-b2c2-55389379cd0b tempest-VolumesAdminNegativeTest-935612459 None] Lock "cinder-a46e2223-4cae-4e66-9478-4aaade4b9e3c-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:12:35 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-12e1aede-4b2f-4e28-9c3d-36a8660614a1 tempest-VolumesListAdminTestJSON-266026417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:12:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-12e1aede-4b2f-4e28-9c3d-36a8660614a1 tempest-VolumesListAdminTestJSON-266026417 None] Flow 'volume_create_manager' (15a50fd9-6679-45d4-b22c-29bff91728a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:12:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-12e1aede-4b2f-4e28-9c3d-36a8660614a1 tempest-VolumesListAdminTestJSON-266026417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31594e78-9dd5-484d-8075-c23add46a127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:12:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-12e1aede-4b2f-4e28-9c3d-36a8660614a1 tempest-VolumesListAdminTestJSON-266026417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31594e78-9dd5-484d-8075-c23add46a127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:12:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-129612036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2af269eb-6b3a-4299-9a94-c8bce305e7e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33af80a217054409abca6bac8443fafe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:12:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:12:35Z,use_quota=True,user_id='2c0f969afe2a498bb35bf65d317cab0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:12:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-12e1aede-4b2f-4e28-9c3d-36a8660614a1 tempest-VolumesListAdminTestJSON-266026417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58d5650d-620f-4de3-abfa-f578485fc309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:12:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-12e1aede-4b2f-4e28-9c3d-36a8660614a1 tempest-VolumesListAdminTestJSON-266026417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58d5650d-620f-4de3-abfa-f578485fc309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:12:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-12e1aede-4b2f-4e28-9c3d-36a8660614a1 tempest-VolumesListAdminTestJSON-266026417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c6774da-d50d-422a-871e-e2ae64af5ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:12:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-12e1aede-4b2f-4e28-9c3d-36a8660614a1 tempest-VolumesListAdminTestJSON-266026417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c6774da-d50d-422a-871e-e2ae64af5ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2af269eb-6b3a-4299-9a94-c8bce305e7e3', 'volume_name': 'volume-2af269eb-6b3a-4299-9a94-c8bce305e7e3', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:12:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-12e1aede-4b2f-4e28-9c3d-36a8660614a1 tempest-VolumesListAdminTestJSON-266026417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8fb438a-eef1-4612-9338-4cce7f614d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:12:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-12e1aede-4b2f-4e28-9c3d-36a8660614a1 tempest-VolumesListAdminTestJSON-266026417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8fb438a-eef1-4612-9338-4cce7f614d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:12:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-12e1aede-4b2f-4e28-9c3d-36a8660614a1 tempest-VolumesListAdminTestJSON-266026417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b335d3f4-ad94-4f67-8e8c-fe1b203b0ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:12:35 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-12e1aede-4b2f-4e28-9c3d-36a8660614a1 tempest-VolumesListAdminTestJSON-266026417 None] Volume 2af269eb-6b3a-4299-9a94-c8bce305e7e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2af269eb-6b3a-4299-9a94-c8bce305e7e3', 'volume_size': 1} Nov 04 12:12:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-12e1aede-4b2f-4e28-9c3d-36a8660614a1 tempest-VolumesListAdminTestJSON-266026417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:12:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-12e1aede-4b2f-4e28-9c3d-36a8660614a1 tempest-VolumesListAdminTestJSON-266026417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:12:35 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-12e1aede-4b2f-4e28-9c3d-36a8660614a1 tempest-VolumesListAdminTestJSON-266026417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:12:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-129612036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2af269eb-6b3a-4299-9a94-c8bce305e7e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33af80a217054409abca6bac8443fafe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:12:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:12:35Z,use_quota=True,user_id='2c0f969afe2a498bb35bf65d317cab0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:12:35 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-12e1aede-4b2f-4e28-9c3d-36a8660614a1 tempest-VolumesListAdminTestJSON-266026417 None] Creating volume 2af269eb-6b3a-4299-9a94-c8bce305e7e3 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:12:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-12e1aede-4b2f-4e28-9c3d-36a8660614a1 tempest-VolumesListAdminTestJSON-266026417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:12:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-12e1aede-4b2f-4e28-9c3d-36a8660614a1 tempest-VolumesListAdminTestJSON-266026417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:12:35 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-12e1aede-4b2f-4e28-9c3d-36a8660614a1 tempest-VolumesListAdminTestJSON-266026417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:12:35 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-12e1aede-4b2f-4e28-9c3d-36a8660614a1 tempest-VolumesListAdminTestJSON-266026417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:12:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-12e1aede-4b2f-4e28-9c3d-36a8660614a1 tempest-VolumesListAdminTestJSON-266026417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:12:35 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-12e1aede-4b2f-4e28-9c3d-36a8660614a1 tempest-VolumesListAdminTestJSON-266026417 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:12:35 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-12e1aede-4b2f-4e28-9c3d-36a8660614a1 tempest-VolumesListAdminTestJSON-266026417 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:12:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-12e1aede-4b2f-4e28-9c3d-36a8660614a1 tempest-VolumesListAdminTestJSON-266026417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2af269eb-6b3a-4299-9a94-c8bce305e7e3 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:12:35 devstack sudo[89818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2af269eb-6b3a-4299-9a94-c8bce305e7e3 1073741824 Nov 04 12:12:35 devstack sudo[89818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:12:35 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a3b8a33-eb00-43c0-9993-ce669e32a867 tempest-AttachVolumeShelveTestJSON-176583002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:12:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5a3b8a33-eb00-43c0-9993-ce669e32a867 tempest-AttachVolumeShelveTestJSON-176583002 None] Flow 'volume_create_manager' (150f11a2-f89e-43c7-9cf5-fd942f75a2d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:12:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5a3b8a33-eb00-43c0-9993-ce669e32a867 tempest-AttachVolumeShelveTestJSON-176583002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91b3beb1-506e-480e-bf39-f064b8d5c578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:12:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5a3b8a33-eb00-43c0-9993-ce669e32a867 tempest-AttachVolumeShelveTestJSON-176583002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91b3beb1-506e-480e-bf39-f064b8d5c578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:12:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1807740010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edb55207-3f2c-44aa-b6a0-3b8afe7efee8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='702cb7f0c32d4b4cbe23195019e6f1f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:12:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:12:35Z,use_quota=True,user_id='19957d85e2e6440a819a35fd4ac11823',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:12:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5a3b8a33-eb00-43c0-9993-ce669e32a867 tempest-AttachVolumeShelveTestJSON-176583002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (260b276f-3768-4cda-9e3d-a9a977d601b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:12:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5a3b8a33-eb00-43c0-9993-ce669e32a867 tempest-AttachVolumeShelveTestJSON-176583002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (260b276f-3768-4cda-9e3d-a9a977d601b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:12:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5a3b8a33-eb00-43c0-9993-ce669e32a867 tempest-AttachVolumeShelveTestJSON-176583002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dfff902-df95-4f45-973c-c9ce44937649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:12:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5a3b8a33-eb00-43c0-9993-ce669e32a867 tempest-AttachVolumeShelveTestJSON-176583002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dfff902-df95-4f45-973c-c9ce44937649) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edb55207-3f2c-44aa-b6a0-3b8afe7efee8', 'volume_name': 'volume-edb55207-3f2c-44aa-b6a0-3b8afe7efee8', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:12:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5a3b8a33-eb00-43c0-9993-ce669e32a867 tempest-AttachVolumeShelveTestJSON-176583002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b0c0658-ae85-4db0-86bb-9b659a02e718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:12:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5a3b8a33-eb00-43c0-9993-ce669e32a867 tempest-AttachVolumeShelveTestJSON-176583002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b0c0658-ae85-4db0-86bb-9b659a02e718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:12:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5a3b8a33-eb00-43c0-9993-ce669e32a867 tempest-AttachVolumeShelveTestJSON-176583002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c86fc6c-76e4-45fb-8018-a3ab97e2db7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:12:35 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-5a3b8a33-eb00-43c0-9993-ce669e32a867 tempest-AttachVolumeShelveTestJSON-176583002 None] Volume edb55207-3f2c-44aa-b6a0-3b8afe7efee8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edb55207-3f2c-44aa-b6a0-3b8afe7efee8', 'volume_size': 1} Nov 04 12:12:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5a3b8a33-eb00-43c0-9993-ce669e32a867 tempest-AttachVolumeShelveTestJSON-176583002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:12:35 devstack sudo[89818]: pam_unix(sudo:session): session closed for user root Nov 04 12:12:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-12e1aede-4b2f-4e28-9c3d-36a8660614a1 tempest-VolumesListAdminTestJSON-266026417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2af269eb-6b3a-4299-9a94-c8bce305e7e3 1073741824" returned: 0 in 0.513s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:12:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-12e1aede-4b2f-4e28-9c3d-36a8660614a1 tempest-VolumesListAdminTestJSON-266026417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2af269eb-6b3a-4299-9a94-c8bce305e7e3 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:12:35 devstack sudo[89824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2af269eb-6b3a-4299-9a94-c8bce305e7e3 Nov 04 12:12:35 devstack sudo[89824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:12:36 devstack sudo[89824]: pam_unix(sudo:session): session closed for user root Nov 04 12:12:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-12e1aede-4b2f-4e28-9c3d-36a8660614a1 tempest-VolumesListAdminTestJSON-266026417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2af269eb-6b3a-4299-9a94-c8bce305e7e3" returned: 0 in 0.278s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:12:36 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-12e1aede-4b2f-4e28-9c3d-36a8660614a1 tempest-VolumesListAdminTestJSON-266026417 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:12:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-12e1aede-4b2f-4e28-9c3d-36a8660614a1 tempest-VolumesListAdminTestJSON-266026417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:12:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5a3b8a33-eb00-43c0-9993-ce669e32a867 tempest-AttachVolumeShelveTestJSON-176583002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.610s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:12:36 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-5a3b8a33-eb00-43c0-9993-ce669e32a867 tempest-AttachVolumeShelveTestJSON-176583002 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:12:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1807740010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edb55207-3f2c-44aa-b6a0-3b8afe7efee8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='702cb7f0c32d4b4cbe23195019e6f1f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:12:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:12:35Z,use_quota=True,user_id='19957d85e2e6440a819a35fd4ac11823',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:12:36 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-5a3b8a33-eb00-43c0-9993-ce669e32a867 tempest-AttachVolumeShelveTestJSON-176583002 None] Creating volume edb55207-3f2c-44aa-b6a0-3b8afe7efee8 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:12:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5a3b8a33-eb00-43c0-9993-ce669e32a867 tempest-AttachVolumeShelveTestJSON-176583002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:12:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5a3b8a33-eb00-43c0-9993-ce669e32a867 tempest-AttachVolumeShelveTestJSON-176583002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:12:36 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-5a3b8a33-eb00-43c0-9993-ce669e32a867 tempest-AttachVolumeShelveTestJSON-176583002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:12:36 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-5a3b8a33-eb00-43c0-9993-ce669e32a867 tempest-AttachVolumeShelveTestJSON-176583002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:12:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5a3b8a33-eb00-43c0-9993-ce669e32a867 tempest-AttachVolumeShelveTestJSON-176583002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:12:36 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-5a3b8a33-eb00-43c0-9993-ce669e32a867 tempest-AttachVolumeShelveTestJSON-176583002 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:12:36 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-5a3b8a33-eb00-43c0-9993-ce669e32a867 tempest-AttachVolumeShelveTestJSON-176583002 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:12:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5a3b8a33-eb00-43c0-9993-ce669e32a867 tempest-AttachVolumeShelveTestJSON-176583002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-edb55207-3f2c-44aa-b6a0-3b8afe7efee8 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:12:36 devstack sudo[89827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-edb55207-3f2c-44aa-b6a0-3b8afe7efee8 1073741824 Nov 04 12:12:36 devstack sudo[89827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:12:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-12e1aede-4b2f-4e28-9c3d-36a8660614a1 tempest-VolumesListAdminTestJSON-266026417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b335d3f4-ad94-4f67-8e8c-fe1b203b0ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2af269eb-6b3a-4299-9a94-c8bce305e7e3', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:12:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-12e1aede-4b2f-4e28-9c3d-36a8660614a1 tempest-VolumesListAdminTestJSON-266026417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9ba464c-c49f-4bd9-a423-611833565fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:12:36 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-12e1aede-4b2f-4e28-9c3d-36a8660614a1 tempest-VolumesListAdminTestJSON-266026417 None] Volume volume-2af269eb-6b3a-4299-9a94-c8bce305e7e3 (2af269eb-6b3a-4299-9a94-c8bce305e7e3): created successfully Nov 04 12:12:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-12e1aede-4b2f-4e28-9c3d-36a8660614a1 tempest-VolumesListAdminTestJSON-266026417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9ba464c-c49f-4bd9-a423-611833565fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:12:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-12e1aede-4b2f-4e28-9c3d-36a8660614a1 tempest-VolumesListAdminTestJSON-266026417 None] Flow 'volume_create_manager' (15a50fd9-6679-45d4-b22c-29bff91728a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:12:36 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-12e1aede-4b2f-4e28-9c3d-36a8660614a1 tempest-VolumesListAdminTestJSON-266026417 None] Created volume successfully. Nov 04 12:12:36 devstack sudo[89827]: pam_unix(sudo:session): session closed for user root Nov 04 12:12:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5a3b8a33-eb00-43c0-9993-ce669e32a867 tempest-AttachVolumeShelveTestJSON-176583002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-edb55207-3f2c-44aa-b6a0-3b8afe7efee8 1073741824" returned: 0 in 0.466s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:12:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5a3b8a33-eb00-43c0-9993-ce669e32a867 tempest-AttachVolumeShelveTestJSON-176583002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-edb55207-3f2c-44aa-b6a0-3b8afe7efee8 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:12:36 devstack sudo[89833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-edb55207-3f2c-44aa-b6a0-3b8afe7efee8 Nov 04 12:12:36 devstack sudo[89833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:12:36 devstack sudo[89833]: pam_unix(sudo:session): session closed for user root Nov 04 12:12:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5a3b8a33-eb00-43c0-9993-ce669e32a867 tempest-AttachVolumeShelveTestJSON-176583002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-edb55207-3f2c-44aa-b6a0-3b8afe7efee8" returned: 0 in 0.264s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:12:36 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-5a3b8a33-eb00-43c0-9993-ce669e32a867 tempest-AttachVolumeShelveTestJSON-176583002 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:12:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5a3b8a33-eb00-43c0-9993-ce669e32a867 tempest-AttachVolumeShelveTestJSON-176583002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:12:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5a3b8a33-eb00-43c0-9993-ce669e32a867 tempest-AttachVolumeShelveTestJSON-176583002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c86fc6c-76e4-45fb-8018-a3ab97e2db7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edb55207-3f2c-44aa-b6a0-3b8afe7efee8', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:12:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5a3b8a33-eb00-43c0-9993-ce669e32a867 tempest-AttachVolumeShelveTestJSON-176583002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2dc116d-fb6a-4e0b-869b-98ac1dbc9266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:12:36 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-5a3b8a33-eb00-43c0-9993-ce669e32a867 tempest-AttachVolumeShelveTestJSON-176583002 None] Volume volume-edb55207-3f2c-44aa-b6a0-3b8afe7efee8 (edb55207-3f2c-44aa-b6a0-3b8afe7efee8): created successfully Nov 04 12:12:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5a3b8a33-eb00-43c0-9993-ce669e32a867 tempest-AttachVolumeShelveTestJSON-176583002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2dc116d-fb6a-4e0b-869b-98ac1dbc9266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:12:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5a3b8a33-eb00-43c0-9993-ce669e32a867 tempest-AttachVolumeShelveTestJSON-176583002 None] Flow 'volume_create_manager' (150f11a2-f89e-43c7-9cf5-fd942f75a2d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:12:36 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-5a3b8a33-eb00-43c0-9993-ce669e32a867 tempest-AttachVolumeShelveTestJSON-176583002 None] Created volume successfully. Nov 04 12:12:38 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac8f5d03-2176-4a6f-8df9-aa5484efe190 tempest-VolumesListAdminTestJSON-266026417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:12:38 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ac8f5d03-2176-4a6f-8df9-aa5484efe190 tempest-VolumesListAdminTestJSON-266026417 None] Flow 'volume_create_manager' (f6eada99-dfee-4af8-93a8-e1e1d0e8547b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:12:38 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ac8f5d03-2176-4a6f-8df9-aa5484efe190 tempest-VolumesListAdminTestJSON-266026417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e816c1a4-af52-447c-9319-69df7191c6ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:12:38 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ac8f5d03-2176-4a6f-8df9-aa5484efe190 tempest-VolumesListAdminTestJSON-266026417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e816c1a4-af52-447c-9319-69df7191c6ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:12:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-125016813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c349278-f0ba-4433-b278-6fe2b19cb9c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33af80a217054409abca6bac8443fafe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:12:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:12:38Z,use_quota=True,user_id='2c0f969afe2a498bb35bf65d317cab0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:12:38 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ac8f5d03-2176-4a6f-8df9-aa5484efe190 tempest-VolumesListAdminTestJSON-266026417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4020ec9a-9d64-4cae-b7b2-a765386e957d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:12:38 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ac8f5d03-2176-4a6f-8df9-aa5484efe190 tempest-VolumesListAdminTestJSON-266026417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4020ec9a-9d64-4cae-b7b2-a765386e957d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:12:38 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ac8f5d03-2176-4a6f-8df9-aa5484efe190 tempest-VolumesListAdminTestJSON-266026417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78a711ff-8470-4a73-96a1-0720c47abe88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:12:38 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ac8f5d03-2176-4a6f-8df9-aa5484efe190 tempest-VolumesListAdminTestJSON-266026417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78a711ff-8470-4a73-96a1-0720c47abe88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c349278-f0ba-4433-b278-6fe2b19cb9c0', 'volume_name': 'volume-9c349278-f0ba-4433-b278-6fe2b19cb9c0', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:12:38 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ac8f5d03-2176-4a6f-8df9-aa5484efe190 tempest-VolumesListAdminTestJSON-266026417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2943f397-d536-4f4b-9edb-e3a33a189ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:12:38 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ac8f5d03-2176-4a6f-8df9-aa5484efe190 tempest-VolumesListAdminTestJSON-266026417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2943f397-d536-4f4b-9edb-e3a33a189ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:12:38 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ac8f5d03-2176-4a6f-8df9-aa5484efe190 tempest-VolumesListAdminTestJSON-266026417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd42be06-ebf4-40ea-93ca-80ea87495cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:12:38 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-ac8f5d03-2176-4a6f-8df9-aa5484efe190 tempest-VolumesListAdminTestJSON-266026417 None] Volume 9c349278-f0ba-4433-b278-6fe2b19cb9c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c349278-f0ba-4433-b278-6fe2b19cb9c0', 'volume_size': 1} Nov 04 12:12:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ac8f5d03-2176-4a6f-8df9-aa5484efe190 tempest-VolumesListAdminTestJSON-266026417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:12:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ac8f5d03-2176-4a6f-8df9-aa5484efe190 tempest-VolumesListAdminTestJSON-266026417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:12:38 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ac8f5d03-2176-4a6f-8df9-aa5484efe190 tempest-VolumesListAdminTestJSON-266026417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:12:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-125016813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c349278-f0ba-4433-b278-6fe2b19cb9c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33af80a217054409abca6bac8443fafe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:12:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:12:38Z,use_quota=True,user_id='2c0f969afe2a498bb35bf65d317cab0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:12:38 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-ac8f5d03-2176-4a6f-8df9-aa5484efe190 tempest-VolumesListAdminTestJSON-266026417 None] Creating volume 9c349278-f0ba-4433-b278-6fe2b19cb9c0 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:12:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ac8f5d03-2176-4a6f-8df9-aa5484efe190 tempest-VolumesListAdminTestJSON-266026417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:12:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ac8f5d03-2176-4a6f-8df9-aa5484efe190 tempest-VolumesListAdminTestJSON-266026417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:12:38 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ac8f5d03-2176-4a6f-8df9-aa5484efe190 tempest-VolumesListAdminTestJSON-266026417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:12:38 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ac8f5d03-2176-4a6f-8df9-aa5484efe190 tempest-VolumesListAdminTestJSON-266026417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:12:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ac8f5d03-2176-4a6f-8df9-aa5484efe190 tempest-VolumesListAdminTestJSON-266026417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:12:38 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ac8f5d03-2176-4a6f-8df9-aa5484efe190 tempest-VolumesListAdminTestJSON-266026417 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:12:38 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-ac8f5d03-2176-4a6f-8df9-aa5484efe190 tempest-VolumesListAdminTestJSON-266026417 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:12:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ac8f5d03-2176-4a6f-8df9-aa5484efe190 tempest-VolumesListAdminTestJSON-266026417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9c349278-f0ba-4433-b278-6fe2b19cb9c0 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:12:38 devstack sudo[89840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9c349278-f0ba-4433-b278-6fe2b19cb9c0 1073741824 Nov 04 12:12:38 devstack sudo[89840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:12:38 devstack sudo[89840]: pam_unix(sudo:session): session closed for user root Nov 04 12:12:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ac8f5d03-2176-4a6f-8df9-aa5484efe190 tempest-VolumesListAdminTestJSON-266026417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9c349278-f0ba-4433-b278-6fe2b19cb9c0 1073741824" returned: 0 in 0.655s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:12:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ac8f5d03-2176-4a6f-8df9-aa5484efe190 tempest-VolumesListAdminTestJSON-266026417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9c349278-f0ba-4433-b278-6fe2b19cb9c0 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:12:38 devstack sudo[89846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9c349278-f0ba-4433-b278-6fe2b19cb9c0 Nov 04 12:12:38 devstack sudo[89846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:12:39 devstack sudo[89846]: pam_unix(sudo:session): session closed for user root Nov 04 12:12:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ac8f5d03-2176-4a6f-8df9-aa5484efe190 tempest-VolumesListAdminTestJSON-266026417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9c349278-f0ba-4433-b278-6fe2b19cb9c0" returned: 0 in 0.437s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:12:39 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ac8f5d03-2176-4a6f-8df9-aa5484efe190 tempest-VolumesListAdminTestJSON-266026417 None] <== create_volume: return (1169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:12:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ac8f5d03-2176-4a6f-8df9-aa5484efe190 tempest-VolumesListAdminTestJSON-266026417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.172s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:12:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ac8f5d03-2176-4a6f-8df9-aa5484efe190 tempest-VolumesListAdminTestJSON-266026417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd42be06-ebf4-40ea-93ca-80ea87495cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c349278-f0ba-4433-b278-6fe2b19cb9c0', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:12:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ac8f5d03-2176-4a6f-8df9-aa5484efe190 tempest-VolumesListAdminTestJSON-266026417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dceb105-33ad-40c0-a1d9-4e9cf2db201a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:12:39 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-ac8f5d03-2176-4a6f-8df9-aa5484efe190 tempest-VolumesListAdminTestJSON-266026417 None] Volume volume-9c349278-f0ba-4433-b278-6fe2b19cb9c0 (9c349278-f0ba-4433-b278-6fe2b19cb9c0): created successfully Nov 04 12:12:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ac8f5d03-2176-4a6f-8df9-aa5484efe190 tempest-VolumesListAdminTestJSON-266026417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dceb105-33ad-40c0-a1d9-4e9cf2db201a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:12:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ac8f5d03-2176-4a6f-8df9-aa5484efe190 tempest-VolumesListAdminTestJSON-266026417 None] Flow 'volume_create_manager' (f6eada99-dfee-4af8-93a8-e1e1d0e8547b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:12:39 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-ac8f5d03-2176-4a6f-8df9-aa5484efe190 tempest-VolumesListAdminTestJSON-266026417 None] Created volume successfully. Nov 04 12:12:40 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-aaaa7df8-9c44-446a-a636-e97592e2e227 tempest-VolumesListAdminTestJSON-266026417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:12:41 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-aaaa7df8-9c44-446a-a636-e97592e2e227 tempest-VolumesListAdminTestJSON-266026417 None] Flow 'volume_create_manager' (c30aa2f0-5d03-4621-98a8-a1deddc2729a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:12:41 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-aaaa7df8-9c44-446a-a636-e97592e2e227 tempest-VolumesListAdminTestJSON-266026417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8177e277-b0be-44b3-9430-780ec35a9f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:12:41 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-aaaa7df8-9c44-446a-a636-e97592e2e227 tempest-VolumesListAdminTestJSON-266026417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8177e277-b0be-44b3-9430-780ec35a9f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:12:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-644666783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=807edec6-a747-4f07-a4e7-cba743d880f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33af80a217054409abca6bac8443fafe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:12:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:12:41Z,use_quota=True,user_id='2c0f969afe2a498bb35bf65d317cab0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:12:41 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-aaaa7df8-9c44-446a-a636-e97592e2e227 tempest-VolumesListAdminTestJSON-266026417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fac45b9a-000a-4697-8a3c-09aac426f39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:12:41 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-aaaa7df8-9c44-446a-a636-e97592e2e227 tempest-VolumesListAdminTestJSON-266026417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fac45b9a-000a-4697-8a3c-09aac426f39f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:12:41 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-aaaa7df8-9c44-446a-a636-e97592e2e227 tempest-VolumesListAdminTestJSON-266026417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb5ef503-1e1f-4132-9767-c2732a09f481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:12:41 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-aaaa7df8-9c44-446a-a636-e97592e2e227 tempest-VolumesListAdminTestJSON-266026417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb5ef503-1e1f-4132-9767-c2732a09f481) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '807edec6-a747-4f07-a4e7-cba743d880f0', 'volume_name': 'volume-807edec6-a747-4f07-a4e7-cba743d880f0', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:12:41 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-aaaa7df8-9c44-446a-a636-e97592e2e227 tempest-VolumesListAdminTestJSON-266026417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5614a6b1-28a8-4414-8bc1-baf25aa0abf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:12:41 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-aaaa7df8-9c44-446a-a636-e97592e2e227 tempest-VolumesListAdminTestJSON-266026417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5614a6b1-28a8-4414-8bc1-baf25aa0abf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:12:41 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-aaaa7df8-9c44-446a-a636-e97592e2e227 tempest-VolumesListAdminTestJSON-266026417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f673aa8a-2f91-4877-baaa-d52b02d01c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:12:41 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-aaaa7df8-9c44-446a-a636-e97592e2e227 tempest-VolumesListAdminTestJSON-266026417 None] Volume 807edec6-a747-4f07-a4e7-cba743d880f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-807edec6-a747-4f07-a4e7-cba743d880f0', 'volume_size': 1} Nov 04 12:12:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-aaaa7df8-9c44-446a-a636-e97592e2e227 tempest-VolumesListAdminTestJSON-266026417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:12:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-aaaa7df8-9c44-446a-a636-e97592e2e227 tempest-VolumesListAdminTestJSON-266026417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:12:41 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-aaaa7df8-9c44-446a-a636-e97592e2e227 tempest-VolumesListAdminTestJSON-266026417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:12:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-644666783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=807edec6-a747-4f07-a4e7-cba743d880f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33af80a217054409abca6bac8443fafe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:12:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:12:41Z,use_quota=True,user_id='2c0f969afe2a498bb35bf65d317cab0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:12:41 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-aaaa7df8-9c44-446a-a636-e97592e2e227 tempest-VolumesListAdminTestJSON-266026417 None] Creating volume 807edec6-a747-4f07-a4e7-cba743d880f0 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:12:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-aaaa7df8-9c44-446a-a636-e97592e2e227 tempest-VolumesListAdminTestJSON-266026417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:12:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-aaaa7df8-9c44-446a-a636-e97592e2e227 tempest-VolumesListAdminTestJSON-266026417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:12:41 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-aaaa7df8-9c44-446a-a636-e97592e2e227 tempest-VolumesListAdminTestJSON-266026417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:12:41 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-aaaa7df8-9c44-446a-a636-e97592e2e227 tempest-VolumesListAdminTestJSON-266026417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:12:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-aaaa7df8-9c44-446a-a636-e97592e2e227 tempest-VolumesListAdminTestJSON-266026417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:12:41 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-aaaa7df8-9c44-446a-a636-e97592e2e227 tempest-VolumesListAdminTestJSON-266026417 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:12:41 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-aaaa7df8-9c44-446a-a636-e97592e2e227 tempest-VolumesListAdminTestJSON-266026417 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:12:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-aaaa7df8-9c44-446a-a636-e97592e2e227 tempest-VolumesListAdminTestJSON-266026417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-807edec6-a747-4f07-a4e7-cba743d880f0 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:12:41 devstack sudo[89864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-807edec6-a747-4f07-a4e7-cba743d880f0 1073741824 Nov 04 12:12:41 devstack sudo[89864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:12:41 devstack sudo[89864]: pam_unix(sudo:session): session closed for user root Nov 04 12:12:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-aaaa7df8-9c44-446a-a636-e97592e2e227 tempest-VolumesListAdminTestJSON-266026417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-807edec6-a747-4f07-a4e7-cba743d880f0 1073741824" returned: 0 in 0.571s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:12:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-aaaa7df8-9c44-446a-a636-e97592e2e227 tempest-VolumesListAdminTestJSON-266026417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-807edec6-a747-4f07-a4e7-cba743d880f0 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:12:41 devstack sudo[89870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-807edec6-a747-4f07-a4e7-cba743d880f0 Nov 04 12:12:41 devstack sudo[89870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:12:42 devstack sudo[89870]: pam_unix(sudo:session): session closed for user root Nov 04 12:12:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-aaaa7df8-9c44-446a-a636-e97592e2e227 tempest-VolumesListAdminTestJSON-266026417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-807edec6-a747-4f07-a4e7-cba743d880f0" returned: 0 in 0.385s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:12:42 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-aaaa7df8-9c44-446a-a636-e97592e2e227 tempest-VolumesListAdminTestJSON-266026417 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:12:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-aaaa7df8-9c44-446a-a636-e97592e2e227 tempest-VolumesListAdminTestJSON-266026417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:12:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-aaaa7df8-9c44-446a-a636-e97592e2e227 tempest-VolumesListAdminTestJSON-266026417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f673aa8a-2f91-4877-baaa-d52b02d01c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-807edec6-a747-4f07-a4e7-cba743d880f0', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:12:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-aaaa7df8-9c44-446a-a636-e97592e2e227 tempest-VolumesListAdminTestJSON-266026417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e13bcbf0-93fd-46bd-babc-cae87c0dbe97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:12:42 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-aaaa7df8-9c44-446a-a636-e97592e2e227 tempest-VolumesListAdminTestJSON-266026417 None] Volume volume-807edec6-a747-4f07-a4e7-cba743d880f0 (807edec6-a747-4f07-a4e7-cba743d880f0): created successfully Nov 04 12:12:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-aaaa7df8-9c44-446a-a636-e97592e2e227 tempest-VolumesListAdminTestJSON-266026417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e13bcbf0-93fd-46bd-babc-cae87c0dbe97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:12:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-aaaa7df8-9c44-446a-a636-e97592e2e227 tempest-VolumesListAdminTestJSON-266026417 None] Flow 'volume_create_manager' (c30aa2f0-5d03-4621-98a8-a1deddc2729a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:12:42 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-aaaa7df8-9c44-446a-a636-e97592e2e227 tempest-VolumesListAdminTestJSON-266026417 None] Created volume successfully. Nov 04 12:12:44 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d77aac3-5a6a-4767-b763-fa2253f0f303 tempest-VolumesListAdminTestJSON-1858419923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:12:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0d77aac3-5a6a-4767-b763-fa2253f0f303 tempest-VolumesListAdminTestJSON-1858419923 None] Flow 'volume_create_manager' (9dfb4476-88ea-4975-8404-2b43148fe3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:12:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0d77aac3-5a6a-4767-b763-fa2253f0f303 tempest-VolumesListAdminTestJSON-1858419923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e49daa4e-0fb7-41eb-bf81-a35e064a8c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:12:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0d77aac3-5a6a-4767-b763-fa2253f0f303 tempest-VolumesListAdminTestJSON-1858419923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e49daa4e-0fb7-41eb-bf81-a35e064a8c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:12:44Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e644fba7-eabd-4d1c-b7e6-6e5e71bd8b57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58cf5df6a26e4545a04c0e02d282869b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:12:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:12:44Z,use_quota=True,user_id='0e01401e987347eaa79deccc6371378f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:12:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0d77aac3-5a6a-4767-b763-fa2253f0f303 tempest-VolumesListAdminTestJSON-1858419923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c1de0ed-153e-4d75-9ac2-93f3f83ba753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:12:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0d77aac3-5a6a-4767-b763-fa2253f0f303 tempest-VolumesListAdminTestJSON-1858419923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c1de0ed-153e-4d75-9ac2-93f3f83ba753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:12:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0d77aac3-5a6a-4767-b763-fa2253f0f303 tempest-VolumesListAdminTestJSON-1858419923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84104c4b-b4b5-4567-9c33-11f2d74a2c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:12:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0d77aac3-5a6a-4767-b763-fa2253f0f303 tempest-VolumesListAdminTestJSON-1858419923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84104c4b-b4b5-4567-9c33-11f2d74a2c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e644fba7-eabd-4d1c-b7e6-6e5e71bd8b57', 'volume_name': 'volume-e644fba7-eabd-4d1c-b7e6-6e5e71bd8b57', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:12:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0d77aac3-5a6a-4767-b763-fa2253f0f303 tempest-VolumesListAdminTestJSON-1858419923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58e0caed-09de-43d0-a1d1-54e93ae3bd95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:12:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0d77aac3-5a6a-4767-b763-fa2253f0f303 tempest-VolumesListAdminTestJSON-1858419923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58e0caed-09de-43d0-a1d1-54e93ae3bd95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:12:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0d77aac3-5a6a-4767-b763-fa2253f0f303 tempest-VolumesListAdminTestJSON-1858419923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72312cef-7160-46f6-b181-b1d4df192627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:12:44 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-0d77aac3-5a6a-4767-b763-fa2253f0f303 tempest-VolumesListAdminTestJSON-1858419923 None] Volume e644fba7-eabd-4d1c-b7e6-6e5e71bd8b57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e644fba7-eabd-4d1c-b7e6-6e5e71bd8b57', 'volume_size': 1} Nov 04 12:12:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0d77aac3-5a6a-4767-b763-fa2253f0f303 tempest-VolumesListAdminTestJSON-1858419923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:12:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0d77aac3-5a6a-4767-b763-fa2253f0f303 tempest-VolumesListAdminTestJSON-1858419923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:12:44 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0d77aac3-5a6a-4767-b763-fa2253f0f303 tempest-VolumesListAdminTestJSON-1858419923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:12:44Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e644fba7-eabd-4d1c-b7e6-6e5e71bd8b57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58cf5df6a26e4545a04c0e02d282869b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:12:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:12:44Z,use_quota=True,user_id='0e01401e987347eaa79deccc6371378f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:12:44 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-0d77aac3-5a6a-4767-b763-fa2253f0f303 tempest-VolumesListAdminTestJSON-1858419923 None] Creating volume e644fba7-eabd-4d1c-b7e6-6e5e71bd8b57 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:12:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0d77aac3-5a6a-4767-b763-fa2253f0f303 tempest-VolumesListAdminTestJSON-1858419923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:12:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0d77aac3-5a6a-4767-b763-fa2253f0f303 tempest-VolumesListAdminTestJSON-1858419923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:12:44 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0d77aac3-5a6a-4767-b763-fa2253f0f303 tempest-VolumesListAdminTestJSON-1858419923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:12:44 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0d77aac3-5a6a-4767-b763-fa2253f0f303 tempest-VolumesListAdminTestJSON-1858419923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:12:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0d77aac3-5a6a-4767-b763-fa2253f0f303 tempest-VolumesListAdminTestJSON-1858419923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:12:44 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0d77aac3-5a6a-4767-b763-fa2253f0f303 tempest-VolumesListAdminTestJSON-1858419923 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:12:44 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-0d77aac3-5a6a-4767-b763-fa2253f0f303 tempest-VolumesListAdminTestJSON-1858419923 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:12:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0d77aac3-5a6a-4767-b763-fa2253f0f303 tempest-VolumesListAdminTestJSON-1858419923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-e644fba7-eabd-4d1c-b7e6-6e5e71bd8b57 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:12:44 devstack sudo[89876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-e644fba7-eabd-4d1c-b7e6-6e5e71bd8b57 1073741824 Nov 04 12:12:44 devstack sudo[89876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:12:45 devstack sudo[89876]: pam_unix(sudo:session): session closed for user root Nov 04 12:12:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0d77aac3-5a6a-4767-b763-fa2253f0f303 tempest-VolumesListAdminTestJSON-1858419923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-e644fba7-eabd-4d1c-b7e6-6e5e71bd8b57 1073741824" returned: 0 in 0.642s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:12:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0d77aac3-5a6a-4767-b763-fa2253f0f303 tempest-VolumesListAdminTestJSON-1858419923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-e644fba7-eabd-4d1c-b7e6-6e5e71bd8b57 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:12:45 devstack sudo[89882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-e644fba7-eabd-4d1c-b7e6-6e5e71bd8b57 Nov 04 12:12:45 devstack sudo[89882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:12:45 devstack sudo[89882]: pam_unix(sudo:session): session closed for user root Nov 04 12:12:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0d77aac3-5a6a-4767-b763-fa2253f0f303 tempest-VolumesListAdminTestJSON-1858419923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-e644fba7-eabd-4d1c-b7e6-6e5e71bd8b57" returned: 0 in 0.394s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:12:45 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0d77aac3-5a6a-4767-b763-fa2253f0f303 tempest-VolumesListAdminTestJSON-1858419923 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:12:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0d77aac3-5a6a-4767-b763-fa2253f0f303 tempest-VolumesListAdminTestJSON-1858419923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:12:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0d77aac3-5a6a-4767-b763-fa2253f0f303 tempest-VolumesListAdminTestJSON-1858419923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72312cef-7160-46f6-b181-b1d4df192627) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e644fba7-eabd-4d1c-b7e6-6e5e71bd8b57', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:12:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0d77aac3-5a6a-4767-b763-fa2253f0f303 tempest-VolumesListAdminTestJSON-1858419923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a8b4f7f-9cf5-4029-a533-adc43ae64276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:12:45 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-0d77aac3-5a6a-4767-b763-fa2253f0f303 tempest-VolumesListAdminTestJSON-1858419923 None] Volume volume-e644fba7-eabd-4d1c-b7e6-6e5e71bd8b57 (e644fba7-eabd-4d1c-b7e6-6e5e71bd8b57): created successfully Nov 04 12:12:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0d77aac3-5a6a-4767-b763-fa2253f0f303 tempest-VolumesListAdminTestJSON-1858419923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a8b4f7f-9cf5-4029-a533-adc43ae64276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:12:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0d77aac3-5a6a-4767-b763-fa2253f0f303 tempest-VolumesListAdminTestJSON-1858419923 None] Flow 'volume_create_manager' (9dfb4476-88ea-4975-8404-2b43148fe3fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:12:45 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-0d77aac3-5a6a-4767-b763-fa2253f0f303 tempest-VolumesListAdminTestJSON-1858419923 None] Created volume successfully. Nov 04 12:12:46 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-d53b99ab-8291-4416-b715-27c2e93dfc23 tempest-VolumesListAdminTestJSON-1858419923 None] Acquiring lock "cinder-e644fba7-eabd-4d1c-b7e6-6e5e71bd8b57-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:12:46 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-d53b99ab-8291-4416-b715-27c2e93dfc23 tempest-VolumesListAdminTestJSON-1858419923 None] Lock "cinder-e644fba7-eabd-4d1c-b7e6-6e5e71bd8b57-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:12:46 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-d53b99ab-8291-4416-b715-27c2e93dfc23 tempest-VolumesListAdminTestJSON-1858419923 None] Acquiring lock "cinder-quobyte-e644fba7-eabd-4d1c-b7e6-6e5e71bd8b57" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:12:46 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-d53b99ab-8291-4416-b715-27c2e93dfc23 tempest-VolumesListAdminTestJSON-1858419923 None] Lock "cinder-quobyte-e644fba7-eabd-4d1c-b7e6-6e5e71bd8b57" acquired by "delete_volume" :: waited 0.023s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:12:46 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[669d8418-e854-466d-b925-a49ed816ffeb]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:12:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d53b99ab-8291-4416-b715-27c2e93dfc23 tempest-VolumesListAdminTestJSON-1858419923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-e644fba7-eabd-4d1c-b7e6-6e5e71bd8b57 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:12:46 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-55202fe6-f4f7-480d-94e2-5c2cb4a9bf40 tempest-VolumesListAdminTestJSON-266026417 None] Acquiring lock "cinder-807edec6-a747-4f07-a4e7-cba743d880f0-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:12:46 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-55202fe6-f4f7-480d-94e2-5c2cb4a9bf40 tempest-VolumesListAdminTestJSON-266026417 None] Lock "cinder-807edec6-a747-4f07-a4e7-cba743d880f0-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:12:46 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-55202fe6-f4f7-480d-94e2-5c2cb4a9bf40 tempest-VolumesListAdminTestJSON-266026417 None] Acquiring lock "cinder-quobyte-807edec6-a747-4f07-a4e7-cba743d880f0" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:12:46 devstack sudo[89888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-e644fba7-eabd-4d1c-b7e6-6e5e71bd8b57 Nov 04 12:12:46 devstack sudo[89888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:12:46 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-55202fe6-f4f7-480d-94e2-5c2cb4a9bf40 tempest-VolumesListAdminTestJSON-266026417 None] Lock "cinder-quobyte-807edec6-a747-4f07-a4e7-cba743d880f0" acquired by "delete_volume" :: waited 0.026s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:12:46 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d48678d1-3f98-48e3-89b4-8d40155c96ec]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:12:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-55202fe6-f4f7-480d-94e2-5c2cb4a9bf40 tempest-VolumesListAdminTestJSON-266026417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-807edec6-a747-4f07-a4e7-cba743d880f0 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:12:47 devstack sudo[89892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-807edec6-a747-4f07-a4e7-cba743d880f0 Nov 04 12:12:47 devstack sudo[89892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:12:47 devstack sudo[89888]: pam_unix(sudo:session): session closed for user root Nov 04 12:12:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d53b99ab-8291-4416-b715-27c2e93dfc23 tempest-VolumesListAdminTestJSON-1858419923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-e644fba7-eabd-4d1c-b7e6-6e5e71bd8b57" returned: 0 in 0.740s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:12:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d53b99ab-8291-4416-b715-27c2e93dfc23 tempest-VolumesListAdminTestJSON-1858419923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-e644fba7-eabd-4d1c-b7e6-6e5e71bd8b57 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:12:47 devstack sudo[89914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-e644fba7-eabd-4d1c-b7e6-6e5e71bd8b57 Nov 04 12:12:47 devstack sudo[89914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:12:47 devstack sudo[89892]: pam_unix(sudo:session): session closed for user root Nov 04 12:12:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-55202fe6-f4f7-480d-94e2-5c2cb4a9bf40 tempest-VolumesListAdminTestJSON-266026417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-807edec6-a747-4f07-a4e7-cba743d880f0" returned: 0 in 0.618s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:12:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-55202fe6-f4f7-480d-94e2-5c2cb4a9bf40 tempest-VolumesListAdminTestJSON-266026417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-807edec6-a747-4f07-a4e7-cba743d880f0 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:12:47 devstack sudo[89918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-807edec6-a747-4f07-a4e7-cba743d880f0 Nov 04 12:12:47 devstack sudo[89918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:12:47 devstack sudo[89914]: pam_unix(sudo:session): session closed for user root Nov 04 12:12:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d53b99ab-8291-4416-b715-27c2e93dfc23 tempest-VolumesListAdminTestJSON-1858419923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-e644fba7-eabd-4d1c-b7e6-6e5e71bd8b57" returned: 0 in 0.339s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:12:47 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-d53b99ab-8291-4416-b715-27c2e93dfc23 tempest-VolumesListAdminTestJSON-1858419923 None] Lock "cinder-quobyte-e644fba7-eabd-4d1c-b7e6-6e5e71bd8b57" released by "delete_volume" :: held 1.148s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:12:47 devstack sudo[89918]: pam_unix(sudo:session): session closed for user root Nov 04 12:12:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-55202fe6-f4f7-480d-94e2-5c2cb4a9bf40 tempest-VolumesListAdminTestJSON-266026417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-807edec6-a747-4f07-a4e7-cba743d880f0" returned: 0 in 0.302s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:12:47 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-55202fe6-f4f7-480d-94e2-5c2cb4a9bf40 tempest-VolumesListAdminTestJSON-266026417 None] Lock "cinder-quobyte-807edec6-a747-4f07-a4e7-cba743d880f0" released by "delete_volume" :: held 1.004s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:12:47 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-d53b99ab-8291-4416-b715-27c2e93dfc23 tempest-VolumesListAdminTestJSON-1858419923 None] Created reservations ['8200ebe2-4b47-473b-b0bb-9dff275980cc', '97b6c323-3e53-411b-9c23-4f024f6ecf79', '53c08965-a954-4fef-9d4a-76fb2d6e8588', '290133c6-e2df-49b8-87ff-a367d47edb1d'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:12:48 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-55202fe6-f4f7-480d-94e2-5c2cb4a9bf40 tempest-VolumesListAdminTestJSON-266026417 None] Created reservations ['73c2264e-1adf-4f85-a06b-39157d18c856', '59d25af4-07dc-4eed-9b16-fc0b59baf946', '57d0797b-31e2-4289-a38a-c5d52d8516f3', 'cde53ed0-333c-4d6f-82ac-469eece752d3'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:12:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d53b99ab-8291-4416-b715-27c2e93dfc23 tempest-VolumesListAdminTestJSON-1858419923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:12:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d53b99ab-8291-4416-b715-27c2e93dfc23 tempest-VolumesListAdminTestJSON-1858419923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:12:48 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d53b99ab-8291-4416-b715-27c2e93dfc23 tempest-VolumesListAdminTestJSON-1858419923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:12:48 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d53b99ab-8291-4416-b715-27c2e93dfc23 tempest-VolumesListAdminTestJSON-1858419923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:12:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d53b99ab-8291-4416-b715-27c2e93dfc23 tempest-VolumesListAdminTestJSON-1858419923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:12:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d53b99ab-8291-4416-b715-27c2e93dfc23 tempest-VolumesListAdminTestJSON-1858419923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:12:48 devstack sudo[89922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:12:48 devstack sudo[89922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:12:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-55202fe6-f4f7-480d-94e2-5c2cb4a9bf40 tempest-VolumesListAdminTestJSON-266026417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:12:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-55202fe6-f4f7-480d-94e2-5c2cb4a9bf40 tempest-VolumesListAdminTestJSON-266026417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:12:48 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-55202fe6-f4f7-480d-94e2-5c2cb4a9bf40 tempest-VolumesListAdminTestJSON-266026417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:12:48 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-55202fe6-f4f7-480d-94e2-5c2cb4a9bf40 tempest-VolumesListAdminTestJSON-266026417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:12:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-55202fe6-f4f7-480d-94e2-5c2cb4a9bf40 tempest-VolumesListAdminTestJSON-266026417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:12:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-55202fe6-f4f7-480d-94e2-5c2cb4a9bf40 tempest-VolumesListAdminTestJSON-266026417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:12:48 devstack sudo[89924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:12:48 devstack sudo[89924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:12:48 devstack sudo[89922]: pam_unix(sudo:session): session closed for user root Nov 04 12:12:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d53b99ab-8291-4416-b715-27c2e93dfc23 tempest-VolumesListAdminTestJSON-1858419923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.339s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:12:48 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-d53b99ab-8291-4416-b715-27c2e93dfc23 tempest-VolumesListAdminTestJSON-1858419923 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:12:48 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-d53b99ab-8291-4416-b715-27c2e93dfc23 tempest-VolumesListAdminTestJSON-1858419923 None] Deleted volume successfully. Nov 04 12:12:48 devstack sudo[89924]: pam_unix(sudo:session): session closed for user root Nov 04 12:12:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-55202fe6-f4f7-480d-94e2-5c2cb4a9bf40 tempest-VolumesListAdminTestJSON-266026417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.292s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:12:48 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-55202fe6-f4f7-480d-94e2-5c2cb4a9bf40 tempest-VolumesListAdminTestJSON-266026417 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:12:48 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-55202fe6-f4f7-480d-94e2-5c2cb4a9bf40 tempest-VolumesListAdminTestJSON-266026417 None] Deleted volume successfully. Nov 04 12:12:48 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-d53b99ab-8291-4416-b715-27c2e93dfc23 tempest-VolumesListAdminTestJSON-1858419923 None] Lock "cinder-e644fba7-eabd-4d1c-b7e6-6e5e71bd8b57-delete_volume" released by "delete_volume" :: held 1.944s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:12:48 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-55202fe6-f4f7-480d-94e2-5c2cb4a9bf40 tempest-VolumesListAdminTestJSON-266026417 None] Lock "cinder-807edec6-a747-4f07-a4e7-cba743d880f0-delete_volume" released by "delete_volume" :: held 1.720s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:12:49 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-00fe5bee-c596-490e-a9cd-fa4ab8e4df57 tempest-VolumesListAdminTestJSON-266026417 None] Acquiring lock "cinder-9c349278-f0ba-4433-b278-6fe2b19cb9c0-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:12:49 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-00fe5bee-c596-490e-a9cd-fa4ab8e4df57 tempest-VolumesListAdminTestJSON-266026417 None] Lock "cinder-9c349278-f0ba-4433-b278-6fe2b19cb9c0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:12:49 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-00fe5bee-c596-490e-a9cd-fa4ab8e4df57 tempest-VolumesListAdminTestJSON-266026417 None] Acquiring lock "cinder-quobyte-9c349278-f0ba-4433-b278-6fe2b19cb9c0" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:12:49 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-00fe5bee-c596-490e-a9cd-fa4ab8e4df57 tempest-VolumesListAdminTestJSON-266026417 None] Lock "cinder-quobyte-9c349278-f0ba-4433-b278-6fe2b19cb9c0" acquired by "delete_volume" :: waited 0.023s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:12:49 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b2a117-ea60-492d-bdb1-ddc9006ddff3]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:12:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-00fe5bee-c596-490e-a9cd-fa4ab8e4df57 tempest-VolumesListAdminTestJSON-266026417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9c349278-f0ba-4433-b278-6fe2b19cb9c0 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:12:49 devstack sudo[89928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9c349278-f0ba-4433-b278-6fe2b19cb9c0 Nov 04 12:12:49 devstack sudo[89928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:12:49 devstack sudo[89928]: pam_unix(sudo:session): session closed for user root Nov 04 12:12:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-00fe5bee-c596-490e-a9cd-fa4ab8e4df57 tempest-VolumesListAdminTestJSON-266026417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9c349278-f0ba-4433-b278-6fe2b19cb9c0" returned: 0 in 0.414s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:12:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-00fe5bee-c596-490e-a9cd-fa4ab8e4df57 tempest-VolumesListAdminTestJSON-266026417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9c349278-f0ba-4433-b278-6fe2b19cb9c0 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:12:49 devstack sudo[89933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9c349278-f0ba-4433-b278-6fe2b19cb9c0 Nov 04 12:12:49 devstack sudo[89933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:12:50 devstack sudo[89933]: pam_unix(sudo:session): session closed for user root Nov 04 12:12:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-00fe5bee-c596-490e-a9cd-fa4ab8e4df57 tempest-VolumesListAdminTestJSON-266026417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9c349278-f0ba-4433-b278-6fe2b19cb9c0" returned: 0 in 0.335s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:12:50 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-00fe5bee-c596-490e-a9cd-fa4ab8e4df57 tempest-VolumesListAdminTestJSON-266026417 None] Lock "cinder-quobyte-9c349278-f0ba-4433-b278-6fe2b19cb9c0" released by "delete_volume" :: held 0.819s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:12:50 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-00fe5bee-c596-490e-a9cd-fa4ab8e4df57 tempest-VolumesListAdminTestJSON-266026417 None] Created reservations ['38aa39c3-3c88-415a-91f2-44e7445b0885', 'a651c87c-0a15-4351-80c5-d26d0387a9cf', 'f88162c6-47d2-4e71-91f6-373acd27b765', 'c7521b3f-7aea-4bb5-843e-c846253dd6d4'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:12:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-00fe5bee-c596-490e-a9cd-fa4ab8e4df57 tempest-VolumesListAdminTestJSON-266026417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:12:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-00fe5bee-c596-490e-a9cd-fa4ab8e4df57 tempest-VolumesListAdminTestJSON-266026417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:12:50 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-00fe5bee-c596-490e-a9cd-fa4ab8e4df57 tempest-VolumesListAdminTestJSON-266026417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:12:50 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-00fe5bee-c596-490e-a9cd-fa4ab8e4df57 tempest-VolumesListAdminTestJSON-266026417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:12:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-00fe5bee-c596-490e-a9cd-fa4ab8e4df57 tempest-VolumesListAdminTestJSON-266026417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:12:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-00fe5bee-c596-490e-a9cd-fa4ab8e4df57 tempest-VolumesListAdminTestJSON-266026417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:12:50 devstack sudo[89937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:12:50 devstack sudo[89937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:12:50 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7518e2b8-ddb6-452f-b4cc-34592823fb43 tempest-VolumesListAdminTestJSON-266026417 None] Acquiring lock "cinder-2af269eb-6b3a-4299-9a94-c8bce305e7e3-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:12:50 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7518e2b8-ddb6-452f-b4cc-34592823fb43 tempest-VolumesListAdminTestJSON-266026417 None] Lock "cinder-2af269eb-6b3a-4299-9a94-c8bce305e7e3-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:12:50 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7518e2b8-ddb6-452f-b4cc-34592823fb43 tempest-VolumesListAdminTestJSON-266026417 None] Acquiring lock "cinder-quobyte-2af269eb-6b3a-4299-9a94-c8bce305e7e3" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:12:50 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7518e2b8-ddb6-452f-b4cc-34592823fb43 tempest-VolumesListAdminTestJSON-266026417 None] Lock "cinder-quobyte-2af269eb-6b3a-4299-9a94-c8bce305e7e3" acquired by "delete_volume" :: waited 0.026s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:12:50 devstack sudo[89937]: pam_unix(sudo:session): session closed for user root Nov 04 12:12:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-00fe5bee-c596-490e-a9cd-fa4ab8e4df57 tempest-VolumesListAdminTestJSON-266026417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.398s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:12:50 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-00fe5bee-c596-490e-a9cd-fa4ab8e4df57 tempest-VolumesListAdminTestJSON-266026417 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:12:50 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-00fe5bee-c596-490e-a9cd-fa4ab8e4df57 tempest-VolumesListAdminTestJSON-266026417 None] Deleted volume successfully. Nov 04 12:12:50 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b57383c8-e8ee-46d2-8143-ef0b9b3cdb2d]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:12:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7518e2b8-ddb6-452f-b4cc-34592823fb43 tempest-VolumesListAdminTestJSON-266026417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2af269eb-6b3a-4299-9a94-c8bce305e7e3 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:12:50 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-00fe5bee-c596-490e-a9cd-fa4ab8e4df57 tempest-VolumesListAdminTestJSON-266026417 None] Lock "cinder-9c349278-f0ba-4433-b278-6fe2b19cb9c0-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:12:50 devstack sudo[89940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2af269eb-6b3a-4299-9a94-c8bce305e7e3 Nov 04 12:12:50 devstack sudo[89940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:12:51 devstack sudo[89940]: pam_unix(sudo:session): session closed for user root Nov 04 12:12:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7518e2b8-ddb6-452f-b4cc-34592823fb43 tempest-VolumesListAdminTestJSON-266026417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2af269eb-6b3a-4299-9a94-c8bce305e7e3" returned: 0 in 0.507s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:12:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7518e2b8-ddb6-452f-b4cc-34592823fb43 tempest-VolumesListAdminTestJSON-266026417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2af269eb-6b3a-4299-9a94-c8bce305e7e3 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:12:51 devstack sudo[89945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2af269eb-6b3a-4299-9a94-c8bce305e7e3 Nov 04 12:12:51 devstack sudo[89945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:12:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-6ab06671-6b33-4efc-a445-1017b2c69295 req-6234cf00-42e6-402f-a787-b75b2d665f24 tempest-AttachVolumeShelveTestJSON-176583002 None] No connector for attachment 57429a64-a330-4fb7-bf5a-b61a6c915620; skipping storage backend terminate_connection call. {{(pid=87095) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Nov 04 12:12:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-6ab06671-6b33-4efc-a445-1017b2c69295 req-6234cf00-42e6-402f-a787-b75b2d665f24 tempest-AttachVolumeShelveTestJSON-176583002 None] Deleting attachment 57429a64-a330-4fb7-bf5a-b61a6c915620. {{(pid=87095) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 12:12:51 devstack sudo[89945]: pam_unix(sudo:session): session closed for user root Nov 04 12:12:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7518e2b8-ddb6-452f-b4cc-34592823fb43 tempest-VolumesListAdminTestJSON-266026417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2af269eb-6b3a-4299-9a94-c8bce305e7e3" returned: 0 in 0.331s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:12:51 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7518e2b8-ddb6-452f-b4cc-34592823fb43 tempest-VolumesListAdminTestJSON-266026417 None] Lock "cinder-quobyte-2af269eb-6b3a-4299-9a94-c8bce305e7e3" released by "delete_volume" :: held 0.928s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:12:51 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-7518e2b8-ddb6-452f-b4cc-34592823fb43 tempest-VolumesListAdminTestJSON-266026417 None] Created reservations ['febc7f7e-bc25-47ad-9836-15c01bbe41fe', 'a64f998e-04cc-4d3c-b6cb-c474578767b1', '9000db28-63fe-48eb-b961-c8164628ed4d', '4d486287-466f-44ba-a520-4b4235ade54c'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:12:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7518e2b8-ddb6-452f-b4cc-34592823fb43 tempest-VolumesListAdminTestJSON-266026417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:12:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7518e2b8-ddb6-452f-b4cc-34592823fb43 tempest-VolumesListAdminTestJSON-266026417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:12:51 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7518e2b8-ddb6-452f-b4cc-34592823fb43 tempest-VolumesListAdminTestJSON-266026417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:12:51 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7518e2b8-ddb6-452f-b4cc-34592823fb43 tempest-VolumesListAdminTestJSON-266026417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:12:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7518e2b8-ddb6-452f-b4cc-34592823fb43 tempest-VolumesListAdminTestJSON-266026417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:12:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7518e2b8-ddb6-452f-b4cc-34592823fb43 tempest-VolumesListAdminTestJSON-266026417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:12:51 devstack sudo[89952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:12:51 devstack sudo[89952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:12:52 devstack sudo[89952]: pam_unix(sudo:session): session closed for user root Nov 04 12:12:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7518e2b8-ddb6-452f-b4cc-34592823fb43 tempest-VolumesListAdminTestJSON-266026417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.453s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:12:52 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-7518e2b8-ddb6-452f-b4cc-34592823fb43 tempest-VolumesListAdminTestJSON-266026417 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:12:52 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-7518e2b8-ddb6-452f-b4cc-34592823fb43 tempest-VolumesListAdminTestJSON-266026417 None] Deleted volume successfully. Nov 04 12:12:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7518e2b8-ddb6-452f-b4cc-34592823fb43 tempest-VolumesListAdminTestJSON-266026417 None] Lock "cinder-2af269eb-6b3a-4299-9a94-c8bce305e7e3-delete_volume" released by "delete_volume" :: held 1.732s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:13:01 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:UPDATE=64,cinder:SELECT=41,cinder:INSERT=11,cinder:DELETE=5 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 12:13:01 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 12:13:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:13:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:13:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:13:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:13:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:13:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:13:01 devstack sudo[90053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:13:01 devstack sudo[90053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:13:02 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=35,cinder:UPDATE=52,cinder:INSERT=15,cinder:DELETE=6 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 12:13:02 devstack sudo[90053]: pam_unix(sudo:session): session closed for user root Nov 04 12:13:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.563s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:13:02 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:13:02 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Running periodic task VolumeManager._thread_info {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 12:13:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] thread count: 8 {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 12:13:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] thread info: [<_MainThread(MainThread, started 140610387472512)>, , , , , , , ] {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 12:13:02 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f9700a3-70b7-4ec2-b38e-216b60a9fb05 tempest-SnapshotMetadataTestJSON-1183334657 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:13:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2f9700a3-70b7-4ec2-b38e-216b60a9fb05 tempest-SnapshotMetadataTestJSON-1183334657 None] Flow 'volume_create_manager' (c7f7d6ed-db48-4a0f-adf5-f8bdcd957e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:13:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2f9700a3-70b7-4ec2-b38e-216b60a9fb05 tempest-SnapshotMetadataTestJSON-1183334657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad6c94a9-05d7-4bfe-ba90-641ae38c9f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:13:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2f9700a3-70b7-4ec2-b38e-216b60a9fb05 tempest-SnapshotMetadataTestJSON-1183334657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad6c94a9-05d7-4bfe-ba90-641ae38c9f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:13:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2116507830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fe2d278-3448-41da-a9a1-3b7e9dee5316,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7311785066443fca6b761bd63cc3538',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:13:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:13:03Z,use_quota=True,user_id='58e88c97a8e44b2998ce249ef283fe67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:13:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2f9700a3-70b7-4ec2-b38e-216b60a9fb05 tempest-SnapshotMetadataTestJSON-1183334657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa728200-4c0e-4e73-beef-ea4983370d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:13:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2f9700a3-70b7-4ec2-b38e-216b60a9fb05 tempest-SnapshotMetadataTestJSON-1183334657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa728200-4c0e-4e73-beef-ea4983370d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:13:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2f9700a3-70b7-4ec2-b38e-216b60a9fb05 tempest-SnapshotMetadataTestJSON-1183334657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1b8fb15-4d18-4d64-85c5-5fd28352cc35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:13:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2f9700a3-70b7-4ec2-b38e-216b60a9fb05 tempest-SnapshotMetadataTestJSON-1183334657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1b8fb15-4d18-4d64-85c5-5fd28352cc35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fe2d278-3448-41da-a9a1-3b7e9dee5316', 'volume_name': 'volume-8fe2d278-3448-41da-a9a1-3b7e9dee5316', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:13:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2f9700a3-70b7-4ec2-b38e-216b60a9fb05 tempest-SnapshotMetadataTestJSON-1183334657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e90c2775-6302-440b-8328-4b00d4fbb448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:13:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2f9700a3-70b7-4ec2-b38e-216b60a9fb05 tempest-SnapshotMetadataTestJSON-1183334657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e90c2775-6302-440b-8328-4b00d4fbb448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:13:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2f9700a3-70b7-4ec2-b38e-216b60a9fb05 tempest-SnapshotMetadataTestJSON-1183334657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (899ebfe2-17e6-4973-9e19-bd17aac66d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:13:02 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-2f9700a3-70b7-4ec2-b38e-216b60a9fb05 tempest-SnapshotMetadataTestJSON-1183334657 None] Volume 8fe2d278-3448-41da-a9a1-3b7e9dee5316: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fe2d278-3448-41da-a9a1-3b7e9dee5316', 'volume_size': 1} Nov 04 12:13:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2f9700a3-70b7-4ec2-b38e-216b60a9fb05 tempest-SnapshotMetadataTestJSON-1183334657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:13:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2f9700a3-70b7-4ec2-b38e-216b60a9fb05 tempest-SnapshotMetadataTestJSON-1183334657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:13:02 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2f9700a3-70b7-4ec2-b38e-216b60a9fb05 tempest-SnapshotMetadataTestJSON-1183334657 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:13:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2116507830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fe2d278-3448-41da-a9a1-3b7e9dee5316,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7311785066443fca6b761bd63cc3538',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:13:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:13:03Z,use_quota=True,user_id='58e88c97a8e44b2998ce249ef283fe67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:13:02 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-2f9700a3-70b7-4ec2-b38e-216b60a9fb05 tempest-SnapshotMetadataTestJSON-1183334657 None] Creating volume 8fe2d278-3448-41da-a9a1-3b7e9dee5316 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:13:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2f9700a3-70b7-4ec2-b38e-216b60a9fb05 tempest-SnapshotMetadataTestJSON-1183334657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:13:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2f9700a3-70b7-4ec2-b38e-216b60a9fb05 tempest-SnapshotMetadataTestJSON-1183334657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:13:02 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2f9700a3-70b7-4ec2-b38e-216b60a9fb05 tempest-SnapshotMetadataTestJSON-1183334657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:13:02 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2f9700a3-70b7-4ec2-b38e-216b60a9fb05 tempest-SnapshotMetadataTestJSON-1183334657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:13:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2f9700a3-70b7-4ec2-b38e-216b60a9fb05 tempest-SnapshotMetadataTestJSON-1183334657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:13:02 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2f9700a3-70b7-4ec2-b38e-216b60a9fb05 tempest-SnapshotMetadataTestJSON-1183334657 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:13:02 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-2f9700a3-70b7-4ec2-b38e-216b60a9fb05 tempest-SnapshotMetadataTestJSON-1183334657 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:13:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2f9700a3-70b7-4ec2-b38e-216b60a9fb05 tempest-SnapshotMetadataTestJSON-1183334657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8fe2d278-3448-41da-a9a1-3b7e9dee5316 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:13:02 devstack sudo[90057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8fe2d278-3448-41da-a9a1-3b7e9dee5316 1073741824 Nov 04 12:13:02 devstack sudo[90057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:13:03 devstack sudo[90057]: pam_unix(sudo:session): session closed for user root Nov 04 12:13:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2f9700a3-70b7-4ec2-b38e-216b60a9fb05 tempest-SnapshotMetadataTestJSON-1183334657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8fe2d278-3448-41da-a9a1-3b7e9dee5316 1073741824" returned: 0 in 0.778s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:13:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2f9700a3-70b7-4ec2-b38e-216b60a9fb05 tempest-SnapshotMetadataTestJSON-1183334657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8fe2d278-3448-41da-a9a1-3b7e9dee5316 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:13:03 devstack sudo[90064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8fe2d278-3448-41da-a9a1-3b7e9dee5316 Nov 04 12:13:03 devstack sudo[90064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:13:04 devstack sudo[90064]: pam_unix(sudo:session): session closed for user root Nov 04 12:13:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2f9700a3-70b7-4ec2-b38e-216b60a9fb05 tempest-SnapshotMetadataTestJSON-1183334657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8fe2d278-3448-41da-a9a1-3b7e9dee5316" returned: 0 in 0.405s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:13:04 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2f9700a3-70b7-4ec2-b38e-216b60a9fb05 tempest-SnapshotMetadataTestJSON-1183334657 None] <== create_volume: return (1295ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:13:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2f9700a3-70b7-4ec2-b38e-216b60a9fb05 tempest-SnapshotMetadataTestJSON-1183334657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.298s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:13:04 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2f9700a3-70b7-4ec2-b38e-216b60a9fb05 tempest-SnapshotMetadataTestJSON-1183334657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (899ebfe2-17e6-4973-9e19-bd17aac66d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fe2d278-3448-41da-a9a1-3b7e9dee5316', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:13:04 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2f9700a3-70b7-4ec2-b38e-216b60a9fb05 tempest-SnapshotMetadataTestJSON-1183334657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87b60592-1e39-49b2-9058-822bc3dd3040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:13:04 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-2f9700a3-70b7-4ec2-b38e-216b60a9fb05 tempest-SnapshotMetadataTestJSON-1183334657 None] Volume volume-8fe2d278-3448-41da-a9a1-3b7e9dee5316 (8fe2d278-3448-41da-a9a1-3b7e9dee5316): created successfully Nov 04 12:13:04 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2f9700a3-70b7-4ec2-b38e-216b60a9fb05 tempest-SnapshotMetadataTestJSON-1183334657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87b60592-1e39-49b2-9058-822bc3dd3040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:13:04 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2f9700a3-70b7-4ec2-b38e-216b60a9fb05 tempest-SnapshotMetadataTestJSON-1183334657 None] Flow 'volume_create_manager' (c7f7d6ed-db48-4a0f-adf5-f8bdcd957e2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:13:04 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-2f9700a3-70b7-4ec2-b38e-216b60a9fb05 tempest-SnapshotMetadataTestJSON-1183334657 None] Created volume successfully. Nov 04 12:13:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4e8ad893-fd8e-4d20-a76d-9a2bf321e0dd tempest-SnapshotMetadataTestJSON-1183334657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:13:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4e8ad893-fd8e-4d20-a76d-9a2bf321e0dd tempest-SnapshotMetadataTestJSON-1183334657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:13:05 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-4e8ad893-fd8e-4d20-a76d-9a2bf321e0dd tempest-SnapshotMetadataTestJSON-1183334657 None] Creating offline snapshot ac020615-6c3e-4aae-9860-3867f975d37c of volume 8fe2d278-3448-41da-a9a1-3b7e9dee5316 {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 12:13:05 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c5327d-3fc5-4f90-9aa9-9da8eb820452]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:13:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4e8ad893-fd8e-4d20-a76d-9a2bf321e0dd tempest-SnapshotMetadataTestJSON-1183334657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8fe2d278-3448-41da-a9a1-3b7e9dee5316 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:13:05 devstack sudo[90095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8fe2d278-3448-41da-a9a1-3b7e9dee5316 Nov 04 12:13:05 devstack sudo[90095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:13:06 devstack sudo[90095]: pam_unix(sudo:session): session closed for user root Nov 04 12:13:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4e8ad893-fd8e-4d20-a76d-9a2bf321e0dd tempest-SnapshotMetadataTestJSON-1183334657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8fe2d278-3448-41da-a9a1-3b7e9dee5316" returned: 0 in 0.589s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:13:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4e8ad893-fd8e-4d20-a76d-9a2bf321e0dd tempest-SnapshotMetadataTestJSON-1183334657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8fe2d278-3448-41da-a9a1-3b7e9dee5316,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8fe2d278-3448-41da-a9a1-3b7e9dee5316.ac020615-6c3e-4aae-9860-3867f975d37c 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:13:06 devstack sudo[90110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8fe2d278-3448-41da-a9a1-3b7e9dee5316,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8fe2d278-3448-41da-a9a1-3b7e9dee5316.ac020615-6c3e-4aae-9860-3867f975d37c 1G Nov 04 12:13:06 devstack sudo[90110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:13:07 devstack sudo[90110]: pam_unix(sudo:session): session closed for user root Nov 04 12:13:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4e8ad893-fd8e-4d20-a76d-9a2bf321e0dd tempest-SnapshotMetadataTestJSON-1183334657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8fe2d278-3448-41da-a9a1-3b7e9dee5316,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8fe2d278-3448-41da-a9a1-3b7e9dee5316.ac020615-6c3e-4aae-9860-3867f975d37c 1G" returned: 0 in 0.828s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:13:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4e8ad893-fd8e-4d20-a76d-9a2bf321e0dd tempest-SnapshotMetadataTestJSON-1183334657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fe2d278-3448-41da-a9a1-3b7e9dee5316 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8fe2d278-3448-41da-a9a1-3b7e9dee5316.ac020615-6c3e-4aae-9860-3867f975d37c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:13:07 devstack sudo[90116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fe2d278-3448-41da-a9a1-3b7e9dee5316 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8fe2d278-3448-41da-a9a1-3b7e9dee5316.ac020615-6c3e-4aae-9860-3867f975d37c Nov 04 12:13:07 devstack sudo[90116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:13:07 devstack sudo[90116]: pam_unix(sudo:session): session closed for user root Nov 04 12:13:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4e8ad893-fd8e-4d20-a76d-9a2bf321e0dd tempest-SnapshotMetadataTestJSON-1183334657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fe2d278-3448-41da-a9a1-3b7e9dee5316 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8fe2d278-3448-41da-a9a1-3b7e9dee5316.ac020615-6c3e-4aae-9860-3867f975d37c" returned: 0 in 0.496s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:13:07 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-4e8ad893-fd8e-4d20-a76d-9a2bf321e0dd tempest-SnapshotMetadataTestJSON-1183334657 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8fe2d278-3448-41da-a9a1-3b7e9dee5316.ac020615-6c3e-4aae-9860-3867f975d37c is being set with open permissions: ugo+rw Nov 04 12:13:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4e8ad893-fd8e-4d20-a76d-9a2bf321e0dd tempest-SnapshotMetadataTestJSON-1183334657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8fe2d278-3448-41da-a9a1-3b7e9dee5316.ac020615-6c3e-4aae-9860-3867f975d37c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:13:07 devstack sudo[90124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8fe2d278-3448-41da-a9a1-3b7e9dee5316.ac020615-6c3e-4aae-9860-3867f975d37c Nov 04 12:13:07 devstack sudo[90124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:13:07 devstack sudo[90124]: pam_unix(sudo:session): session closed for user root Nov 04 12:13:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4e8ad893-fd8e-4d20-a76d-9a2bf321e0dd tempest-SnapshotMetadataTestJSON-1183334657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8fe2d278-3448-41da-a9a1-3b7e9dee5316.ac020615-6c3e-4aae-9860-3867f975d37c" returned: 0 in 0.448s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:13:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4e8ad893-fd8e-4d20-a76d-9a2bf321e0dd tempest-SnapshotMetadataTestJSON-1183334657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8fe2d278-3448-41da-a9a1-3b7e9dee5316.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:13:08 devstack sudo[90127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8fe2d278-3448-41da-a9a1-3b7e9dee5316.info Nov 04 12:13:08 devstack sudo[90127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:13:08 devstack sudo[90127]: pam_unix(sudo:session): session closed for user root Nov 04 12:13:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4e8ad893-fd8e-4d20-a76d-9a2bf321e0dd tempest-SnapshotMetadataTestJSON-1183334657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8fe2d278-3448-41da-a9a1-3b7e9dee5316.info" returned: 0 in 0.472s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:13:08 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-4e8ad893-fd8e-4d20-a76d-9a2bf321e0dd tempest-SnapshotMetadataTestJSON-1183334657 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8fe2d278-3448-41da-a9a1-3b7e9dee5316.info is being set with open permissions: ugo+rw Nov 04 12:13:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4e8ad893-fd8e-4d20-a76d-9a2bf321e0dd tempest-SnapshotMetadataTestJSON-1183334657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8fe2d278-3448-41da-a9a1-3b7e9dee5316.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:13:08 devstack sudo[90130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8fe2d278-3448-41da-a9a1-3b7e9dee5316.info Nov 04 12:13:08 devstack sudo[90130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:13:09 devstack sudo[90130]: pam_unix(sudo:session): session closed for user root Nov 04 12:13:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4e8ad893-fd8e-4d20-a76d-9a2bf321e0dd tempest-SnapshotMetadataTestJSON-1183334657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8fe2d278-3448-41da-a9a1-3b7e9dee5316.info" returned: 0 in 0.490s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:13:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4e8ad893-fd8e-4d20-a76d-9a2bf321e0dd tempest-SnapshotMetadataTestJSON-1183334657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.583s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:13:09 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-4e8ad893-fd8e-4d20-a76d-9a2bf321e0dd tempest-SnapshotMetadataTestJSON-1183334657 None] Create snapshot completed successfully Nov 04 12:13:11 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-66cc8840-15af-42ce-b87a-33b65c508af7 tempest-SnapshotMetadataTestJSON-1183334657 None] Acquiring lock "cinder-ac020615-6c3e-4aae-9860-3867f975d37c-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:13:11 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-66cc8840-15af-42ce-b87a-33b65c508af7 tempest-SnapshotMetadataTestJSON-1183334657 None] Lock "cinder-ac020615-6c3e-4aae-9860-3867f975d37c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:13:11 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-66cc8840-15af-42ce-b87a-33b65c508af7 tempest-SnapshotMetadataTestJSON-1183334657 None] Acquiring lock "cinder-quobyte-8fe2d278-3448-41da-a9a1-3b7e9dee5316" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:13:11 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-66cc8840-15af-42ce-b87a-33b65c508af7 tempest-SnapshotMetadataTestJSON-1183334657 None] Lock "cinder-quobyte-8fe2d278-3448-41da-a9a1-3b7e9dee5316" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:13:11 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-66cc8840-15af-42ce-b87a-33b65c508af7 tempest-SnapshotMetadataTestJSON-1183334657 None] Acquiring lock "cinder-quobyte-ac020615-6c3e-4aae-9860-3867f975d37c" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:13:11 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-66cc8840-15af-42ce-b87a-33b65c508af7 tempest-SnapshotMetadataTestJSON-1183334657 None] Lock "cinder-quobyte-ac020615-6c3e-4aae-9860-3867f975d37c" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:13:11 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-66cc8840-15af-42ce-b87a-33b65c508af7 tempest-SnapshotMetadataTestJSON-1183334657 None] Deleting offline snapshot ac020615-6c3e-4aae-9860-3867f975d37c of volume 8fe2d278-3448-41da-a9a1-3b7e9dee5316 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 12:13:11 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-66cc8840-15af-42ce-b87a-33b65c508af7 tempest-SnapshotMetadataTestJSON-1183334657 None] snapshot_file for this snap is: volume-8fe2d278-3448-41da-a9a1-3b7e9dee5316.ac020615-6c3e-4aae-9860-3867f975d37c {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 12:13:11 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c53972-5379-4c77-80a8-6d35d6be102f]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:13:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-66cc8840-15af-42ce-b87a-33b65c508af7 tempest-SnapshotMetadataTestJSON-1183334657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8fe2d278-3448-41da-a9a1-3b7e9dee5316.ac020615-6c3e-4aae-9860-3867f975d37c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:13:11 devstack sudo[90215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8fe2d278-3448-41da-a9a1-3b7e9dee5316.ac020615-6c3e-4aae-9860-3867f975d37c Nov 04 12:13:11 devstack sudo[90215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:13:12 devstack sudo[90215]: pam_unix(sudo:session): session closed for user root Nov 04 12:13:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-66cc8840-15af-42ce-b87a-33b65c508af7 tempest-SnapshotMetadataTestJSON-1183334657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8fe2d278-3448-41da-a9a1-3b7e9dee5316.ac020615-6c3e-4aae-9860-3867f975d37c" returned: 0 in 0.739s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:13:12 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-66cc8840-15af-42ce-b87a-33b65c508af7 tempest-SnapshotMetadataTestJSON-1183334657 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8fe2d278-3448-41da-a9a1-3b7e9dee5316(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 12:13:12 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d76254e-c8e3-46ba-85b4-16032efd6906]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:13:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-66cc8840-15af-42ce-b87a-33b65c508af7 tempest-SnapshotMetadataTestJSON-1183334657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8fe2d278-3448-41da-a9a1-3b7e9dee5316 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:13:12 devstack sudo[90225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8fe2d278-3448-41da-a9a1-3b7e9dee5316 Nov 04 12:13:12 devstack sudo[90225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:13:13 devstack sudo[90225]: pam_unix(sudo:session): session closed for user root Nov 04 12:13:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-66cc8840-15af-42ce-b87a-33b65c508af7 tempest-SnapshotMetadataTestJSON-1183334657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8fe2d278-3448-41da-a9a1-3b7e9dee5316" returned: 0 in 0.761s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:13:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-66cc8840-15af-42ce-b87a-33b65c508af7 tempest-SnapshotMetadataTestJSON-1183334657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8fe2d278-3448-41da-a9a1-3b7e9dee5316.ac020615-6c3e-4aae-9860-3867f975d37c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:13:13 devstack sudo[90230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8fe2d278-3448-41da-a9a1-3b7e9dee5316.ac020615-6c3e-4aae-9860-3867f975d37c Nov 04 12:13:13 devstack sudo[90230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:13:13 devstack sudo[90230]: pam_unix(sudo:session): session closed for user root Nov 04 12:13:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-66cc8840-15af-42ce-b87a-33b65c508af7 tempest-SnapshotMetadataTestJSON-1183334657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8fe2d278-3448-41da-a9a1-3b7e9dee5316.ac020615-6c3e-4aae-9860-3867f975d37c" returned: 0 in 0.404s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:13:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-66cc8840-15af-42ce-b87a-33b65c508af7 tempest-SnapshotMetadataTestJSON-1183334657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8fe2d278-3448-41da-a9a1-3b7e9dee5316.ac020615-6c3e-4aae-9860-3867f975d37c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:13:13 devstack sudo[90235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8fe2d278-3448-41da-a9a1-3b7e9dee5316.ac020615-6c3e-4aae-9860-3867f975d37c Nov 04 12:13:13 devstack sudo[90235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:13:14 devstack sudo[90235]: pam_unix(sudo:session): session closed for user root Nov 04 12:13:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-66cc8840-15af-42ce-b87a-33b65c508af7 tempest-SnapshotMetadataTestJSON-1183334657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8fe2d278-3448-41da-a9a1-3b7e9dee5316.ac020615-6c3e-4aae-9860-3867f975d37c" returned: 0 in 0.376s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:13:14 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-66cc8840-15af-42ce-b87a-33b65c508af7 tempest-SnapshotMetadataTestJSON-1183334657 None] Lock "cinder-quobyte-ac020615-6c3e-4aae-9860-3867f975d37c" released by "_delete_snapshot" :: held 2.479s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:13:14 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-66cc8840-15af-42ce-b87a-33b65c508af7 tempest-SnapshotMetadataTestJSON-1183334657 None] Lock "cinder-quobyte-8fe2d278-3448-41da-a9a1-3b7e9dee5316" released by "delete_snapshot" :: held 2.523s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:13:14 devstack cinder-volume[87095]: WARNING cinder.quota [None req-66cc8840-15af-42ce-b87a-33b65c508af7 tempest-SnapshotMetadataTestJSON-1183334657 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 04 12:13:14 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-66cc8840-15af-42ce-b87a-33b65c508af7 tempest-SnapshotMetadataTestJSON-1183334657 None] Created reservations ['b01226da-52e6-45bf-8512-2a1ca0f7642c', '279651bd-4d56-4779-9b97-f1f998db172d', 'eea7a77b-2c06-40ab-85f9-98080e04df94', 'e63d929a-2654-4c0d-8148-3345302ba2b6'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:13:14 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-66cc8840-15af-42ce-b87a-33b65c508af7 tempest-SnapshotMetadataTestJSON-1183334657 None] Delete snapshot completed successfully. Nov 04 12:13:14 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-66cc8840-15af-42ce-b87a-33b65c508af7 tempest-SnapshotMetadataTestJSON-1183334657 None] Lock "cinder-ac020615-6c3e-4aae-9860-3867f975d37c-delete_snapshot" released by "delete_snapshot" :: held 2.931s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:13:15 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-65900cd1-cb9e-4d11-a144-ffcfaa4fb06d tempest-SnapshotMetadataTestJSON-1183334657 None] Acquiring lock "cinder-8fe2d278-3448-41da-a9a1-3b7e9dee5316-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:13:15 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-65900cd1-cb9e-4d11-a144-ffcfaa4fb06d tempest-SnapshotMetadataTestJSON-1183334657 None] Lock "cinder-8fe2d278-3448-41da-a9a1-3b7e9dee5316-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:13:15 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-65900cd1-cb9e-4d11-a144-ffcfaa4fb06d tempest-SnapshotMetadataTestJSON-1183334657 None] Acquiring lock "cinder-quobyte-8fe2d278-3448-41da-a9a1-3b7e9dee5316" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:13:15 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-65900cd1-cb9e-4d11-a144-ffcfaa4fb06d tempest-SnapshotMetadataTestJSON-1183334657 None] Lock "cinder-quobyte-8fe2d278-3448-41da-a9a1-3b7e9dee5316" acquired by "delete_volume" :: waited 0.037s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:13:15 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[76406c9d-f91c-4a91-a6b0-e520f1fb1d20]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:13:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-65900cd1-cb9e-4d11-a144-ffcfaa4fb06d tempest-SnapshotMetadataTestJSON-1183334657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8fe2d278-3448-41da-a9a1-3b7e9dee5316 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:13:15 devstack sudo[90278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8fe2d278-3448-41da-a9a1-3b7e9dee5316 Nov 04 12:13:15 devstack sudo[90278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:13:15 devstack sudo[90278]: pam_unix(sudo:session): session closed for user root Nov 04 12:13:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-65900cd1-cb9e-4d11-a144-ffcfaa4fb06d tempest-SnapshotMetadataTestJSON-1183334657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8fe2d278-3448-41da-a9a1-3b7e9dee5316" returned: 0 in 0.448s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:13:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-65900cd1-cb9e-4d11-a144-ffcfaa4fb06d tempest-SnapshotMetadataTestJSON-1183334657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8fe2d278-3448-41da-a9a1-3b7e9dee5316 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:13:15 devstack sudo[90283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8fe2d278-3448-41da-a9a1-3b7e9dee5316 Nov 04 12:13:15 devstack sudo[90283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:13:16 devstack sudo[90283]: pam_unix(sudo:session): session closed for user root Nov 04 12:13:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-65900cd1-cb9e-4d11-a144-ffcfaa4fb06d tempest-SnapshotMetadataTestJSON-1183334657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8fe2d278-3448-41da-a9a1-3b7e9dee5316" returned: 0 in 0.292s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:13:16 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-65900cd1-cb9e-4d11-a144-ffcfaa4fb06d tempest-SnapshotMetadataTestJSON-1183334657 None] Lock "cinder-quobyte-8fe2d278-3448-41da-a9a1-3b7e9dee5316" released by "delete_volume" :: held 0.841s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:13:16 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-65900cd1-cb9e-4d11-a144-ffcfaa4fb06d tempest-SnapshotMetadataTestJSON-1183334657 None] Created reservations ['ac4a60ef-4546-4b78-b078-ad76d3621081', '1b8e6932-ab55-4ca7-b49f-b2d160b83ee2', 'f52d40cd-3169-408f-8ec0-fd03c73da249', '8b4879ee-66ed-4380-b61e-d4947d6ba1a1'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:13:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-65900cd1-cb9e-4d11-a144-ffcfaa4fb06d tempest-SnapshotMetadataTestJSON-1183334657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:13:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-65900cd1-cb9e-4d11-a144-ffcfaa4fb06d tempest-SnapshotMetadataTestJSON-1183334657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:13:16 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-65900cd1-cb9e-4d11-a144-ffcfaa4fb06d tempest-SnapshotMetadataTestJSON-1183334657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:13:16 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-65900cd1-cb9e-4d11-a144-ffcfaa4fb06d tempest-SnapshotMetadataTestJSON-1183334657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:13:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-65900cd1-cb9e-4d11-a144-ffcfaa4fb06d tempest-SnapshotMetadataTestJSON-1183334657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:13:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-65900cd1-cb9e-4d11-a144-ffcfaa4fb06d tempest-SnapshotMetadataTestJSON-1183334657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:13:16 devstack sudo[90286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:13:16 devstack sudo[90286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:13:16 devstack sudo[90286]: pam_unix(sudo:session): session closed for user root Nov 04 12:13:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-65900cd1-cb9e-4d11-a144-ffcfaa4fb06d tempest-SnapshotMetadataTestJSON-1183334657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.302s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:13:16 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-65900cd1-cb9e-4d11-a144-ffcfaa4fb06d tempest-SnapshotMetadataTestJSON-1183334657 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:13:16 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-65900cd1-cb9e-4d11-a144-ffcfaa4fb06d tempest-SnapshotMetadataTestJSON-1183334657 None] Deleted volume successfully. Nov 04 12:13:16 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-65900cd1-cb9e-4d11-a144-ffcfaa4fb06d tempest-SnapshotMetadataTestJSON-1183334657 None] Lock "cinder-8fe2d278-3448-41da-a9a1-3b7e9dee5316-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:13:24 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-2da07d4f-c4c9-409e-83bd-0c9b78ccb55e tempest-VolumesTransfersTest-592285369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:13:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2da07d4f-c4c9-409e-83bd-0c9b78ccb55e tempest-VolumesTransfersTest-592285369 None] Flow 'volume_create_manager' (048d7408-9c11-4295-a87a-84e10ee11b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:13:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2da07d4f-c4c9-409e-83bd-0c9b78ccb55e tempest-VolumesTransfersTest-592285369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acb257ae-a2ac-4bb6-a544-c3b2db512f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:13:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2da07d4f-c4c9-409e-83bd-0c9b78ccb55e tempest-VolumesTransfersTest-592285369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acb257ae-a2ac-4bb6-a544-c3b2db512f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:13:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1400261966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d31f2a48-58aa-4e12-b4c5-791897b05006,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03cb59ea296e40c7af9ea47b8a6ecf52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:13:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:13:25Z,use_quota=True,user_id='c7aa6e2444774b3fb3503b67f7a4ddc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:13:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2da07d4f-c4c9-409e-83bd-0c9b78ccb55e tempest-VolumesTransfersTest-592285369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6775ee0e-88e4-4b23-bae8-1a5349c463e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:13:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2da07d4f-c4c9-409e-83bd-0c9b78ccb55e tempest-VolumesTransfersTest-592285369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6775ee0e-88e4-4b23-bae8-1a5349c463e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:13:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2da07d4f-c4c9-409e-83bd-0c9b78ccb55e tempest-VolumesTransfersTest-592285369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d0add52-8b40-4b4c-97c9-8ce8b8a988bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:13:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2da07d4f-c4c9-409e-83bd-0c9b78ccb55e tempest-VolumesTransfersTest-592285369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d0add52-8b40-4b4c-97c9-8ce8b8a988bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd31f2a48-58aa-4e12-b4c5-791897b05006', 'volume_name': 'volume-d31f2a48-58aa-4e12-b4c5-791897b05006', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:13:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2da07d4f-c4c9-409e-83bd-0c9b78ccb55e tempest-VolumesTransfersTest-592285369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (138a50d8-9956-4a3f-a89b-e7f97eb8542a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:13:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2da07d4f-c4c9-409e-83bd-0c9b78ccb55e tempest-VolumesTransfersTest-592285369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (138a50d8-9956-4a3f-a89b-e7f97eb8542a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:13:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2da07d4f-c4c9-409e-83bd-0c9b78ccb55e tempest-VolumesTransfersTest-592285369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34619b7b-ffed-4338-91a7-89ec56adc6d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:13:24 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-2da07d4f-c4c9-409e-83bd-0c9b78ccb55e tempest-VolumesTransfersTest-592285369 None] Volume d31f2a48-58aa-4e12-b4c5-791897b05006: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d31f2a48-58aa-4e12-b4c5-791897b05006', 'volume_size': 1} Nov 04 12:13:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2da07d4f-c4c9-409e-83bd-0c9b78ccb55e tempest-VolumesTransfersTest-592285369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:13:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2da07d4f-c4c9-409e-83bd-0c9b78ccb55e tempest-VolumesTransfersTest-592285369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:13:24 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2da07d4f-c4c9-409e-83bd-0c9b78ccb55e tempest-VolumesTransfersTest-592285369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:13:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1400261966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d31f2a48-58aa-4e12-b4c5-791897b05006,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03cb59ea296e40c7af9ea47b8a6ecf52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:13:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:13:25Z,use_quota=True,user_id='c7aa6e2444774b3fb3503b67f7a4ddc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:13:24 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-2da07d4f-c4c9-409e-83bd-0c9b78ccb55e tempest-VolumesTransfersTest-592285369 None] Creating volume d31f2a48-58aa-4e12-b4c5-791897b05006 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:13:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2da07d4f-c4c9-409e-83bd-0c9b78ccb55e tempest-VolumesTransfersTest-592285369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:13:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2da07d4f-c4c9-409e-83bd-0c9b78ccb55e tempest-VolumesTransfersTest-592285369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:13:24 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2da07d4f-c4c9-409e-83bd-0c9b78ccb55e tempest-VolumesTransfersTest-592285369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:13:24 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2da07d4f-c4c9-409e-83bd-0c9b78ccb55e tempest-VolumesTransfersTest-592285369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:13:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2da07d4f-c4c9-409e-83bd-0c9b78ccb55e tempest-VolumesTransfersTest-592285369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:13:24 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2da07d4f-c4c9-409e-83bd-0c9b78ccb55e tempest-VolumesTransfersTest-592285369 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:13:24 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-2da07d4f-c4c9-409e-83bd-0c9b78ccb55e tempest-VolumesTransfersTest-592285369 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:13:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2da07d4f-c4c9-409e-83bd-0c9b78ccb55e tempest-VolumesTransfersTest-592285369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d31f2a48-58aa-4e12-b4c5-791897b05006 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:13:24 devstack sudo[90385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d31f2a48-58aa-4e12-b4c5-791897b05006 1073741824 Nov 04 12:13:24 devstack sudo[90385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:13:25 devstack sudo[90385]: pam_unix(sudo:session): session closed for user root Nov 04 12:13:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2da07d4f-c4c9-409e-83bd-0c9b78ccb55e tempest-VolumesTransfersTest-592285369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d31f2a48-58aa-4e12-b4c5-791897b05006 1073741824" returned: 0 in 0.898s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:13:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2da07d4f-c4c9-409e-83bd-0c9b78ccb55e tempest-VolumesTransfersTest-592285369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d31f2a48-58aa-4e12-b4c5-791897b05006 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:13:25 devstack sudo[90394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d31f2a48-58aa-4e12-b4c5-791897b05006 Nov 04 12:13:25 devstack sudo[90394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:13:26 devstack sudo[90394]: pam_unix(sudo:session): session closed for user root Nov 04 12:13:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2da07d4f-c4c9-409e-83bd-0c9b78ccb55e tempest-VolumesTransfersTest-592285369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d31f2a48-58aa-4e12-b4c5-791897b05006" returned: 0 in 0.419s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:13:26 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2da07d4f-c4c9-409e-83bd-0c9b78ccb55e tempest-VolumesTransfersTest-592285369 None] <== create_volume: return (1414ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:13:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2da07d4f-c4c9-409e-83bd-0c9b78ccb55e tempest-VolumesTransfersTest-592285369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.416s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:13:26 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2da07d4f-c4c9-409e-83bd-0c9b78ccb55e tempest-VolumesTransfersTest-592285369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34619b7b-ffed-4338-91a7-89ec56adc6d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d31f2a48-58aa-4e12-b4c5-791897b05006', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:13:26 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2da07d4f-c4c9-409e-83bd-0c9b78ccb55e tempest-VolumesTransfersTest-592285369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afd82f1b-cd4b-426d-9f95-7101c847ac5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:13:26 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-2da07d4f-c4c9-409e-83bd-0c9b78ccb55e tempest-VolumesTransfersTest-592285369 None] Volume volume-d31f2a48-58aa-4e12-b4c5-791897b05006 (d31f2a48-58aa-4e12-b4c5-791897b05006): created successfully Nov 04 12:13:26 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2da07d4f-c4c9-409e-83bd-0c9b78ccb55e tempest-VolumesTransfersTest-592285369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afd82f1b-cd4b-426d-9f95-7101c847ac5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:13:26 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2da07d4f-c4c9-409e-83bd-0c9b78ccb55e tempest-VolumesTransfersTest-592285369 None] Flow 'volume_create_manager' (048d7408-9c11-4295-a87a-84e10ee11b5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:13:26 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-2da07d4f-c4c9-409e-83bd-0c9b78ccb55e tempest-VolumesTransfersTest-592285369 None] Created volume successfully. Nov 04 12:13:26 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-cad26147-99b0-4705-857d-25b9a75323ed tempest-ServerActionsTestOtherA-1526177158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:13:26 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cad26147-99b0-4705-857d-25b9a75323ed tempest-ServerActionsTestOtherA-1526177158 None] Flow 'volume_create_manager' (082f0cfa-e5ff-4778-ac7e-2337857e3055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:13:26 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cad26147-99b0-4705-857d-25b9a75323ed tempest-ServerActionsTestOtherA-1526177158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79fa5d37-5c2a-4997-a314-8b3a4f718b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:13:26 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cad26147-99b0-4705-857d-25b9a75323ed tempest-ServerActionsTestOtherA-1526177158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79fa5d37-5c2a-4997-a314-8b3a4f718b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:13:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1410297656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e3403eb-f6e0-483a-9467-55820ca11ec9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91f7feb2ed564a598d1806a492a31193',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:13:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:13:27Z,use_quota=True,user_id='1de4ad7c8f3848f3b97b917a5f9d3c0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:13:26 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cad26147-99b0-4705-857d-25b9a75323ed tempest-ServerActionsTestOtherA-1526177158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2a183ee-0f30-43c8-aaf1-a6d0ea31b839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:13:26 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cad26147-99b0-4705-857d-25b9a75323ed tempest-ServerActionsTestOtherA-1526177158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2a183ee-0f30-43c8-aaf1-a6d0ea31b839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:13:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cad26147-99b0-4705-857d-25b9a75323ed tempest-ServerActionsTestOtherA-1526177158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cd24b4b-96ff-4fed-bc20-d3098694c467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:13:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cad26147-99b0-4705-857d-25b9a75323ed tempest-ServerActionsTestOtherA-1526177158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cd24b4b-96ff-4fed-bc20-d3098694c467) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e3403eb-f6e0-483a-9467-55820ca11ec9', 'volume_name': 'volume-6e3403eb-f6e0-483a-9467-55820ca11ec9', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:13:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cad26147-99b0-4705-857d-25b9a75323ed tempest-ServerActionsTestOtherA-1526177158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce9c00a8-c380-40fb-bb9e-9102197f2d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:13:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cad26147-99b0-4705-857d-25b9a75323ed tempest-ServerActionsTestOtherA-1526177158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce9c00a8-c380-40fb-bb9e-9102197f2d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:13:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cad26147-99b0-4705-857d-25b9a75323ed tempest-ServerActionsTestOtherA-1526177158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (115f82cc-1336-4e79-ae17-9b93ddb66faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:13:27 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-cad26147-99b0-4705-857d-25b9a75323ed tempest-ServerActionsTestOtherA-1526177158 None] Volume 6e3403eb-f6e0-483a-9467-55820ca11ec9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e3403eb-f6e0-483a-9467-55820ca11ec9', 'volume_size': 1} Nov 04 12:13:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cad26147-99b0-4705-857d-25b9a75323ed tempest-ServerActionsTestOtherA-1526177158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:13:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cad26147-99b0-4705-857d-25b9a75323ed tempest-ServerActionsTestOtherA-1526177158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:13:27 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-cad26147-99b0-4705-857d-25b9a75323ed tempest-ServerActionsTestOtherA-1526177158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:13:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1410297656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e3403eb-f6e0-483a-9467-55820ca11ec9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91f7feb2ed564a598d1806a492a31193',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:13:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:13:27Z,use_quota=True,user_id='1de4ad7c8f3848f3b97b917a5f9d3c0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:13:27 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-cad26147-99b0-4705-857d-25b9a75323ed tempest-ServerActionsTestOtherA-1526177158 None] Creating volume 6e3403eb-f6e0-483a-9467-55820ca11ec9 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:13:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cad26147-99b0-4705-857d-25b9a75323ed tempest-ServerActionsTestOtherA-1526177158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:13:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cad26147-99b0-4705-857d-25b9a75323ed tempest-ServerActionsTestOtherA-1526177158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:13:27 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-cad26147-99b0-4705-857d-25b9a75323ed tempest-ServerActionsTestOtherA-1526177158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:13:27 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-cad26147-99b0-4705-857d-25b9a75323ed tempest-ServerActionsTestOtherA-1526177158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:13:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cad26147-99b0-4705-857d-25b9a75323ed tempest-ServerActionsTestOtherA-1526177158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:13:27 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-cad26147-99b0-4705-857d-25b9a75323ed tempest-ServerActionsTestOtherA-1526177158 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:13:27 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-cad26147-99b0-4705-857d-25b9a75323ed tempest-ServerActionsTestOtherA-1526177158 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:13:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cad26147-99b0-4705-857d-25b9a75323ed tempest-ServerActionsTestOtherA-1526177158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6e3403eb-f6e0-483a-9467-55820ca11ec9 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:13:27 devstack sudo[90416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6e3403eb-f6e0-483a-9467-55820ca11ec9 1073741824 Nov 04 12:13:27 devstack sudo[90416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:13:28 devstack sudo[90416]: pam_unix(sudo:session): session closed for user root Nov 04 12:13:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cad26147-99b0-4705-857d-25b9a75323ed tempest-ServerActionsTestOtherA-1526177158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6e3403eb-f6e0-483a-9467-55820ca11ec9 1073741824" returned: 0 in 1.531s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:13:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cad26147-99b0-4705-857d-25b9a75323ed tempest-ServerActionsTestOtherA-1526177158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6e3403eb-f6e0-483a-9467-55820ca11ec9 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:13:28 devstack sudo[90432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6e3403eb-f6e0-483a-9467-55820ca11ec9 Nov 04 12:13:28 devstack sudo[90432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:13:29 devstack sudo[90432]: pam_unix(sudo:session): session closed for user root Nov 04 12:13:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cad26147-99b0-4705-857d-25b9a75323ed tempest-ServerActionsTestOtherA-1526177158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6e3403eb-f6e0-483a-9467-55820ca11ec9" returned: 0 in 0.568s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:13:29 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-cad26147-99b0-4705-857d-25b9a75323ed tempest-ServerActionsTestOtherA-1526177158 None] <== create_volume: return (2256ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:13:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cad26147-99b0-4705-857d-25b9a75323ed tempest-ServerActionsTestOtherA-1526177158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.268s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:13:29 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cad26147-99b0-4705-857d-25b9a75323ed tempest-ServerActionsTestOtherA-1526177158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (115f82cc-1336-4e79-ae17-9b93ddb66faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e3403eb-f6e0-483a-9467-55820ca11ec9', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:13:29 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cad26147-99b0-4705-857d-25b9a75323ed tempest-ServerActionsTestOtherA-1526177158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99b2b031-9bb2-48d7-8f44-e6eab11ade45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:13:29 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-41d2543e-1003-4e28-b73b-d1e885070d51 tempest-DeleteServersTestJSON-1960685474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:13:29 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-41d2543e-1003-4e28-b73b-d1e885070d51 tempest-DeleteServersTestJSON-1960685474 None] Flow 'volume_create_manager' (32f2a051-0135-45c5-8ea7-bc9db2cbee79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:13:29 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-41d2543e-1003-4e28-b73b-d1e885070d51 tempest-DeleteServersTestJSON-1960685474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (684def5c-ef51-4dbf-897f-294efa28b55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:13:29 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-cad26147-99b0-4705-857d-25b9a75323ed tempest-ServerActionsTestOtherA-1526177158 None] Volume volume-6e3403eb-f6e0-483a-9467-55820ca11ec9 (6e3403eb-f6e0-483a-9467-55820ca11ec9): created successfully Nov 04 12:13:29 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cad26147-99b0-4705-857d-25b9a75323ed tempest-ServerActionsTestOtherA-1526177158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99b2b031-9bb2-48d7-8f44-e6eab11ade45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:13:29 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cad26147-99b0-4705-857d-25b9a75323ed tempest-ServerActionsTestOtherA-1526177158 None] Flow 'volume_create_manager' (082f0cfa-e5ff-4778-ac7e-2337857e3055) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:13:29 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-41d2543e-1003-4e28-b73b-d1e885070d51 tempest-DeleteServersTestJSON-1960685474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (684def5c-ef51-4dbf-897f-294efa28b55d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:13:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1478297218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53e644d2-d992-4e26-a139-cbc0cc26a187,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74856d9fbc684a969e256cc9e71b69f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:13:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:13:29Z,use_quota=True,user_id='31e920676a0b45259213f396e9026468',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:13:29 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-41d2543e-1003-4e28-b73b-d1e885070d51 tempest-DeleteServersTestJSON-1960685474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d143d193-81c9-43d0-a74b-8b444a5ad239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:13:29 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-41d2543e-1003-4e28-b73b-d1e885070d51 tempest-DeleteServersTestJSON-1960685474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d143d193-81c9-43d0-a74b-8b444a5ad239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:13:29 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-41d2543e-1003-4e28-b73b-d1e885070d51 tempest-DeleteServersTestJSON-1960685474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b93c8d2e-1f9a-4f74-854f-c37c83789367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:13:29 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-41d2543e-1003-4e28-b73b-d1e885070d51 tempest-DeleteServersTestJSON-1960685474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b93c8d2e-1f9a-4f74-854f-c37c83789367) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53e644d2-d992-4e26-a139-cbc0cc26a187', 'volume_name': 'volume-53e644d2-d992-4e26-a139-cbc0cc26a187', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:13:29 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-41d2543e-1003-4e28-b73b-d1e885070d51 tempest-DeleteServersTestJSON-1960685474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1f8cee1-4b52-460f-9122-7254606c63fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:13:29 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-41d2543e-1003-4e28-b73b-d1e885070d51 tempest-DeleteServersTestJSON-1960685474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1f8cee1-4b52-460f-9122-7254606c63fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:13:29 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-41d2543e-1003-4e28-b73b-d1e885070d51 tempest-DeleteServersTestJSON-1960685474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e430aea-247c-4fa2-938e-465224a531aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:13:29 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-41d2543e-1003-4e28-b73b-d1e885070d51 tempest-DeleteServersTestJSON-1960685474 None] Volume 53e644d2-d992-4e26-a139-cbc0cc26a187: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53e644d2-d992-4e26-a139-cbc0cc26a187', 'volume_size': 1} Nov 04 12:13:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-41d2543e-1003-4e28-b73b-d1e885070d51 tempest-DeleteServersTestJSON-1960685474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:13:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-41d2543e-1003-4e28-b73b-d1e885070d51 tempest-DeleteServersTestJSON-1960685474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:13:29 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-41d2543e-1003-4e28-b73b-d1e885070d51 tempest-DeleteServersTestJSON-1960685474 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:13:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1478297218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53e644d2-d992-4e26-a139-cbc0cc26a187,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74856d9fbc684a969e256cc9e71b69f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:13:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:13:29Z,use_quota=True,user_id='31e920676a0b45259213f396e9026468',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:13:29 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-41d2543e-1003-4e28-b73b-d1e885070d51 tempest-DeleteServersTestJSON-1960685474 None] Creating volume 53e644d2-d992-4e26-a139-cbc0cc26a187 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:13:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-41d2543e-1003-4e28-b73b-d1e885070d51 tempest-DeleteServersTestJSON-1960685474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:13:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-41d2543e-1003-4e28-b73b-d1e885070d51 tempest-DeleteServersTestJSON-1960685474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:13:29 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-41d2543e-1003-4e28-b73b-d1e885070d51 tempest-DeleteServersTestJSON-1960685474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:13:29 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-41d2543e-1003-4e28-b73b-d1e885070d51 tempest-DeleteServersTestJSON-1960685474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:13:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-41d2543e-1003-4e28-b73b-d1e885070d51 tempest-DeleteServersTestJSON-1960685474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:13:29 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-41d2543e-1003-4e28-b73b-d1e885070d51 tempest-DeleteServersTestJSON-1960685474 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:13:29 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-41d2543e-1003-4e28-b73b-d1e885070d51 tempest-DeleteServersTestJSON-1960685474 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:13:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-41d2543e-1003-4e28-b73b-d1e885070d51 tempest-DeleteServersTestJSON-1960685474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-53e644d2-d992-4e26-a139-cbc0cc26a187 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:13:29 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-cad26147-99b0-4705-857d-25b9a75323ed tempest-ServerActionsTestOtherA-1526177158 None] Created volume successfully. Nov 04 12:13:29 devstack sudo[90435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-53e644d2-d992-4e26-a139-cbc0cc26a187 1073741824 Nov 04 12:13:29 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-5cf1bcc7-98b8-4350-b146-1dae2e80e5d2 tempest-VolumesTransfersTest-661763129 None] Transfer volume completed successfully. Nov 04 12:13:29 devstack sudo[90435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:13:30 devstack sudo[90435]: pam_unix(sudo:session): session closed for user root Nov 04 12:13:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-41d2543e-1003-4e28-b73b-d1e885070d51 tempest-DeleteServersTestJSON-1960685474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-53e644d2-d992-4e26-a139-cbc0cc26a187 1073741824" returned: 0 in 0.874s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:13:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-41d2543e-1003-4e28-b73b-d1e885070d51 tempest-DeleteServersTestJSON-1960685474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-53e644d2-d992-4e26-a139-cbc0cc26a187 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:13:30 devstack sudo[90442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-53e644d2-d992-4e26-a139-cbc0cc26a187 Nov 04 12:13:30 devstack sudo[90442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:13:30 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9a6e98c9-b2db-443f-abe6-ec89c188fcf2 tempest-VolumesTransfersTest-1558781982 None] Acquiring lock "cinder-d31f2a48-58aa-4e12-b4c5-791897b05006-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:13:30 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9a6e98c9-b2db-443f-abe6-ec89c188fcf2 tempest-VolumesTransfersTest-1558781982 None] Lock "cinder-d31f2a48-58aa-4e12-b4c5-791897b05006-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:13:30 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9a6e98c9-b2db-443f-abe6-ec89c188fcf2 tempest-VolumesTransfersTest-1558781982 None] Acquiring lock "cinder-quobyte-d31f2a48-58aa-4e12-b4c5-791897b05006" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:13:30 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9a6e98c9-b2db-443f-abe6-ec89c188fcf2 tempest-VolumesTransfersTest-1558781982 None] Lock "cinder-quobyte-d31f2a48-58aa-4e12-b4c5-791897b05006" acquired by "delete_volume" :: waited 0.020s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:13:31 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b8bff8e-168c-4234-8de8-f2d2ff8d0d9d]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:13:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9a6e98c9-b2db-443f-abe6-ec89c188fcf2 tempest-VolumesTransfersTest-1558781982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d31f2a48-58aa-4e12-b4c5-791897b05006 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:13:31 devstack sudo[90442]: pam_unix(sudo:session): session closed for user root Nov 04 12:13:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-41d2543e-1003-4e28-b73b-d1e885070d51 tempest-DeleteServersTestJSON-1960685474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-53e644d2-d992-4e26-a139-cbc0cc26a187" returned: 0 in 0.381s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:13:31 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-41d2543e-1003-4e28-b73b-d1e885070d51 tempest-DeleteServersTestJSON-1960685474 None] <== create_volume: return (1321ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:13:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-41d2543e-1003-4e28-b73b-d1e885070d51 tempest-DeleteServersTestJSON-1960685474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.325s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:13:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-41d2543e-1003-4e28-b73b-d1e885070d51 tempest-DeleteServersTestJSON-1960685474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e430aea-247c-4fa2-938e-465224a531aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53e644d2-d992-4e26-a139-cbc0cc26a187', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:13:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-41d2543e-1003-4e28-b73b-d1e885070d51 tempest-DeleteServersTestJSON-1960685474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c294755-f91e-4b80-9b88-7c0612ad9417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:13:31 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-41d2543e-1003-4e28-b73b-d1e885070d51 tempest-DeleteServersTestJSON-1960685474 None] Volume volume-53e644d2-d992-4e26-a139-cbc0cc26a187 (53e644d2-d992-4e26-a139-cbc0cc26a187): created successfully Nov 04 12:13:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-41d2543e-1003-4e28-b73b-d1e885070d51 tempest-DeleteServersTestJSON-1960685474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c294755-f91e-4b80-9b88-7c0612ad9417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:13:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-41d2543e-1003-4e28-b73b-d1e885070d51 tempest-DeleteServersTestJSON-1960685474 None] Flow 'volume_create_manager' (32f2a051-0135-45c5-8ea7-bc9db2cbee79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:13:31 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-41d2543e-1003-4e28-b73b-d1e885070d51 tempest-DeleteServersTestJSON-1960685474 None] Created volume successfully. Nov 04 12:13:31 devstack sudo[90445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d31f2a48-58aa-4e12-b4c5-791897b05006 Nov 04 12:13:31 devstack sudo[90445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:13:31 devstack sudo[90445]: pam_unix(sudo:session): session closed for user root Nov 04 12:13:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9a6e98c9-b2db-443f-abe6-ec89c188fcf2 tempest-VolumesTransfersTest-1558781982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d31f2a48-58aa-4e12-b4c5-791897b05006" returned: 0 in 0.418s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:13:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9a6e98c9-b2db-443f-abe6-ec89c188fcf2 tempest-VolumesTransfersTest-1558781982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d31f2a48-58aa-4e12-b4c5-791897b05006 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:13:31 devstack sudo[90450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d31f2a48-58aa-4e12-b4c5-791897b05006 Nov 04 12:13:31 devstack sudo[90450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:13:31 devstack sudo[90450]: pam_unix(sudo:session): session closed for user root Nov 04 12:13:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9a6e98c9-b2db-443f-abe6-ec89c188fcf2 tempest-VolumesTransfersTest-1558781982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d31f2a48-58aa-4e12-b4c5-791897b05006" returned: 0 in 0.289s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:13:31 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9a6e98c9-b2db-443f-abe6-ec89c188fcf2 tempest-VolumesTransfersTest-1558781982 None] Lock "cinder-quobyte-d31f2a48-58aa-4e12-b4c5-791897b05006" released by "delete_volume" :: held 0.765s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:13:31 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-9a6e98c9-b2db-443f-abe6-ec89c188fcf2 tempest-VolumesTransfersTest-1558781982 None] Created reservations ['55c72247-ffae-4a73-89d4-ea1583593d3c', 'f728e8f0-d549-47e6-a58a-bd4122cbe723', '200b96b7-6312-43c8-8c2b-c9a8ad155b43', '7cfb1357-891b-43ef-9033-3cd85d1e4e10'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:13:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9a6e98c9-b2db-443f-abe6-ec89c188fcf2 tempest-VolumesTransfersTest-1558781982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:13:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9a6e98c9-b2db-443f-abe6-ec89c188fcf2 tempest-VolumesTransfersTest-1558781982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:13:32 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9a6e98c9-b2db-443f-abe6-ec89c188fcf2 tempest-VolumesTransfersTest-1558781982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:13:32 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9a6e98c9-b2db-443f-abe6-ec89c188fcf2 tempest-VolumesTransfersTest-1558781982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:13:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9a6e98c9-b2db-443f-abe6-ec89c188fcf2 tempest-VolumesTransfersTest-1558781982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:13:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9a6e98c9-b2db-443f-abe6-ec89c188fcf2 tempest-VolumesTransfersTest-1558781982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:13:32 devstack sudo[90461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:13:32 devstack sudo[90461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:13:32 devstack sudo[90461]: pam_unix(sudo:session): session closed for user root Nov 04 12:13:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9a6e98c9-b2db-443f-abe6-ec89c188fcf2 tempest-VolumesTransfersTest-1558781982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.672s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:13:32 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-9a6e98c9-b2db-443f-abe6-ec89c188fcf2 tempest-VolumesTransfersTest-1558781982 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:13:32 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-9a6e98c9-b2db-443f-abe6-ec89c188fcf2 tempest-VolumesTransfersTest-1558781982 None] Deleted volume successfully. Nov 04 12:13:32 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9a6e98c9-b2db-443f-abe6-ec89c188fcf2 tempest-VolumesTransfersTest-1558781982 None] Lock "cinder-d31f2a48-58aa-4e12-b4c5-791897b05006-delete_volume" released by "delete_volume" :: held 1.885s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:13:33 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-da1e1be5-12ac-40c5-a01b-740b97a28a11 tempest-VolumesTransfersTest-592285369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:13:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-da1e1be5-12ac-40c5-a01b-740b97a28a11 tempest-VolumesTransfersTest-592285369 None] Flow 'volume_create_manager' (5d7ec4cf-e0aa-4ff7-871d-40e7b1b41383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:13:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-da1e1be5-12ac-40c5-a01b-740b97a28a11 tempest-VolumesTransfersTest-592285369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53016d2f-eea0-42f2-9e3c-1f9c2ae2d8b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:13:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-da1e1be5-12ac-40c5-a01b-740b97a28a11 tempest-VolumesTransfersTest-592285369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53016d2f-eea0-42f2-9e3c-1f9c2ae2d8b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:13:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-769674509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80a0a7a9-8a22-4333-ac27-0ace7d728616,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03cb59ea296e40c7af9ea47b8a6ecf52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:13:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:13:33Z,use_quota=True,user_id='c7aa6e2444774b3fb3503b67f7a4ddc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:13:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-da1e1be5-12ac-40c5-a01b-740b97a28a11 tempest-VolumesTransfersTest-592285369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30da8fd5-0e0f-4967-891f-dc49588f1756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:13:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-da1e1be5-12ac-40c5-a01b-740b97a28a11 tempest-VolumesTransfersTest-592285369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30da8fd5-0e0f-4967-891f-dc49588f1756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:13:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-da1e1be5-12ac-40c5-a01b-740b97a28a11 tempest-VolumesTransfersTest-592285369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4a78577-4021-49d2-be1b-ffb45fd3b83e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:13:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-da1e1be5-12ac-40c5-a01b-740b97a28a11 tempest-VolumesTransfersTest-592285369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4a78577-4021-49d2-be1b-ffb45fd3b83e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80a0a7a9-8a22-4333-ac27-0ace7d728616', 'volume_name': 'volume-80a0a7a9-8a22-4333-ac27-0ace7d728616', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:13:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-da1e1be5-12ac-40c5-a01b-740b97a28a11 tempest-VolumesTransfersTest-592285369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f772bdb-079d-4991-a963-0ce7a786b1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:13:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-da1e1be5-12ac-40c5-a01b-740b97a28a11 tempest-VolumesTransfersTest-592285369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f772bdb-079d-4991-a963-0ce7a786b1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:13:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-da1e1be5-12ac-40c5-a01b-740b97a28a11 tempest-VolumesTransfersTest-592285369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edd5e7a5-52ec-4a2d-a4ed-324646916dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:13:33 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-da1e1be5-12ac-40c5-a01b-740b97a28a11 tempest-VolumesTransfersTest-592285369 None] Volume 80a0a7a9-8a22-4333-ac27-0ace7d728616: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80a0a7a9-8a22-4333-ac27-0ace7d728616', 'volume_size': 1} Nov 04 12:13:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-da1e1be5-12ac-40c5-a01b-740b97a28a11 tempest-VolumesTransfersTest-592285369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:13:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-da1e1be5-12ac-40c5-a01b-740b97a28a11 tempest-VolumesTransfersTest-592285369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:13:33 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-da1e1be5-12ac-40c5-a01b-740b97a28a11 tempest-VolumesTransfersTest-592285369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:13:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-769674509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80a0a7a9-8a22-4333-ac27-0ace7d728616,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03cb59ea296e40c7af9ea47b8a6ecf52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:13:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:13:33Z,use_quota=True,user_id='c7aa6e2444774b3fb3503b67f7a4ddc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:13:33 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-da1e1be5-12ac-40c5-a01b-740b97a28a11 tempest-VolumesTransfersTest-592285369 None] Creating volume 80a0a7a9-8a22-4333-ac27-0ace7d728616 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:13:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-da1e1be5-12ac-40c5-a01b-740b97a28a11 tempest-VolumesTransfersTest-592285369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:13:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-da1e1be5-12ac-40c5-a01b-740b97a28a11 tempest-VolumesTransfersTest-592285369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:13:33 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-da1e1be5-12ac-40c5-a01b-740b97a28a11 tempest-VolumesTransfersTest-592285369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:13:33 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-da1e1be5-12ac-40c5-a01b-740b97a28a11 tempest-VolumesTransfersTest-592285369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:13:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-da1e1be5-12ac-40c5-a01b-740b97a28a11 tempest-VolumesTransfersTest-592285369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:13:33 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-da1e1be5-12ac-40c5-a01b-740b97a28a11 tempest-VolumesTransfersTest-592285369 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:13:33 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-da1e1be5-12ac-40c5-a01b-740b97a28a11 tempest-VolumesTransfersTest-592285369 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:13:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-da1e1be5-12ac-40c5-a01b-740b97a28a11 tempest-VolumesTransfersTest-592285369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-80a0a7a9-8a22-4333-ac27-0ace7d728616 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:13:33 devstack sudo[90476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-80a0a7a9-8a22-4333-ac27-0ace7d728616 1073741824 Nov 04 12:13:33 devstack sudo[90476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:13:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-95ce4956-03cb-4b70-a2bb-bb156dc93566 req-6267de5a-05c2-43dc-ac6f-07aab5a1cbe3 tempest-DeleteServersTestJSON-1960685474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:13:33 devstack sudo[90476]: pam_unix(sudo:session): session closed for user root Nov 04 12:13:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-da1e1be5-12ac-40c5-a01b-740b97a28a11 tempest-VolumesTransfersTest-592285369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-80a0a7a9-8a22-4333-ac27-0ace7d728616 1073741824" returned: 0 in 0.573s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:13:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-da1e1be5-12ac-40c5-a01b-740b97a28a11 tempest-VolumesTransfersTest-592285369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-80a0a7a9-8a22-4333-ac27-0ace7d728616 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:13:33 devstack sudo[90482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-80a0a7a9-8a22-4333-ac27-0ace7d728616 Nov 04 12:13:33 devstack sudo[90482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:13:34 devstack sudo[90482]: pam_unix(sudo:session): session closed for user root Nov 04 12:13:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-da1e1be5-12ac-40c5-a01b-740b97a28a11 tempest-VolumesTransfersTest-592285369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-80a0a7a9-8a22-4333-ac27-0ace7d728616" returned: 0 in 0.403s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:13:34 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-da1e1be5-12ac-40c5-a01b-740b97a28a11 tempest-VolumesTransfersTest-592285369 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:13:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-da1e1be5-12ac-40c5-a01b-740b97a28a11 tempest-VolumesTransfersTest-592285369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:13:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-95ce4956-03cb-4b70-a2bb-bb156dc93566 req-6267de5a-05c2-43dc-ac6f-07aab5a1cbe3 tempest-DeleteServersTestJSON-1960685474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.996s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:13:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-da1e1be5-12ac-40c5-a01b-740b97a28a11 tempest-VolumesTransfersTest-592285369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edd5e7a5-52ec-4a2d-a4ed-324646916dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80a0a7a9-8a22-4333-ac27-0ace7d728616', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:13:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-da1e1be5-12ac-40c5-a01b-740b97a28a11 tempest-VolumesTransfersTest-592285369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13ae0c35-2263-4738-bd28-af4a7f125f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:13:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-95ce4956-03cb-4b70-a2bb-bb156dc93566 req-6267de5a-05c2-43dc-ac6f-07aab5a1cbe3 tempest-DeleteServersTestJSON-1960685474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.045s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:13:34 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-da1e1be5-12ac-40c5-a01b-740b97a28a11 tempest-VolumesTransfersTest-592285369 None] Volume volume-80a0a7a9-8a22-4333-ac27-0ace7d728616 (80a0a7a9-8a22-4333-ac27-0ace7d728616): created successfully Nov 04 12:13:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-da1e1be5-12ac-40c5-a01b-740b97a28a11 tempest-VolumesTransfersTest-592285369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13ae0c35-2263-4738-bd28-af4a7f125f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:13:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-da1e1be5-12ac-40c5-a01b-740b97a28a11 tempest-VolumesTransfersTest-592285369 None] Flow 'volume_create_manager' (5d7ec4cf-e0aa-4ff7-871d-40e7b1b41383) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:13:34 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-da1e1be5-12ac-40c5-a01b-740b97a28a11 tempest-VolumesTransfersTest-592285369 None] Created volume successfully. Nov 04 12:13:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-95ce4956-03cb-4b70-a2bb-bb156dc93566 req-6267de5a-05c2-43dc-ac6f-07aab5a1cbe3 tempest-DeleteServersTestJSON-1960685474 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784', 'name': 'volume-53e644d2-d992-4e26-a139-cbc0cc26a187', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a9c2a9cc-91eb-4d92-8312-d25113075fc8', 'enforce_multipath': True} {{(pid=87095) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 12:13:34 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-95ce4956-03cb-4b70-a2bb-bb156dc93566 req-6267de5a-05c2-43dc-ac6f-07aab5a1cbe3 tempest-DeleteServersTestJSON-1960685474 None] attachment_update completed successfully. Nov 04 12:13:35 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a88c194a-15a0-4739-9f5e-cf1e8eade0ec tempest-VolumesTransfersTest-1558781982 None] Acquiring lock "cinder-80a0a7a9-8a22-4333-ac27-0ace7d728616-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:13:35 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a88c194a-15a0-4739-9f5e-cf1e8eade0ec tempest-VolumesTransfersTest-1558781982 None] Lock "cinder-80a0a7a9-8a22-4333-ac27-0ace7d728616-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:13:35 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a88c194a-15a0-4739-9f5e-cf1e8eade0ec tempest-VolumesTransfersTest-1558781982 None] Acquiring lock "cinder-quobyte-80a0a7a9-8a22-4333-ac27-0ace7d728616" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:13:35 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a88c194a-15a0-4739-9f5e-cf1e8eade0ec tempest-VolumesTransfersTest-1558781982 None] Lock "cinder-quobyte-80a0a7a9-8a22-4333-ac27-0ace7d728616" acquired by "delete_volume" :: waited 0.024s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:13:35 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[545f3957-887e-46c5-b59a-3bfa3f2f57e6]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:13:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a88c194a-15a0-4739-9f5e-cf1e8eade0ec tempest-VolumesTransfersTest-1558781982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-80a0a7a9-8a22-4333-ac27-0ace7d728616 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:13:35 devstack sudo[90917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-80a0a7a9-8a22-4333-ac27-0ace7d728616 Nov 04 12:13:35 devstack sudo[90917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:13:36 devstack sudo[90917]: pam_unix(sudo:session): session closed for user root Nov 04 12:13:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a88c194a-15a0-4739-9f5e-cf1e8eade0ec tempest-VolumesTransfersTest-1558781982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-80a0a7a9-8a22-4333-ac27-0ace7d728616" returned: 0 in 0.557s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:13:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a88c194a-15a0-4739-9f5e-cf1e8eade0ec tempest-VolumesTransfersTest-1558781982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-80a0a7a9-8a22-4333-ac27-0ace7d728616 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:13:36 devstack sudo[90923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-80a0a7a9-8a22-4333-ac27-0ace7d728616 Nov 04 12:13:36 devstack sudo[90923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:13:36 devstack sudo[90923]: pam_unix(sudo:session): session closed for user root Nov 04 12:13:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a88c194a-15a0-4739-9f5e-cf1e8eade0ec tempest-VolumesTransfersTest-1558781982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-80a0a7a9-8a22-4333-ac27-0ace7d728616" returned: 0 in 0.309s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:13:36 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a88c194a-15a0-4739-9f5e-cf1e8eade0ec tempest-VolumesTransfersTest-1558781982 None] Lock "cinder-quobyte-80a0a7a9-8a22-4333-ac27-0ace7d728616" released by "delete_volume" :: held 0.963s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:13:36 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-a88c194a-15a0-4739-9f5e-cf1e8eade0ec tempest-VolumesTransfersTest-1558781982 None] Created reservations ['ae863e5f-38f3-4398-9c31-3376fcc269c6', 'fbd5e363-6563-450a-a938-cf60aa11c3bb', '6e429175-5ac9-4ad0-8914-79eb0f4b43ca', 'f493fad4-f7e9-4e72-95ad-aa8ac3ce7c2e'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:13:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a88c194a-15a0-4739-9f5e-cf1e8eade0ec tempest-VolumesTransfersTest-1558781982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:13:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a88c194a-15a0-4739-9f5e-cf1e8eade0ec tempest-VolumesTransfersTest-1558781982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:13:36 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a88c194a-15a0-4739-9f5e-cf1e8eade0ec tempest-VolumesTransfersTest-1558781982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:13:36 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a88c194a-15a0-4739-9f5e-cf1e8eade0ec tempest-VolumesTransfersTest-1558781982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:13:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a88c194a-15a0-4739-9f5e-cf1e8eade0ec tempest-VolumesTransfersTest-1558781982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:13:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a88c194a-15a0-4739-9f5e-cf1e8eade0ec tempest-VolumesTransfersTest-1558781982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:13:36 devstack sudo[90943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:13:36 devstack sudo[90943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:13:37 devstack sudo[90943]: pam_unix(sudo:session): session closed for user root Nov 04 12:13:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a88c194a-15a0-4739-9f5e-cf1e8eade0ec tempest-VolumesTransfersTest-1558781982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.478s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:13:37 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-a88c194a-15a0-4739-9f5e-cf1e8eade0ec tempest-VolumesTransfersTest-1558781982 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:13:37 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-a88c194a-15a0-4739-9f5e-cf1e8eade0ec tempest-VolumesTransfersTest-1558781982 None] Deleted volume successfully. Nov 04 12:13:37 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a88c194a-15a0-4739-9f5e-cf1e8eade0ec tempest-VolumesTransfersTest-1558781982 None] Lock "cinder-80a0a7a9-8a22-4333-ac27-0ace7d728616-delete_volume" released by "delete_volume" :: held 1.813s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:13:38 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-779627e1-eb12-4158-af1d-c91cde65cf18 req-0a03ab31-3a88-49ef-b43e-1af83a95559f tempest-DeleteServersTestJSON-1960685474 None] Terminate volume connection completed successfully. Nov 04 12:13:38 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-779627e1-eb12-4158-af1d-c91cde65cf18 req-0a03ab31-3a88-49ef-b43e-1af83a95559f tempest-DeleteServersTestJSON-1960685474 None] Deleting attachment a9c2a9cc-91eb-4d92-8312-d25113075fc8. {{(pid=87095) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 12:13:40 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-4b37464c-7363-4a92-9fb7-d6b5c36469e4 tempest-DeleteServersTestJSON-1960685474 None] Acquiring lock "cinder-53e644d2-d992-4e26-a139-cbc0cc26a187-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:13:40 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-4b37464c-7363-4a92-9fb7-d6b5c36469e4 tempest-DeleteServersTestJSON-1960685474 None] Lock "cinder-53e644d2-d992-4e26-a139-cbc0cc26a187-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:13:40 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-4b37464c-7363-4a92-9fb7-d6b5c36469e4 tempest-DeleteServersTestJSON-1960685474 None] Acquiring lock "cinder-quobyte-53e644d2-d992-4e26-a139-cbc0cc26a187" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:13:40 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-4b37464c-7363-4a92-9fb7-d6b5c36469e4 tempest-DeleteServersTestJSON-1960685474 None] Lock "cinder-quobyte-53e644d2-d992-4e26-a139-cbc0cc26a187" acquired by "delete_volume" :: waited 0.031s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:13:40 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d274023d-b72e-4bd1-ac48-02377e74952a]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:13:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4b37464c-7363-4a92-9fb7-d6b5c36469e4 tempest-DeleteServersTestJSON-1960685474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-53e644d2-d992-4e26-a139-cbc0cc26a187 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:13:41 devstack sudo[91022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-53e644d2-d992-4e26-a139-cbc0cc26a187 Nov 04 12:13:41 devstack sudo[91022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:13:41 devstack sudo[91022]: pam_unix(sudo:session): session closed for user root Nov 04 12:13:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4b37464c-7363-4a92-9fb7-d6b5c36469e4 tempest-DeleteServersTestJSON-1960685474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-53e644d2-d992-4e26-a139-cbc0cc26a187" returned: 0 in 0.381s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:13:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4b37464c-7363-4a92-9fb7-d6b5c36469e4 tempest-DeleteServersTestJSON-1960685474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-53e644d2-d992-4e26-a139-cbc0cc26a187 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:13:41 devstack sudo[91027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-53e644d2-d992-4e26-a139-cbc0cc26a187 Nov 04 12:13:41 devstack sudo[91027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:13:41 devstack sudo[91027]: pam_unix(sudo:session): session closed for user root Nov 04 12:13:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4b37464c-7363-4a92-9fb7-d6b5c36469e4 tempest-DeleteServersTestJSON-1960685474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-53e644d2-d992-4e26-a139-cbc0cc26a187" returned: 0 in 0.327s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:13:41 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-4b37464c-7363-4a92-9fb7-d6b5c36469e4 tempest-DeleteServersTestJSON-1960685474 None] Lock "cinder-quobyte-53e644d2-d992-4e26-a139-cbc0cc26a187" released by "delete_volume" :: held 0.794s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:13:41 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-4b37464c-7363-4a92-9fb7-d6b5c36469e4 tempest-DeleteServersTestJSON-1960685474 None] Created reservations ['abc6cc4f-d0d4-48d7-ada8-66984aa34499', 'bbdbf2c7-f29a-46d1-99b8-47eaf082f4d9', 'df7c2a6f-c4a7-40b3-b6c1-8d0aa414c535', '57d5d62d-a4bf-40a7-bc4a-a9c35ad7564a'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:13:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4b37464c-7363-4a92-9fb7-d6b5c36469e4 tempest-DeleteServersTestJSON-1960685474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:13:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4b37464c-7363-4a92-9fb7-d6b5c36469e4 tempest-DeleteServersTestJSON-1960685474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:13:41 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4b37464c-7363-4a92-9fb7-d6b5c36469e4 tempest-DeleteServersTestJSON-1960685474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:13:41 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4b37464c-7363-4a92-9fb7-d6b5c36469e4 tempest-DeleteServersTestJSON-1960685474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:13:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4b37464c-7363-4a92-9fb7-d6b5c36469e4 tempest-DeleteServersTestJSON-1960685474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:13:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4b37464c-7363-4a92-9fb7-d6b5c36469e4 tempest-DeleteServersTestJSON-1960685474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:13:42 devstack sudo[91033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:13:42 devstack sudo[91033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:13:42 devstack sudo[91033]: pam_unix(sudo:session): session closed for user root Nov 04 12:13:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4b37464c-7363-4a92-9fb7-d6b5c36469e4 tempest-DeleteServersTestJSON-1960685474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.561s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:13:42 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-4b37464c-7363-4a92-9fb7-d6b5c36469e4 tempest-DeleteServersTestJSON-1960685474 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:13:42 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-4b37464c-7363-4a92-9fb7-d6b5c36469e4 tempest-DeleteServersTestJSON-1960685474 None] Deleted volume successfully. Nov 04 12:13:42 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-4b37464c-7363-4a92-9fb7-d6b5c36469e4 tempest-DeleteServersTestJSON-1960685474 None] Lock "cinder-53e644d2-d992-4e26-a139-cbc0cc26a187-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:13:48 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-cffd29ec-c0c5-48e2-9ac6-7922e3910c68 tempest-VolumesTransfersV355Test-367660535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:13:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cffd29ec-c0c5-48e2-9ac6-7922e3910c68 tempest-VolumesTransfersV355Test-367660535 None] Flow 'volume_create_manager' (37eaf074-195d-4e95-80e9-3748204a66f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:13:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cffd29ec-c0c5-48e2-9ac6-7922e3910c68 tempest-VolumesTransfersV355Test-367660535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62b8709a-172b-4c75-a503-479da07d9628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:13:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cffd29ec-c0c5-48e2-9ac6-7922e3910c68 tempest-VolumesTransfersV355Test-367660535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62b8709a-172b-4c75-a503-479da07d9628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:13:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1848109293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7278a002-2478-4fea-b805-903d71f48e7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89b98da6a98946dea1a774facdcd45b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:13:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:13:48Z,use_quota=True,user_id='230e0755d6fc4629b49dab2b440d0516',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:13:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cffd29ec-c0c5-48e2-9ac6-7922e3910c68 tempest-VolumesTransfersV355Test-367660535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e24bc287-1fc1-46de-a3bf-990dbc3772ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:13:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cffd29ec-c0c5-48e2-9ac6-7922e3910c68 tempest-VolumesTransfersV355Test-367660535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e24bc287-1fc1-46de-a3bf-990dbc3772ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:13:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cffd29ec-c0c5-48e2-9ac6-7922e3910c68 tempest-VolumesTransfersV355Test-367660535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b44f1fcb-8aca-4ea6-bde5-0f12f947328d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:13:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cffd29ec-c0c5-48e2-9ac6-7922e3910c68 tempest-VolumesTransfersV355Test-367660535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b44f1fcb-8aca-4ea6-bde5-0f12f947328d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7278a002-2478-4fea-b805-903d71f48e7a', 'volume_name': 'volume-7278a002-2478-4fea-b805-903d71f48e7a', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:13:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cffd29ec-c0c5-48e2-9ac6-7922e3910c68 tempest-VolumesTransfersV355Test-367660535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcd2e32a-e91b-4c9f-b691-bc9902aa3ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:13:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cffd29ec-c0c5-48e2-9ac6-7922e3910c68 tempest-VolumesTransfersV355Test-367660535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcd2e32a-e91b-4c9f-b691-bc9902aa3ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:13:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cffd29ec-c0c5-48e2-9ac6-7922e3910c68 tempest-VolumesTransfersV355Test-367660535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c713293-4d20-4adc-9c30-c14d593ceecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:13:48 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-cffd29ec-c0c5-48e2-9ac6-7922e3910c68 tempest-VolumesTransfersV355Test-367660535 None] Volume 7278a002-2478-4fea-b805-903d71f48e7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7278a002-2478-4fea-b805-903d71f48e7a', 'volume_size': 1} Nov 04 12:13:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cffd29ec-c0c5-48e2-9ac6-7922e3910c68 tempest-VolumesTransfersV355Test-367660535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:13:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cffd29ec-c0c5-48e2-9ac6-7922e3910c68 tempest-VolumesTransfersV355Test-367660535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:13:48 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-cffd29ec-c0c5-48e2-9ac6-7922e3910c68 tempest-VolumesTransfersV355Test-367660535 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:13:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1848109293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7278a002-2478-4fea-b805-903d71f48e7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89b98da6a98946dea1a774facdcd45b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:13:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:13:48Z,use_quota=True,user_id='230e0755d6fc4629b49dab2b440d0516',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:13:48 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-cffd29ec-c0c5-48e2-9ac6-7922e3910c68 tempest-VolumesTransfersV355Test-367660535 None] Creating volume 7278a002-2478-4fea-b805-903d71f48e7a {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:13:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cffd29ec-c0c5-48e2-9ac6-7922e3910c68 tempest-VolumesTransfersV355Test-367660535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:13:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cffd29ec-c0c5-48e2-9ac6-7922e3910c68 tempest-VolumesTransfersV355Test-367660535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:13:48 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-cffd29ec-c0c5-48e2-9ac6-7922e3910c68 tempest-VolumesTransfersV355Test-367660535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:13:48 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-cffd29ec-c0c5-48e2-9ac6-7922e3910c68 tempest-VolumesTransfersV355Test-367660535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:13:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cffd29ec-c0c5-48e2-9ac6-7922e3910c68 tempest-VolumesTransfersV355Test-367660535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:13:48 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-cffd29ec-c0c5-48e2-9ac6-7922e3910c68 tempest-VolumesTransfersV355Test-367660535 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:13:48 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-cffd29ec-c0c5-48e2-9ac6-7922e3910c68 tempest-VolumesTransfersV355Test-367660535 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:13:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cffd29ec-c0c5-48e2-9ac6-7922e3910c68 tempest-VolumesTransfersV355Test-367660535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-7278a002-2478-4fea-b805-903d71f48e7a 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:13:48 devstack sudo[91043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-7278a002-2478-4fea-b805-903d71f48e7a 1073741824 Nov 04 12:13:48 devstack sudo[91043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:13:48 devstack sudo[91043]: pam_unix(sudo:session): session closed for user root Nov 04 12:13:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cffd29ec-c0c5-48e2-9ac6-7922e3910c68 tempest-VolumesTransfersV355Test-367660535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-7278a002-2478-4fea-b805-903d71f48e7a 1073741824" returned: 0 in 0.493s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:13:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cffd29ec-c0c5-48e2-9ac6-7922e3910c68 tempest-VolumesTransfersV355Test-367660535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-7278a002-2478-4fea-b805-903d71f48e7a {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:13:49 devstack sudo[91049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-7278a002-2478-4fea-b805-903d71f48e7a Nov 04 12:13:49 devstack sudo[91049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:13:49 devstack sudo[91049]: pam_unix(sudo:session): session closed for user root Nov 04 12:13:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cffd29ec-c0c5-48e2-9ac6-7922e3910c68 tempest-VolumesTransfersV355Test-367660535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-7278a002-2478-4fea-b805-903d71f48e7a" returned: 0 in 0.297s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:13:49 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-cffd29ec-c0c5-48e2-9ac6-7922e3910c68 tempest-VolumesTransfersV355Test-367660535 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:13:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cffd29ec-c0c5-48e2-9ac6-7922e3910c68 tempest-VolumesTransfersV355Test-367660535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:13:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cffd29ec-c0c5-48e2-9ac6-7922e3910c68 tempest-VolumesTransfersV355Test-367660535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c713293-4d20-4adc-9c30-c14d593ceecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7278a002-2478-4fea-b805-903d71f48e7a', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:13:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cffd29ec-c0c5-48e2-9ac6-7922e3910c68 tempest-VolumesTransfersV355Test-367660535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9cf87ec-8423-4e63-b551-0cd55722ab9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:13:49 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-cffd29ec-c0c5-48e2-9ac6-7922e3910c68 tempest-VolumesTransfersV355Test-367660535 None] Volume volume-7278a002-2478-4fea-b805-903d71f48e7a (7278a002-2478-4fea-b805-903d71f48e7a): created successfully Nov 04 12:13:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cffd29ec-c0c5-48e2-9ac6-7922e3910c68 tempest-VolumesTransfersV355Test-367660535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9cf87ec-8423-4e63-b551-0cd55722ab9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:13:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cffd29ec-c0c5-48e2-9ac6-7922e3910c68 tempest-VolumesTransfersV355Test-367660535 None] Flow 'volume_create_manager' (37eaf074-195d-4e95-80e9-3748204a66f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:13:49 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-cffd29ec-c0c5-48e2-9ac6-7922e3910c68 tempest-VolumesTransfersV355Test-367660535 None] Created volume successfully. Nov 04 12:13:51 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [req-4fd83c60-8364-49c3-b1a4-995d838ede87 req-e3dcf0ec-6733-4fee-a0ab-d33a70fa2b05 tempest-VolumesSnapshotsTestJSON-2053423637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:13:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-4fd83c60-8364-49c3-b1a4-995d838ede87 req-e3dcf0ec-6733-4fee-a0ab-d33a70fa2b05 tempest-VolumesSnapshotsTestJSON-2053423637 None] Flow 'volume_create_manager' (fe55b83e-aa01-43a4-b1e0-e258795522ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:13:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-4fd83c60-8364-49c3-b1a4-995d838ede87 req-e3dcf0ec-6733-4fee-a0ab-d33a70fa2b05 tempest-VolumesSnapshotsTestJSON-2053423637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (178ff9f6-25c7-46b2-ae2d-8db8e696296b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:13:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-4fd83c60-8364-49c3-b1a4-995d838ede87 req-e3dcf0ec-6733-4fee-a0ab-d33a70fa2b05 tempest-VolumesSnapshotsTestJSON-2053423637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (178ff9f6-25c7-46b2-ae2d-8db8e696296b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:13:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1200977956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c703401d-7e5d-48eb-9190-7d9167d0d79a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa706d36320841cc99386b577a1d7bd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:13:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:13:51Z,use_quota=True,user_id='d3a1836355554f8a8410a6bebcdcbf4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:13:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-4fd83c60-8364-49c3-b1a4-995d838ede87 req-e3dcf0ec-6733-4fee-a0ab-d33a70fa2b05 tempest-VolumesSnapshotsTestJSON-2053423637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96caf999-a91c-4922-80c8-20faf28486a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:13:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-4fd83c60-8364-49c3-b1a4-995d838ede87 req-e3dcf0ec-6733-4fee-a0ab-d33a70fa2b05 tempest-VolumesSnapshotsTestJSON-2053423637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96caf999-a91c-4922-80c8-20faf28486a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:13:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-4fd83c60-8364-49c3-b1a4-995d838ede87 req-e3dcf0ec-6733-4fee-a0ab-d33a70fa2b05 tempest-VolumesSnapshotsTestJSON-2053423637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d11e4737-311a-4468-ae39-2140da715adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:13:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-4fd83c60-8364-49c3-b1a4-995d838ede87 req-e3dcf0ec-6733-4fee-a0ab-d33a70fa2b05 tempest-VolumesSnapshotsTestJSON-2053423637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d11e4737-311a-4468-ae39-2140da715adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c703401d-7e5d-48eb-9190-7d9167d0d79a', 'volume_name': 'volume-c703401d-7e5d-48eb-9190-7d9167d0d79a', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:13:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-4fd83c60-8364-49c3-b1a4-995d838ede87 req-e3dcf0ec-6733-4fee-a0ab-d33a70fa2b05 tempest-VolumesSnapshotsTestJSON-2053423637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (252a2ba9-b530-4b64-9376-6520b178fbdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:13:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-4fd83c60-8364-49c3-b1a4-995d838ede87 req-e3dcf0ec-6733-4fee-a0ab-d33a70fa2b05 tempest-VolumesSnapshotsTestJSON-2053423637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (252a2ba9-b530-4b64-9376-6520b178fbdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:13:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-4fd83c60-8364-49c3-b1a4-995d838ede87 req-e3dcf0ec-6733-4fee-a0ab-d33a70fa2b05 tempest-VolumesSnapshotsTestJSON-2053423637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (212d6b37-c311-4d63-b9fe-e31910733618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:13:51 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [req-4fd83c60-8364-49c3-b1a4-995d838ede87 req-e3dcf0ec-6733-4fee-a0ab-d33a70fa2b05 tempest-VolumesSnapshotsTestJSON-2053423637 None] Volume c703401d-7e5d-48eb-9190-7d9167d0d79a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c703401d-7e5d-48eb-9190-7d9167d0d79a', 'volume_size': 1} Nov 04 12:13:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-4fd83c60-8364-49c3-b1a4-995d838ede87 req-e3dcf0ec-6733-4fee-a0ab-d33a70fa2b05 tempest-VolumesSnapshotsTestJSON-2053423637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:13:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-4fd83c60-8364-49c3-b1a4-995d838ede87 req-e3dcf0ec-6733-4fee-a0ab-d33a70fa2b05 tempest-VolumesSnapshotsTestJSON-2053423637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:13:51 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [req-4fd83c60-8364-49c3-b1a4-995d838ede87 req-e3dcf0ec-6733-4fee-a0ab-d33a70fa2b05 tempest-VolumesSnapshotsTestJSON-2053423637 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:13:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1200977956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c703401d-7e5d-48eb-9190-7d9167d0d79a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa706d36320841cc99386b577a1d7bd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:13:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:13:51Z,use_quota=True,user_id='d3a1836355554f8a8410a6bebcdcbf4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:13:51 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [req-4fd83c60-8364-49c3-b1a4-995d838ede87 req-e3dcf0ec-6733-4fee-a0ab-d33a70fa2b05 tempest-VolumesSnapshotsTestJSON-2053423637 None] Creating volume c703401d-7e5d-48eb-9190-7d9167d0d79a {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:13:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-4fd83c60-8364-49c3-b1a4-995d838ede87 req-e3dcf0ec-6733-4fee-a0ab-d33a70fa2b05 tempest-VolumesSnapshotsTestJSON-2053423637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:13:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-4fd83c60-8364-49c3-b1a4-995d838ede87 req-e3dcf0ec-6733-4fee-a0ab-d33a70fa2b05 tempest-VolumesSnapshotsTestJSON-2053423637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:13:51 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [req-4fd83c60-8364-49c3-b1a4-995d838ede87 req-e3dcf0ec-6733-4fee-a0ab-d33a70fa2b05 tempest-VolumesSnapshotsTestJSON-2053423637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:13:51 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [req-4fd83c60-8364-49c3-b1a4-995d838ede87 req-e3dcf0ec-6733-4fee-a0ab-d33a70fa2b05 tempest-VolumesSnapshotsTestJSON-2053423637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:13:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-4fd83c60-8364-49c3-b1a4-995d838ede87 req-e3dcf0ec-6733-4fee-a0ab-d33a70fa2b05 tempest-VolumesSnapshotsTestJSON-2053423637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:13:51 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [req-4fd83c60-8364-49c3-b1a4-995d838ede87 req-e3dcf0ec-6733-4fee-a0ab-d33a70fa2b05 tempest-VolumesSnapshotsTestJSON-2053423637 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:13:51 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [req-4fd83c60-8364-49c3-b1a4-995d838ede87 req-e3dcf0ec-6733-4fee-a0ab-d33a70fa2b05 tempest-VolumesSnapshotsTestJSON-2053423637 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:13:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-4fd83c60-8364-49c3-b1a4-995d838ede87 req-e3dcf0ec-6733-4fee-a0ab-d33a70fa2b05 tempest-VolumesSnapshotsTestJSON-2053423637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c703401d-7e5d-48eb-9190-7d9167d0d79a 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:13:51 devstack sudo[91054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c703401d-7e5d-48eb-9190-7d9167d0d79a 1073741824 Nov 04 12:13:51 devstack sudo[91054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:13:51 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-d3e0b99f-b0c5-4432-aa83-45d2406be2f9 tempest-VolumesTransfersV355Test-1650707383 None] Transfer volume completed successfully. Nov 04 12:13:51 devstack sudo[91054]: pam_unix(sudo:session): session closed for user root Nov 04 12:13:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-4fd83c60-8364-49c3-b1a4-995d838ede87 req-e3dcf0ec-6733-4fee-a0ab-d33a70fa2b05 tempest-VolumesSnapshotsTestJSON-2053423637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c703401d-7e5d-48eb-9190-7d9167d0d79a 1073741824" returned: 0 in 0.758s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:13:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-4fd83c60-8364-49c3-b1a4-995d838ede87 req-e3dcf0ec-6733-4fee-a0ab-d33a70fa2b05 tempest-VolumesSnapshotsTestJSON-2053423637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c703401d-7e5d-48eb-9190-7d9167d0d79a {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:13:52 devstack sudo[91078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c703401d-7e5d-48eb-9190-7d9167d0d79a Nov 04 12:13:52 devstack sudo[91078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:13:52 devstack sudo[91078]: pam_unix(sudo:session): session closed for user root Nov 04 12:13:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-4fd83c60-8364-49c3-b1a4-995d838ede87 req-e3dcf0ec-6733-4fee-a0ab-d33a70fa2b05 tempest-VolumesSnapshotsTestJSON-2053423637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c703401d-7e5d-48eb-9190-7d9167d0d79a" returned: 0 in 0.445s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:13:52 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [req-4fd83c60-8364-49c3-b1a4-995d838ede87 req-e3dcf0ec-6733-4fee-a0ab-d33a70fa2b05 tempest-VolumesSnapshotsTestJSON-2053423637 None] <== create_volume: return (1359ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:13:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-4fd83c60-8364-49c3-b1a4-995d838ede87 req-e3dcf0ec-6733-4fee-a0ab-d33a70fa2b05 tempest-VolumesSnapshotsTestJSON-2053423637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.367s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:13:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-4fd83c60-8364-49c3-b1a4-995d838ede87 req-e3dcf0ec-6733-4fee-a0ab-d33a70fa2b05 tempest-VolumesSnapshotsTestJSON-2053423637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (212d6b37-c311-4d63-b9fe-e31910733618) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c703401d-7e5d-48eb-9190-7d9167d0d79a', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:13:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-4fd83c60-8364-49c3-b1a4-995d838ede87 req-e3dcf0ec-6733-4fee-a0ab-d33a70fa2b05 tempest-VolumesSnapshotsTestJSON-2053423637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07b6daca-6fe3-4123-9c5b-fa47a038f104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:13:52 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [req-4fd83c60-8364-49c3-b1a4-995d838ede87 req-e3dcf0ec-6733-4fee-a0ab-d33a70fa2b05 tempest-VolumesSnapshotsTestJSON-2053423637 None] Volume volume-c703401d-7e5d-48eb-9190-7d9167d0d79a (c703401d-7e5d-48eb-9190-7d9167d0d79a): created successfully Nov 04 12:13:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-4fd83c60-8364-49c3-b1a4-995d838ede87 req-e3dcf0ec-6733-4fee-a0ab-d33a70fa2b05 tempest-VolumesSnapshotsTestJSON-2053423637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07b6daca-6fe3-4123-9c5b-fa47a038f104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:13:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-4fd83c60-8364-49c3-b1a4-995d838ede87 req-e3dcf0ec-6733-4fee-a0ab-d33a70fa2b05 tempest-VolumesSnapshotsTestJSON-2053423637 None] Flow 'volume_create_manager' (fe55b83e-aa01-43a4-b1e0-e258795522ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:13:52 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-4fd83c60-8364-49c3-b1a4-995d838ede87 req-e3dcf0ec-6733-4fee-a0ab-d33a70fa2b05 tempest-VolumesSnapshotsTestJSON-2053423637 None] Created volume successfully. Nov 04 12:13:53 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-46b51791-3834-4d66-9e39-ade8689d8c87 tempest-VolumesTransfersV355Test-1332255060 None] Acquiring lock "cinder-7278a002-2478-4fea-b805-903d71f48e7a-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:13:53 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-46b51791-3834-4d66-9e39-ade8689d8c87 tempest-VolumesTransfersV355Test-1332255060 None] Lock "cinder-7278a002-2478-4fea-b805-903d71f48e7a-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:13:53 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-46b51791-3834-4d66-9e39-ade8689d8c87 tempest-VolumesTransfersV355Test-1332255060 None] Acquiring lock "cinder-quobyte-7278a002-2478-4fea-b805-903d71f48e7a" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:13:53 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-46b51791-3834-4d66-9e39-ade8689d8c87 tempest-VolumesTransfersV355Test-1332255060 None] Lock "cinder-quobyte-7278a002-2478-4fea-b805-903d71f48e7a" acquired by "delete_volume" :: waited 0.020s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:13:53 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9fd615-c990-47ea-bd29-63bee74882f7]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:13:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-46b51791-3834-4d66-9e39-ade8689d8c87 tempest-VolumesTransfersV355Test-1332255060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-7278a002-2478-4fea-b805-903d71f48e7a {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:13:53 devstack sudo[91089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-7278a002-2478-4fea-b805-903d71f48e7a Nov 04 12:13:53 devstack sudo[91089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:13:53 devstack sudo[91089]: pam_unix(sudo:session): session closed for user root Nov 04 12:13:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-46b51791-3834-4d66-9e39-ade8689d8c87 tempest-VolumesTransfersV355Test-1332255060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-7278a002-2478-4fea-b805-903d71f48e7a" returned: 0 in 0.488s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:13:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-46b51791-3834-4d66-9e39-ade8689d8c87 tempest-VolumesTransfersV355Test-1332255060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-7278a002-2478-4fea-b805-903d71f48e7a {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:13:53 devstack sudo[91095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-7278a002-2478-4fea-b805-903d71f48e7a Nov 04 12:13:53 devstack sudo[91095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:13:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-6eab7e23-1cf6-4588-94d0-692c8633c01e req-45908955-64a9-4c97-894e-91f82512fb02 tempest-VolumesSnapshotsTestJSON-2053423637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:13:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-6eab7e23-1cf6-4588-94d0-692c8633c01e req-45908955-64a9-4c97-894e-91f82512fb02 tempest-VolumesSnapshotsTestJSON-2053423637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:13:53 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [req-6eab7e23-1cf6-4588-94d0-692c8633c01e req-45908955-64a9-4c97-894e-91f82512fb02 tempest-VolumesSnapshotsTestJSON-2053423637 None] Creating offline snapshot 12bceec6-0ae0-410e-97c6-7452db480200 of volume c703401d-7e5d-48eb-9190-7d9167d0d79a {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 12:13:53 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4810fd7-fa14-4a58-8aad-b564aab6be8c]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:13:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-6eab7e23-1cf6-4588-94d0-692c8633c01e req-45908955-64a9-4c97-894e-91f82512fb02 tempest-VolumesSnapshotsTestJSON-2053423637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c703401d-7e5d-48eb-9190-7d9167d0d79a {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:13:54 devstack sudo[91098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c703401d-7e5d-48eb-9190-7d9167d0d79a Nov 04 12:13:54 devstack sudo[91098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:13:54 devstack sudo[91095]: pam_unix(sudo:session): session closed for user root Nov 04 12:13:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-46b51791-3834-4d66-9e39-ade8689d8c87 tempest-VolumesTransfersV355Test-1332255060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-7278a002-2478-4fea-b805-903d71f48e7a" returned: 0 in 0.481s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:13:54 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-46b51791-3834-4d66-9e39-ade8689d8c87 tempest-VolumesTransfersV355Test-1332255060 None] Lock "cinder-quobyte-7278a002-2478-4fea-b805-903d71f48e7a" released by "delete_volume" :: held 1.073s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:13:54 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-46b51791-3834-4d66-9e39-ade8689d8c87 tempest-VolumesTransfersV355Test-1332255060 None] Created reservations ['8bae7276-b971-4353-b9e5-bfe11138910a', '7ac22fac-e637-4e61-a1fd-46b00b710a92', 'fd346e6b-4aa2-4456-9284-c0fdd747347c', 'cd65a750-b934-4b14-b1d6-1b8e907254e0'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:13:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-46b51791-3834-4d66-9e39-ade8689d8c87 tempest-VolumesTransfersV355Test-1332255060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:13:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-46b51791-3834-4d66-9e39-ade8689d8c87 tempest-VolumesTransfersV355Test-1332255060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:13:54 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-46b51791-3834-4d66-9e39-ade8689d8c87 tempest-VolumesTransfersV355Test-1332255060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:13:54 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-46b51791-3834-4d66-9e39-ade8689d8c87 tempest-VolumesTransfersV355Test-1332255060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:13:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-46b51791-3834-4d66-9e39-ade8689d8c87 tempest-VolumesTransfersV355Test-1332255060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:13:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-46b51791-3834-4d66-9e39-ade8689d8c87 tempest-VolumesTransfersV355Test-1332255060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:13:54 devstack sudo[91098]: pam_unix(sudo:session): session closed for user root Nov 04 12:13:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-6eab7e23-1cf6-4588-94d0-692c8633c01e req-45908955-64a9-4c97-894e-91f82512fb02 tempest-VolumesSnapshotsTestJSON-2053423637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c703401d-7e5d-48eb-9190-7d9167d0d79a" returned: 0 in 0.584s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:13:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-6eab7e23-1cf6-4588-94d0-692c8633c01e req-45908955-64a9-4c97-894e-91f82512fb02 tempest-VolumesSnapshotsTestJSON-2053423637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c703401d-7e5d-48eb-9190-7d9167d0d79a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c703401d-7e5d-48eb-9190-7d9167d0d79a.12bceec6-0ae0-410e-97c6-7452db480200 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:13:54 devstack sudo[91121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:13:54 devstack sudo[91121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:13:54 devstack sudo[91123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c703401d-7e5d-48eb-9190-7d9167d0d79a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c703401d-7e5d-48eb-9190-7d9167d0d79a.12bceec6-0ae0-410e-97c6-7452db480200 1G Nov 04 12:13:54 devstack sudo[91123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:13:54 devstack sudo[91121]: pam_unix(sudo:session): session closed for user root Nov 04 12:13:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-46b51791-3834-4d66-9e39-ade8689d8c87 tempest-VolumesTransfersV355Test-1332255060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.487s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:13:54 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-46b51791-3834-4d66-9e39-ade8689d8c87 tempest-VolumesTransfersV355Test-1332255060 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:13:54 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-46b51791-3834-4d66-9e39-ade8689d8c87 tempest-VolumesTransfersV355Test-1332255060 None] Deleted volume successfully. Nov 04 12:13:54 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-46b51791-3834-4d66-9e39-ade8689d8c87 tempest-VolumesTransfersV355Test-1332255060 None] Lock "cinder-7278a002-2478-4fea-b805-903d71f48e7a-delete_volume" released by "delete_volume" :: held 1.937s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:13:55 devstack sudo[91123]: pam_unix(sudo:session): session closed for user root Nov 04 12:13:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-6eab7e23-1cf6-4588-94d0-692c8633c01e req-45908955-64a9-4c97-894e-91f82512fb02 tempest-VolumesSnapshotsTestJSON-2053423637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c703401d-7e5d-48eb-9190-7d9167d0d79a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c703401d-7e5d-48eb-9190-7d9167d0d79a.12bceec6-0ae0-410e-97c6-7452db480200 1G" returned: 0 in 0.556s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:13:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-6eab7e23-1cf6-4588-94d0-692c8633c01e req-45908955-64a9-4c97-894e-91f82512fb02 tempest-VolumesSnapshotsTestJSON-2053423637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c703401d-7e5d-48eb-9190-7d9167d0d79a -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c703401d-7e5d-48eb-9190-7d9167d0d79a.12bceec6-0ae0-410e-97c6-7452db480200 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:13:55 devstack sudo[91130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c703401d-7e5d-48eb-9190-7d9167d0d79a -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c703401d-7e5d-48eb-9190-7d9167d0d79a.12bceec6-0ae0-410e-97c6-7452db480200 Nov 04 12:13:55 devstack sudo[91130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:13:55 devstack sudo[91130]: pam_unix(sudo:session): session closed for user root Nov 04 12:13:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-6eab7e23-1cf6-4588-94d0-692c8633c01e req-45908955-64a9-4c97-894e-91f82512fb02 tempest-VolumesSnapshotsTestJSON-2053423637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c703401d-7e5d-48eb-9190-7d9167d0d79a -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c703401d-7e5d-48eb-9190-7d9167d0d79a.12bceec6-0ae0-410e-97c6-7452db480200" returned: 0 in 0.295s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:13:55 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [req-6eab7e23-1cf6-4588-94d0-692c8633c01e req-45908955-64a9-4c97-894e-91f82512fb02 tempest-VolumesSnapshotsTestJSON-2053423637 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c703401d-7e5d-48eb-9190-7d9167d0d79a.12bceec6-0ae0-410e-97c6-7452db480200 is being set with open permissions: ugo+rw Nov 04 12:13:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-6eab7e23-1cf6-4588-94d0-692c8633c01e req-45908955-64a9-4c97-894e-91f82512fb02 tempest-VolumesSnapshotsTestJSON-2053423637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c703401d-7e5d-48eb-9190-7d9167d0d79a.12bceec6-0ae0-410e-97c6-7452db480200 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:13:55 devstack sudo[91136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c703401d-7e5d-48eb-9190-7d9167d0d79a.12bceec6-0ae0-410e-97c6-7452db480200 Nov 04 12:13:55 devstack sudo[91136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:13:55 devstack sudo[91136]: pam_unix(sudo:session): session closed for user root Nov 04 12:13:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-6eab7e23-1cf6-4588-94d0-692c8633c01e req-45908955-64a9-4c97-894e-91f82512fb02 tempest-VolumesSnapshotsTestJSON-2053423637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c703401d-7e5d-48eb-9190-7d9167d0d79a.12bceec6-0ae0-410e-97c6-7452db480200" returned: 0 in 0.249s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:13:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-6eab7e23-1cf6-4588-94d0-692c8633c01e req-45908955-64a9-4c97-894e-91f82512fb02 tempest-VolumesSnapshotsTestJSON-2053423637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c703401d-7e5d-48eb-9190-7d9167d0d79a.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:13:55 devstack sudo[91139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c703401d-7e5d-48eb-9190-7d9167d0d79a.info Nov 04 12:13:55 devstack sudo[91139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:13:55 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-79ceccb8-be59-40e1-93a1-d00cacfb54e8 tempest-VolumesTransfersV355Test-367660535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:13:55 devstack sudo[91139]: pam_unix(sudo:session): session closed for user root Nov 04 12:13:55 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-79ceccb8-be59-40e1-93a1-d00cacfb54e8 tempest-VolumesTransfersV355Test-367660535 None] Flow 'volume_create_manager' (ee36ce0f-5924-4375-8f89-2f5766b5aa3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:13:55 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-79ceccb8-be59-40e1-93a1-d00cacfb54e8 tempest-VolumesTransfersV355Test-367660535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93a92c71-fec2-4849-afbf-4eabc970c24b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:13:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-6eab7e23-1cf6-4588-94d0-692c8633c01e req-45908955-64a9-4c97-894e-91f82512fb02 tempest-VolumesSnapshotsTestJSON-2053423637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c703401d-7e5d-48eb-9190-7d9167d0d79a.info" returned: 0 in 0.286s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:13:55 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [req-6eab7e23-1cf6-4588-94d0-692c8633c01e req-45908955-64a9-4c97-894e-91f82512fb02 tempest-VolumesSnapshotsTestJSON-2053423637 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c703401d-7e5d-48eb-9190-7d9167d0d79a.info is being set with open permissions: ugo+rw Nov 04 12:13:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-6eab7e23-1cf6-4588-94d0-692c8633c01e req-45908955-64a9-4c97-894e-91f82512fb02 tempest-VolumesSnapshotsTestJSON-2053423637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c703401d-7e5d-48eb-9190-7d9167d0d79a.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:13:55 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-79ceccb8-be59-40e1-93a1-d00cacfb54e8 tempest-VolumesTransfersV355Test-367660535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93a92c71-fec2-4849-afbf-4eabc970c24b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:13:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1172868637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0ba1d60-2f59-4bbd-9322-1be017f13fd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89b98da6a98946dea1a774facdcd45b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:13:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:13:56Z,use_quota=True,user_id='230e0755d6fc4629b49dab2b440d0516',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:13:55 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-79ceccb8-be59-40e1-93a1-d00cacfb54e8 tempest-VolumesTransfersV355Test-367660535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e88e3c7-7fcb-48b9-9018-3a16505993d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:13:55 devstack sudo[91142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c703401d-7e5d-48eb-9190-7d9167d0d79a.info Nov 04 12:13:55 devstack sudo[91142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:13:55 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-79ceccb8-be59-40e1-93a1-d00cacfb54e8 tempest-VolumesTransfersV355Test-367660535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e88e3c7-7fcb-48b9-9018-3a16505993d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:13:55 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-79ceccb8-be59-40e1-93a1-d00cacfb54e8 tempest-VolumesTransfersV355Test-367660535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8df02f2-0465-4b34-bf2d-6e1f6eb7c4dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:13:55 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-79ceccb8-be59-40e1-93a1-d00cacfb54e8 tempest-VolumesTransfersV355Test-367660535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8df02f2-0465-4b34-bf2d-6e1f6eb7c4dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0ba1d60-2f59-4bbd-9322-1be017f13fd9', 'volume_name': 'volume-c0ba1d60-2f59-4bbd-9322-1be017f13fd9', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:13:55 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-79ceccb8-be59-40e1-93a1-d00cacfb54e8 tempest-VolumesTransfersV355Test-367660535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8a7afb5-873b-4747-8583-0c8946b91ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:13:55 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-79ceccb8-be59-40e1-93a1-d00cacfb54e8 tempest-VolumesTransfersV355Test-367660535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8a7afb5-873b-4747-8583-0c8946b91ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:13:55 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-79ceccb8-be59-40e1-93a1-d00cacfb54e8 tempest-VolumesTransfersV355Test-367660535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed9f4003-43b4-4f92-b55b-2086a78fdd10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:13:55 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-79ceccb8-be59-40e1-93a1-d00cacfb54e8 tempest-VolumesTransfersV355Test-367660535 None] Volume c0ba1d60-2f59-4bbd-9322-1be017f13fd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0ba1d60-2f59-4bbd-9322-1be017f13fd9', 'volume_size': 1} Nov 04 12:13:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-79ceccb8-be59-40e1-93a1-d00cacfb54e8 tempest-VolumesTransfersV355Test-367660535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:13:56 devstack sudo[91142]: pam_unix(sudo:session): session closed for user root Nov 04 12:13:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-6eab7e23-1cf6-4588-94d0-692c8633c01e req-45908955-64a9-4c97-894e-91f82512fb02 tempest-VolumesSnapshotsTestJSON-2053423637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c703401d-7e5d-48eb-9190-7d9167d0d79a.info" returned: 0 in 0.256s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:13:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-6eab7e23-1cf6-4588-94d0-692c8633c01e req-45908955-64a9-4c97-894e-91f82512fb02 tempest-VolumesSnapshotsTestJSON-2053423637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.415s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:13:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-79ceccb8-be59-40e1-93a1-d00cacfb54e8 tempest-VolumesTransfersV355Test-367660535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.217s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:13:56 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-79ceccb8-be59-40e1-93a1-d00cacfb54e8 tempest-VolumesTransfersV355Test-367660535 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:13:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1172868637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0ba1d60-2f59-4bbd-9322-1be017f13fd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89b98da6a98946dea1a774facdcd45b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:13:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:13:56Z,use_quota=True,user_id='230e0755d6fc4629b49dab2b440d0516',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:13:56 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-79ceccb8-be59-40e1-93a1-d00cacfb54e8 tempest-VolumesTransfersV355Test-367660535 None] Creating volume c0ba1d60-2f59-4bbd-9322-1be017f13fd9 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:13:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-79ceccb8-be59-40e1-93a1-d00cacfb54e8 tempest-VolumesTransfersV355Test-367660535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:13:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-79ceccb8-be59-40e1-93a1-d00cacfb54e8 tempest-VolumesTransfersV355Test-367660535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:13:56 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-79ceccb8-be59-40e1-93a1-d00cacfb54e8 tempest-VolumesTransfersV355Test-367660535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:13:56 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-79ceccb8-be59-40e1-93a1-d00cacfb54e8 tempest-VolumesTransfersV355Test-367660535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:13:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-79ceccb8-be59-40e1-93a1-d00cacfb54e8 tempest-VolumesTransfersV355Test-367660535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:13:56 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-79ceccb8-be59-40e1-93a1-d00cacfb54e8 tempest-VolumesTransfersV355Test-367660535 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:13:56 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-79ceccb8-be59-40e1-93a1-d00cacfb54e8 tempest-VolumesTransfersV355Test-367660535 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:13:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-79ceccb8-be59-40e1-93a1-d00cacfb54e8 tempest-VolumesTransfersV355Test-367660535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c0ba1d60-2f59-4bbd-9322-1be017f13fd9 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:13:56 devstack sudo[91145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c0ba1d60-2f59-4bbd-9322-1be017f13fd9 1073741824 Nov 04 12:13:56 devstack sudo[91145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:13:56 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-6eab7e23-1cf6-4588-94d0-692c8633c01e req-45908955-64a9-4c97-894e-91f82512fb02 tempest-VolumesSnapshotsTestJSON-2053423637 None] Create snapshot completed successfully Nov 04 12:13:56 devstack sudo[91145]: pam_unix(sudo:session): session closed for user root Nov 04 12:13:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-79ceccb8-be59-40e1-93a1-d00cacfb54e8 tempest-VolumesTransfersV355Test-367660535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c0ba1d60-2f59-4bbd-9322-1be017f13fd9 1073741824" returned: 0 in 0.434s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:13:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-79ceccb8-be59-40e1-93a1-d00cacfb54e8 tempest-VolumesTransfersV355Test-367660535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c0ba1d60-2f59-4bbd-9322-1be017f13fd9 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:13:56 devstack sudo[91151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c0ba1d60-2f59-4bbd-9322-1be017f13fd9 Nov 04 12:13:56 devstack sudo[91151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:13:56 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-da2333cb-704a-40b0-af6c-16c58be9140e tempest-AttachVolumeShelveTestJSON-176583002 None] Acquiring lock "cinder-edb55207-3f2c-44aa-b6a0-3b8afe7efee8-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:13:56 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-da2333cb-704a-40b0-af6c-16c58be9140e tempest-AttachVolumeShelveTestJSON-176583002 None] Lock "cinder-edb55207-3f2c-44aa-b6a0-3b8afe7efee8-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:13:56 devstack sudo[91151]: pam_unix(sudo:session): session closed for user root Nov 04 12:13:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-79ceccb8-be59-40e1-93a1-d00cacfb54e8 tempest-VolumesTransfersV355Test-367660535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c0ba1d60-2f59-4bbd-9322-1be017f13fd9" returned: 0 in 0.287s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:13:56 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-79ceccb8-be59-40e1-93a1-d00cacfb54e8 tempest-VolumesTransfersV355Test-367660535 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:13:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-79ceccb8-be59-40e1-93a1-d00cacfb54e8 tempest-VolumesTransfersV355Test-367660535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:13:56 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-da2333cb-704a-40b0-af6c-16c58be9140e tempest-AttachVolumeShelveTestJSON-176583002 None] Acquiring lock "cinder-quobyte-edb55207-3f2c-44aa-b6a0-3b8afe7efee8" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:13:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-79ceccb8-be59-40e1-93a1-d00cacfb54e8 tempest-VolumesTransfersV355Test-367660535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed9f4003-43b4-4f92-b55b-2086a78fdd10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0ba1d60-2f59-4bbd-9322-1be017f13fd9', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:13:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-79ceccb8-be59-40e1-93a1-d00cacfb54e8 tempest-VolumesTransfersV355Test-367660535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (170b06b2-a3e6-49e7-af23-3489ec0b273a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:13:57 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-da2333cb-704a-40b0-af6c-16c58be9140e tempest-AttachVolumeShelveTestJSON-176583002 None] Lock "cinder-quobyte-edb55207-3f2c-44aa-b6a0-3b8afe7efee8" acquired by "delete_volume" :: waited 0.030s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:13:57 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-79ceccb8-be59-40e1-93a1-d00cacfb54e8 tempest-VolumesTransfersV355Test-367660535 None] Volume volume-c0ba1d60-2f59-4bbd-9322-1be017f13fd9 (c0ba1d60-2f59-4bbd-9322-1be017f13fd9): created successfully Nov 04 12:13:57 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-79ceccb8-be59-40e1-93a1-d00cacfb54e8 tempest-VolumesTransfersV355Test-367660535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (170b06b2-a3e6-49e7-af23-3489ec0b273a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:13:57 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-79ceccb8-be59-40e1-93a1-d00cacfb54e8 tempest-VolumesTransfersV355Test-367660535 None] Flow 'volume_create_manager' (ee36ce0f-5924-4375-8f89-2f5766b5aa3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:13:57 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e20bad9-3c0a-4c5e-8922-1b4b4d2e4c43]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:13:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-da2333cb-704a-40b0-af6c-16c58be9140e tempest-AttachVolumeShelveTestJSON-176583002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-edb55207-3f2c-44aa-b6a0-3b8afe7efee8 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:13:57 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-79ceccb8-be59-40e1-93a1-d00cacfb54e8 tempest-VolumesTransfersV355Test-367660535 None] Created volume successfully. Nov 04 12:13:57 devstack sudo[91154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-edb55207-3f2c-44aa-b6a0-3b8afe7efee8 Nov 04 12:13:57 devstack sudo[91154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:13:57 devstack cinder-volume[87095]: DEBUG cinder.coordination [req-c5190069-45a6-4b71-a0da-8d8135872fbc req-aba72b1d-6958-43ec-ad08-34bb50e0c6cf tempest-VolumesSnapshotsTestJSON-2053423637 None] Acquiring lock "cinder-12bceec6-0ae0-410e-97c6-7452db480200-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:13:57 devstack cinder-volume[87095]: DEBUG cinder.coordination [req-c5190069-45a6-4b71-a0da-8d8135872fbc req-aba72b1d-6958-43ec-ad08-34bb50e0c6cf tempest-VolumesSnapshotsTestJSON-2053423637 None] Lock "cinder-12bceec6-0ae0-410e-97c6-7452db480200-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:13:57 devstack cinder-volume[87095]: DEBUG cinder.coordination [req-c5190069-45a6-4b71-a0da-8d8135872fbc req-aba72b1d-6958-43ec-ad08-34bb50e0c6cf tempest-VolumesSnapshotsTestJSON-2053423637 None] Acquiring lock "cinder-quobyte-c703401d-7e5d-48eb-9190-7d9167d0d79a" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:13:57 devstack cinder-volume[87095]: DEBUG cinder.coordination [req-c5190069-45a6-4b71-a0da-8d8135872fbc req-aba72b1d-6958-43ec-ad08-34bb50e0c6cf tempest-VolumesSnapshotsTestJSON-2053423637 None] Lock "cinder-quobyte-c703401d-7e5d-48eb-9190-7d9167d0d79a" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:13:57 devstack cinder-volume[87095]: DEBUG cinder.coordination [req-c5190069-45a6-4b71-a0da-8d8135872fbc req-aba72b1d-6958-43ec-ad08-34bb50e0c6cf tempest-VolumesSnapshotsTestJSON-2053423637 None] Acquiring lock "cinder-quobyte-12bceec6-0ae0-410e-97c6-7452db480200" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:13:57 devstack cinder-volume[87095]: DEBUG cinder.coordination [req-c5190069-45a6-4b71-a0da-8d8135872fbc req-aba72b1d-6958-43ec-ad08-34bb50e0c6cf tempest-VolumesSnapshotsTestJSON-2053423637 None] Lock "cinder-quobyte-12bceec6-0ae0-410e-97c6-7452db480200" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:13:57 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [req-c5190069-45a6-4b71-a0da-8d8135872fbc req-aba72b1d-6958-43ec-ad08-34bb50e0c6cf tempest-VolumesSnapshotsTestJSON-2053423637 None] Deleting offline snapshot 12bceec6-0ae0-410e-97c6-7452db480200 of volume c703401d-7e5d-48eb-9190-7d9167d0d79a {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 12:13:57 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [req-c5190069-45a6-4b71-a0da-8d8135872fbc req-aba72b1d-6958-43ec-ad08-34bb50e0c6cf tempest-VolumesSnapshotsTestJSON-2053423637 None] snapshot_file for this snap is: volume-c703401d-7e5d-48eb-9190-7d9167d0d79a.12bceec6-0ae0-410e-97c6-7452db480200 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 12:13:57 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[461743cb-dca6-491b-87a8-3be4e2a3be15]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:13:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-c5190069-45a6-4b71-a0da-8d8135872fbc req-aba72b1d-6958-43ec-ad08-34bb50e0c6cf tempest-VolumesSnapshotsTestJSON-2053423637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c703401d-7e5d-48eb-9190-7d9167d0d79a.12bceec6-0ae0-410e-97c6-7452db480200 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:13:57 devstack sudo[91154]: pam_unix(sudo:session): session closed for user root Nov 04 12:13:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-da2333cb-704a-40b0-af6c-16c58be9140e tempest-AttachVolumeShelveTestJSON-176583002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-edb55207-3f2c-44aa-b6a0-3b8afe7efee8" returned: 0 in 0.397s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:13:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-da2333cb-704a-40b0-af6c-16c58be9140e tempest-AttachVolumeShelveTestJSON-176583002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-edb55207-3f2c-44aa-b6a0-3b8afe7efee8 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:13:57 devstack sudo[91160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-edb55207-3f2c-44aa-b6a0-3b8afe7efee8 Nov 04 12:13:57 devstack sudo[91160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:13:57 devstack sudo[91159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c703401d-7e5d-48eb-9190-7d9167d0d79a.12bceec6-0ae0-410e-97c6-7452db480200 Nov 04 12:13:57 devstack sudo[91159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:13:57 devstack sudo[91160]: pam_unix(sudo:session): session closed for user root Nov 04 12:13:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-da2333cb-704a-40b0-af6c-16c58be9140e tempest-AttachVolumeShelveTestJSON-176583002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-edb55207-3f2c-44aa-b6a0-3b8afe7efee8" returned: 0 in 0.240s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:13:57 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-da2333cb-704a-40b0-af6c-16c58be9140e tempest-AttachVolumeShelveTestJSON-176583002 None] Lock "cinder-quobyte-edb55207-3f2c-44aa-b6a0-3b8afe7efee8" released by "delete_volume" :: held 0.686s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:13:57 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-da2333cb-704a-40b0-af6c-16c58be9140e tempest-AttachVolumeShelveTestJSON-176583002 None] Created reservations ['565cd294-5f43-4552-b82a-b2fcde4800ee', '42ff4c76-c9f2-4fe6-8243-fcbe41dd6538', '9a3a923b-ffe0-45e5-a9a9-d5b3a4a75bc3', '389ba1fe-5d8b-4a43-aadb-2c44205a669e'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:13:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-da2333cb-704a-40b0-af6c-16c58be9140e tempest-AttachVolumeShelveTestJSON-176583002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:13:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-da2333cb-704a-40b0-af6c-16c58be9140e tempest-AttachVolumeShelveTestJSON-176583002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:13:57 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-da2333cb-704a-40b0-af6c-16c58be9140e tempest-AttachVolumeShelveTestJSON-176583002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:13:57 devstack sudo[91159]: pam_unix(sudo:session): session closed for user root Nov 04 12:13:57 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-da2333cb-704a-40b0-af6c-16c58be9140e tempest-AttachVolumeShelveTestJSON-176583002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:13:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-da2333cb-704a-40b0-af6c-16c58be9140e tempest-AttachVolumeShelveTestJSON-176583002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:13:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-da2333cb-704a-40b0-af6c-16c58be9140e tempest-AttachVolumeShelveTestJSON-176583002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:13:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-c5190069-45a6-4b71-a0da-8d8135872fbc req-aba72b1d-6958-43ec-ad08-34bb50e0c6cf tempest-VolumesSnapshotsTestJSON-2053423637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c703401d-7e5d-48eb-9190-7d9167d0d79a.12bceec6-0ae0-410e-97c6-7452db480200" returned: 0 in 0.394s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:13:57 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [req-c5190069-45a6-4b71-a0da-8d8135872fbc req-aba72b1d-6958-43ec-ad08-34bb50e0c6cf tempest-VolumesSnapshotsTestJSON-2053423637 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c703401d-7e5d-48eb-9190-7d9167d0d79a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 12:13:57 devstack sudo[91167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:13:57 devstack sudo[91167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:13:57 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1cf4d6c-0968-4440-af21-8bce5a17799d]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:13:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-c5190069-45a6-4b71-a0da-8d8135872fbc req-aba72b1d-6958-43ec-ad08-34bb50e0c6cf tempest-VolumesSnapshotsTestJSON-2053423637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c703401d-7e5d-48eb-9190-7d9167d0d79a {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:13:57 devstack sudo[91169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c703401d-7e5d-48eb-9190-7d9167d0d79a Nov 04 12:13:57 devstack sudo[91169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:13:58 devstack sudo[91167]: pam_unix(sudo:session): session closed for user root Nov 04 12:13:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-da2333cb-704a-40b0-af6c-16c58be9140e tempest-AttachVolumeShelveTestJSON-176583002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.343s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:13:58 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-da2333cb-704a-40b0-af6c-16c58be9140e tempest-AttachVolumeShelveTestJSON-176583002 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:13:58 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-da2333cb-704a-40b0-af6c-16c58be9140e tempest-AttachVolumeShelveTestJSON-176583002 None] Deleted volume successfully. Nov 04 12:13:58 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-da2333cb-704a-40b0-af6c-16c58be9140e tempest-AttachVolumeShelveTestJSON-176583002 None] Lock "cinder-edb55207-3f2c-44aa-b6a0-3b8afe7efee8-delete_volume" released by "delete_volume" :: held 1.276s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:13:58 devstack sudo[91169]: pam_unix(sudo:session): session closed for user root Nov 04 12:13:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-c5190069-45a6-4b71-a0da-8d8135872fbc req-aba72b1d-6958-43ec-ad08-34bb50e0c6cf tempest-VolumesSnapshotsTestJSON-2053423637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c703401d-7e5d-48eb-9190-7d9167d0d79a" returned: 0 in 0.407s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:13:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-c5190069-45a6-4b71-a0da-8d8135872fbc req-aba72b1d-6958-43ec-ad08-34bb50e0c6cf tempest-VolumesSnapshotsTestJSON-2053423637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c703401d-7e5d-48eb-9190-7d9167d0d79a.12bceec6-0ae0-410e-97c6-7452db480200 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:13:58 devstack sudo[91176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c703401d-7e5d-48eb-9190-7d9167d0d79a.12bceec6-0ae0-410e-97c6-7452db480200 Nov 04 12:13:58 devstack sudo[91176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:13:58 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-1880f267-c2a4-4d51-a8b8-8d4d0396658e tempest-VolumesTransfersV355Test-1332255060 None] Acquiring lock "cinder-c0ba1d60-2f59-4bbd-9322-1be017f13fd9-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:13:58 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-1880f267-c2a4-4d51-a8b8-8d4d0396658e tempest-VolumesTransfersV355Test-1332255060 None] Lock "cinder-c0ba1d60-2f59-4bbd-9322-1be017f13fd9-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:13:58 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-1880f267-c2a4-4d51-a8b8-8d4d0396658e tempest-VolumesTransfersV355Test-1332255060 None] Acquiring lock "cinder-quobyte-c0ba1d60-2f59-4bbd-9322-1be017f13fd9" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:13:58 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-1880f267-c2a4-4d51-a8b8-8d4d0396658e tempest-VolumesTransfersV355Test-1332255060 None] Lock "cinder-quobyte-c0ba1d60-2f59-4bbd-9322-1be017f13fd9" acquired by "delete_volume" :: waited 0.025s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:13:58 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3bad0bd-b07a-401e-bed9-467a25a4f82e]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:13:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1880f267-c2a4-4d51-a8b8-8d4d0396658e tempest-VolumesTransfersV355Test-1332255060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c0ba1d60-2f59-4bbd-9322-1be017f13fd9 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:13:58 devstack sudo[91178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c0ba1d60-2f59-4bbd-9322-1be017f13fd9 Nov 04 12:13:58 devstack sudo[91178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:13:58 devstack sudo[91176]: pam_unix(sudo:session): session closed for user root Nov 04 12:13:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-c5190069-45a6-4b71-a0da-8d8135872fbc req-aba72b1d-6958-43ec-ad08-34bb50e0c6cf tempest-VolumesSnapshotsTestJSON-2053423637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c703401d-7e5d-48eb-9190-7d9167d0d79a.12bceec6-0ae0-410e-97c6-7452db480200" returned: 0 in 0.424s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:13:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-c5190069-45a6-4b71-a0da-8d8135872fbc req-aba72b1d-6958-43ec-ad08-34bb50e0c6cf tempest-VolumesSnapshotsTestJSON-2053423637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c703401d-7e5d-48eb-9190-7d9167d0d79a.12bceec6-0ae0-410e-97c6-7452db480200 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:13:58 devstack sudo[91183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c703401d-7e5d-48eb-9190-7d9167d0d79a.12bceec6-0ae0-410e-97c6-7452db480200 Nov 04 12:13:58 devstack sudo[91183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:13:58 devstack sudo[91178]: pam_unix(sudo:session): session closed for user root Nov 04 12:13:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1880f267-c2a4-4d51-a8b8-8d4d0396658e tempest-VolumesTransfersV355Test-1332255060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c0ba1d60-2f59-4bbd-9322-1be017f13fd9" returned: 0 in 0.382s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:13:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1880f267-c2a4-4d51-a8b8-8d4d0396658e tempest-VolumesTransfersV355Test-1332255060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c0ba1d60-2f59-4bbd-9322-1be017f13fd9 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:13:58 devstack sudo[91188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c0ba1d60-2f59-4bbd-9322-1be017f13fd9 Nov 04 12:13:58 devstack sudo[91188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:13:58 devstack sudo[91183]: pam_unix(sudo:session): session closed for user root Nov 04 12:13:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-c5190069-45a6-4b71-a0da-8d8135872fbc req-aba72b1d-6958-43ec-ad08-34bb50e0c6cf tempest-VolumesSnapshotsTestJSON-2053423637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c703401d-7e5d-48eb-9190-7d9167d0d79a.12bceec6-0ae0-410e-97c6-7452db480200" returned: 0 in 0.276s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:13:59 devstack cinder-volume[87095]: DEBUG cinder.coordination [req-c5190069-45a6-4b71-a0da-8d8135872fbc req-aba72b1d-6958-43ec-ad08-34bb50e0c6cf tempest-VolumesSnapshotsTestJSON-2053423637 None] Lock "cinder-quobyte-12bceec6-0ae0-410e-97c6-7452db480200" released by "_delete_snapshot" :: held 1.640s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:13:59 devstack cinder-volume[87095]: DEBUG cinder.coordination [req-c5190069-45a6-4b71-a0da-8d8135872fbc req-aba72b1d-6958-43ec-ad08-34bb50e0c6cf tempest-VolumesSnapshotsTestJSON-2053423637 None] Lock "cinder-quobyte-c703401d-7e5d-48eb-9190-7d9167d0d79a" released by "delete_snapshot" :: held 1.681s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:13:59 devstack cinder-volume[87095]: DEBUG cinder.quota [req-c5190069-45a6-4b71-a0da-8d8135872fbc req-aba72b1d-6958-43ec-ad08-34bb50e0c6cf tempest-VolumesSnapshotsTestJSON-2053423637 None] Created reservations ['fab8444a-0c88-4ae3-b0e7-fefc22ebf59e', '8f7658be-73fd-4dcd-a7d7-167aaa69a25a', '22b85441-b5b7-4188-b231-2857281c74f6', '1a0bcc2a-d9fe-4a31-846b-3ea9d0133f0e'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:13:59 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-c5190069-45a6-4b71-a0da-8d8135872fbc req-aba72b1d-6958-43ec-ad08-34bb50e0c6cf tempest-VolumesSnapshotsTestJSON-2053423637 None] Delete snapshot completed successfully. Nov 04 12:13:59 devstack cinder-volume[87095]: DEBUG cinder.coordination [req-c5190069-45a6-4b71-a0da-8d8135872fbc req-aba72b1d-6958-43ec-ad08-34bb50e0c6cf tempest-VolumesSnapshotsTestJSON-2053423637 None] Lock "cinder-12bceec6-0ae0-410e-97c6-7452db480200-delete_snapshot" released by "delete_snapshot" :: held 1.844s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:13:59 devstack sudo[91188]: pam_unix(sudo:session): session closed for user root Nov 04 12:13:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1880f267-c2a4-4d51-a8b8-8d4d0396658e tempest-VolumesTransfersV355Test-1332255060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c0ba1d60-2f59-4bbd-9322-1be017f13fd9" returned: 0 in 0.320s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:13:59 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-1880f267-c2a4-4d51-a8b8-8d4d0396658e tempest-VolumesTransfersV355Test-1332255060 None] Lock "cinder-quobyte-c0ba1d60-2f59-4bbd-9322-1be017f13fd9" released by "delete_volume" :: held 0.754s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:13:59 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-1880f267-c2a4-4d51-a8b8-8d4d0396658e tempest-VolumesTransfersV355Test-1332255060 None] Created reservations ['b9448bc6-8fcb-4d30-aea1-1eccf6aee5b6', '8af6f47c-0947-4baa-93e9-a6100d933142', '2949de65-9f77-43ce-8dcb-7bc63836af46', '0e3ef952-6705-4afb-8356-cbbba4c2721a'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:13:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1880f267-c2a4-4d51-a8b8-8d4d0396658e tempest-VolumesTransfersV355Test-1332255060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:13:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1880f267-c2a4-4d51-a8b8-8d4d0396658e tempest-VolumesTransfersV355Test-1332255060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:13:59 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1880f267-c2a4-4d51-a8b8-8d4d0396658e tempest-VolumesTransfersV355Test-1332255060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:13:59 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1880f267-c2a4-4d51-a8b8-8d4d0396658e tempest-VolumesTransfersV355Test-1332255060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:13:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1880f267-c2a4-4d51-a8b8-8d4d0396658e tempest-VolumesTransfersV355Test-1332255060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:13:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1880f267-c2a4-4d51-a8b8-8d4d0396658e tempest-VolumesTransfersV355Test-1332255060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:13:59 devstack sudo[91192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:13:59 devstack sudo[91192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:13:59 devstack sudo[91192]: pam_unix(sudo:session): session closed for user root Nov 04 12:13:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1880f267-c2a4-4d51-a8b8-8d4d0396658e tempest-VolumesTransfersV355Test-1332255060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.265s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:13:59 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-1880f267-c2a4-4d51-a8b8-8d4d0396658e tempest-VolumesTransfersV355Test-1332255060 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:13:59 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-1880f267-c2a4-4d51-a8b8-8d4d0396658e tempest-VolumesTransfersV355Test-1332255060 None] Deleted volume successfully. Nov 04 12:13:59 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-1880f267-c2a4-4d51-a8b8-8d4d0396658e tempest-VolumesTransfersV355Test-1332255060 None] Lock "cinder-c0ba1d60-2f59-4bbd-9322-1be017f13fd9-delete_volume" released by "delete_volume" :: held 1.252s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:13:59 devstack cinder-volume[87095]: DEBUG cinder.coordination [req-06dada35-e7ea-4812-a295-806b9364e304 req-344b67d8-3a9d-4f76-963b-b5a8a4e60275 tempest-VolumesSnapshotsTestJSON-2053423637 None] Acquiring lock "cinder-c703401d-7e5d-48eb-9190-7d9167d0d79a-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:13:59 devstack cinder-volume[87095]: DEBUG cinder.coordination [req-06dada35-e7ea-4812-a295-806b9364e304 req-344b67d8-3a9d-4f76-963b-b5a8a4e60275 tempest-VolumesSnapshotsTestJSON-2053423637 None] Lock "cinder-c703401d-7e5d-48eb-9190-7d9167d0d79a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:13:59 devstack cinder-volume[87095]: DEBUG cinder.coordination [req-06dada35-e7ea-4812-a295-806b9364e304 req-344b67d8-3a9d-4f76-963b-b5a8a4e60275 tempest-VolumesSnapshotsTestJSON-2053423637 None] Acquiring lock "cinder-quobyte-c703401d-7e5d-48eb-9190-7d9167d0d79a" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:13:59 devstack cinder-volume[87095]: DEBUG cinder.coordination [req-06dada35-e7ea-4812-a295-806b9364e304 req-344b67d8-3a9d-4f76-963b-b5a8a4e60275 tempest-VolumesSnapshotsTestJSON-2053423637 None] Lock "cinder-quobyte-c703401d-7e5d-48eb-9190-7d9167d0d79a" acquired by "delete_volume" :: waited 0.026s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:13:59 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[15bfe928-f5b7-49bb-ab30-82c35b59bd10]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:13:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-06dada35-e7ea-4812-a295-806b9364e304 req-344b67d8-3a9d-4f76-963b-b5a8a4e60275 tempest-VolumesSnapshotsTestJSON-2053423637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c703401d-7e5d-48eb-9190-7d9167d0d79a {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:13:59 devstack sudo[91196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c703401d-7e5d-48eb-9190-7d9167d0d79a Nov 04 12:13:59 devstack sudo[91196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:00 devstack sudo[91196]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-06dada35-e7ea-4812-a295-806b9364e304 req-344b67d8-3a9d-4f76-963b-b5a8a4e60275 tempest-VolumesSnapshotsTestJSON-2053423637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c703401d-7e5d-48eb-9190-7d9167d0d79a" returned: 0 in 0.434s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-06dada35-e7ea-4812-a295-806b9364e304 req-344b67d8-3a9d-4f76-963b-b5a8a4e60275 tempest-VolumesSnapshotsTestJSON-2053423637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c703401d-7e5d-48eb-9190-7d9167d0d79a {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:00 devstack sudo[91202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c703401d-7e5d-48eb-9190-7d9167d0d79a Nov 04 12:14:00 devstack sudo[91202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:00 devstack sudo[91202]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-06dada35-e7ea-4812-a295-806b9364e304 req-344b67d8-3a9d-4f76-963b-b5a8a4e60275 tempest-VolumesSnapshotsTestJSON-2053423637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c703401d-7e5d-48eb-9190-7d9167d0d79a" returned: 0 in 0.273s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:00 devstack cinder-volume[87095]: DEBUG cinder.coordination [req-06dada35-e7ea-4812-a295-806b9364e304 req-344b67d8-3a9d-4f76-963b-b5a8a4e60275 tempest-VolumesSnapshotsTestJSON-2053423637 None] Lock "cinder-quobyte-c703401d-7e5d-48eb-9190-7d9167d0d79a" released by "delete_volume" :: held 0.816s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:14:00 devstack cinder-volume[87095]: DEBUG cinder.quota [req-06dada35-e7ea-4812-a295-806b9364e304 req-344b67d8-3a9d-4f76-963b-b5a8a4e60275 tempest-VolumesSnapshotsTestJSON-2053423637 None] Created reservations ['e833a061-9254-407d-ab5c-98ef053486a8', 'a3cab962-f15f-43f1-9993-10be469c0a20', '63972b96-8315-417e-a8f8-e528be3a500a', '7ef37cf3-df61-4413-a025-6b59a63d34b0'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:14:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-06dada35-e7ea-4812-a295-806b9364e304 req-344b67d8-3a9d-4f76-963b-b5a8a4e60275 tempest-VolumesSnapshotsTestJSON-2053423637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:14:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-06dada35-e7ea-4812-a295-806b9364e304 req-344b67d8-3a9d-4f76-963b-b5a8a4e60275 tempest-VolumesSnapshotsTestJSON-2053423637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:14:00 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [req-06dada35-e7ea-4812-a295-806b9364e304 req-344b67d8-3a9d-4f76-963b-b5a8a4e60275 tempest-VolumesSnapshotsTestJSON-2053423637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:14:00 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [req-06dada35-e7ea-4812-a295-806b9364e304 req-344b67d8-3a9d-4f76-963b-b5a8a4e60275 tempest-VolumesSnapshotsTestJSON-2053423637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:14:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-06dada35-e7ea-4812-a295-806b9364e304 req-344b67d8-3a9d-4f76-963b-b5a8a4e60275 tempest-VolumesSnapshotsTestJSON-2053423637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:14:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-06dada35-e7ea-4812-a295-806b9364e304 req-344b67d8-3a9d-4f76-963b-b5a8a4e60275 tempest-VolumesSnapshotsTestJSON-2053423637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:00 devstack sudo[91205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:14:00 devstack sudo[91205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:01 devstack sudo[91205]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-06dada35-e7ea-4812-a295-806b9364e304 req-344b67d8-3a9d-4f76-963b-b5a8a4e60275 tempest-VolumesSnapshotsTestJSON-2053423637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.354s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:01 devstack cinder-volume[87095]: DEBUG cinder.manager [req-06dada35-e7ea-4812-a295-806b9364e304 req-344b67d8-3a9d-4f76-963b-b5a8a4e60275 tempest-VolumesSnapshotsTestJSON-2053423637 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:14:01 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-06dada35-e7ea-4812-a295-806b9364e304 req-344b67d8-3a9d-4f76-963b-b5a8a4e60275 tempest-VolumesSnapshotsTestJSON-2053423637 None] Deleted volume successfully. Nov 04 12:14:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [req-06dada35-e7ea-4812-a295-806b9364e304 req-344b67d8-3a9d-4f76-963b-b5a8a4e60275 tempest-VolumesSnapshotsTestJSON-2053423637 None] Lock "cinder-c703401d-7e5d-48eb-9190-7d9167d0d79a-delete_volume" released by "delete_volume" :: held 1.441s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:14:01 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 12:14:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:14:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:14:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:14:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:14:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:14:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:01 devstack sudo[91208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:14:01 devstack sudo[91208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:02 devstack sudo[91208]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.346s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:02 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:14:02 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Running periodic task VolumeManager._thread_info {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 12:14:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] thread count: 8 {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 12:14:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] thread info: [<_MainThread(MainThread, started 140610387472512)>, , , , , , , ] {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 12:14:06 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=85,cinder:UPDATE=110,cinder:INSERT=26,cinder:DELETE=10 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 12:14:06 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=83,cinder:INSERT=24,cinder:UPDATE=98,cinder:DELETE=8 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 12:14:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-4457fb31-a7cd-42e9-86f7-e72596e29548 req-57dee4ac-1139-4570-b51a-d6ac4efc35d9 tempest-ServerActionsTestOtherA-1526177158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:14:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-4457fb31-a7cd-42e9-86f7-e72596e29548 req-57dee4ac-1139-4570-b51a-d6ac4efc35d9 tempest-ServerActionsTestOtherA-1526177158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:14:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-4457fb31-a7cd-42e9-86f7-e72596e29548 req-57dee4ac-1139-4570-b51a-d6ac4efc35d9 tempest-ServerActionsTestOtherA-1526177158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:14:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-4457fb31-a7cd-42e9-86f7-e72596e29548 req-57dee4ac-1139-4570-b51a-d6ac4efc35d9 tempest-ServerActionsTestOtherA-1526177158 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784', 'name': 'volume-6e3403eb-f6e0-483a-9467-55820ca11ec9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '69504058-ae6d-4857-aca2-e2a8fc420a87', 'enforce_multipath': True} {{(pid=87095) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 12:14:06 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-4457fb31-a7cd-42e9-86f7-e72596e29548 req-57dee4ac-1139-4570-b51a-d6ac4efc35d9 tempest-ServerActionsTestOtherA-1526177158 None] attachment_update completed successfully. Nov 04 12:14:08 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [req-8a75af87-a8f1-4a27-baf2-916274dd3fc9 req-81ea62d3-b497-4376-a2f9-7e958c6916cf tempest-VolumesGetTestJSON-741973643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:14:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-8a75af87-a8f1-4a27-baf2-916274dd3fc9 req-81ea62d3-b497-4376-a2f9-7e958c6916cf tempest-VolumesGetTestJSON-741973643 None] Flow 'volume_create_manager' (78edb193-a5b9-4e59-be09-97a2ffe5d190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:14:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-8a75af87-a8f1-4a27-baf2-916274dd3fc9 req-81ea62d3-b497-4376-a2f9-7e958c6916cf tempest-VolumesGetTestJSON-741973643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a23a5fd-a82a-4d28-8eda-e944be83226d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:14:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-8a75af87-a8f1-4a27-baf2-916274dd3fc9 req-81ea62d3-b497-4376-a2f9-7e958c6916cf tempest-VolumesGetTestJSON-741973643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a23a5fd-a82a-4d28-8eda-e944be83226d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:14:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-696460039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3725af69-e62f-4ca0-8325-94b89e31fe84,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9a48a312790f42efa266e3855334bf68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:14:08Z,use_quota=True,user_id='40520afb3ae64a7f841d194fe0572602',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:14:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-8a75af87-a8f1-4a27-baf2-916274dd3fc9 req-81ea62d3-b497-4376-a2f9-7e958c6916cf tempest-VolumesGetTestJSON-741973643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f541e4c6-576c-4cb9-bb7e-25d5b5e964bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:14:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-8a75af87-a8f1-4a27-baf2-916274dd3fc9 req-81ea62d3-b497-4376-a2f9-7e958c6916cf tempest-VolumesGetTestJSON-741973643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f541e4c6-576c-4cb9-bb7e-25d5b5e964bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:14:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-8a75af87-a8f1-4a27-baf2-916274dd3fc9 req-81ea62d3-b497-4376-a2f9-7e958c6916cf tempest-VolumesGetTestJSON-741973643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (954e86d8-498b-4cb7-ada8-76adc904f08c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:14:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-8a75af87-a8f1-4a27-baf2-916274dd3fc9 req-81ea62d3-b497-4376-a2f9-7e958c6916cf tempest-VolumesGetTestJSON-741973643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (954e86d8-498b-4cb7-ada8-76adc904f08c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3725af69-e62f-4ca0-8325-94b89e31fe84', 'volume_name': 'volume-3725af69-e62f-4ca0-8325-94b89e31fe84', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:14:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-8a75af87-a8f1-4a27-baf2-916274dd3fc9 req-81ea62d3-b497-4376-a2f9-7e958c6916cf tempest-VolumesGetTestJSON-741973643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b7e1634-40f6-4220-bab7-e93a1721a4ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:14:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-8a75af87-a8f1-4a27-baf2-916274dd3fc9 req-81ea62d3-b497-4376-a2f9-7e958c6916cf tempest-VolumesGetTestJSON-741973643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b7e1634-40f6-4220-bab7-e93a1721a4ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:14:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-8a75af87-a8f1-4a27-baf2-916274dd3fc9 req-81ea62d3-b497-4376-a2f9-7e958c6916cf tempest-VolumesGetTestJSON-741973643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7b036c9-38fa-4544-9d86-bc61e165c3d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:14:08 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [req-8a75af87-a8f1-4a27-baf2-916274dd3fc9 req-81ea62d3-b497-4376-a2f9-7e958c6916cf tempest-VolumesGetTestJSON-741973643 None] Volume 3725af69-e62f-4ca0-8325-94b89e31fe84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3725af69-e62f-4ca0-8325-94b89e31fe84', 'volume_size': 1} Nov 04 12:14:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-8a75af87-a8f1-4a27-baf2-916274dd3fc9 req-81ea62d3-b497-4376-a2f9-7e958c6916cf tempest-VolumesGetTestJSON-741973643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:14:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-8a75af87-a8f1-4a27-baf2-916274dd3fc9 req-81ea62d3-b497-4376-a2f9-7e958c6916cf tempest-VolumesGetTestJSON-741973643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:14:08 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [req-8a75af87-a8f1-4a27-baf2-916274dd3fc9 req-81ea62d3-b497-4376-a2f9-7e958c6916cf tempest-VolumesGetTestJSON-741973643 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:14:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-696460039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3725af69-e62f-4ca0-8325-94b89e31fe84,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9a48a312790f42efa266e3855334bf68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:14:08Z,use_quota=True,user_id='40520afb3ae64a7f841d194fe0572602',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:14:08 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [req-8a75af87-a8f1-4a27-baf2-916274dd3fc9 req-81ea62d3-b497-4376-a2f9-7e958c6916cf tempest-VolumesGetTestJSON-741973643 None] Creating volume 3725af69-e62f-4ca0-8325-94b89e31fe84 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:14:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-8a75af87-a8f1-4a27-baf2-916274dd3fc9 req-81ea62d3-b497-4376-a2f9-7e958c6916cf tempest-VolumesGetTestJSON-741973643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:14:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-8a75af87-a8f1-4a27-baf2-916274dd3fc9 req-81ea62d3-b497-4376-a2f9-7e958c6916cf tempest-VolumesGetTestJSON-741973643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:14:08 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [req-8a75af87-a8f1-4a27-baf2-916274dd3fc9 req-81ea62d3-b497-4376-a2f9-7e958c6916cf tempest-VolumesGetTestJSON-741973643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:14:08 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [req-8a75af87-a8f1-4a27-baf2-916274dd3fc9 req-81ea62d3-b497-4376-a2f9-7e958c6916cf tempest-VolumesGetTestJSON-741973643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:14:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-8a75af87-a8f1-4a27-baf2-916274dd3fc9 req-81ea62d3-b497-4376-a2f9-7e958c6916cf tempest-VolumesGetTestJSON-741973643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:14:08 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [req-8a75af87-a8f1-4a27-baf2-916274dd3fc9 req-81ea62d3-b497-4376-a2f9-7e958c6916cf tempest-VolumesGetTestJSON-741973643 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:14:08 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [req-8a75af87-a8f1-4a27-baf2-916274dd3fc9 req-81ea62d3-b497-4376-a2f9-7e958c6916cf tempest-VolumesGetTestJSON-741973643 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:14:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-8a75af87-a8f1-4a27-baf2-916274dd3fc9 req-81ea62d3-b497-4376-a2f9-7e958c6916cf tempest-VolumesGetTestJSON-741973643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-3725af69-e62f-4ca0-8325-94b89e31fe84 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ca40d2f4-4dcb-44df-ba5b-b90c7195264b tempest-BackendsCapabilitiesAdminTestsJSON-249943911 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6071128845215, 'free_capacity_gb': 1773.6071128845215, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87095) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 04 12:14:08 devstack sudo[91645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-3725af69-e62f-4ca0-8325-94b89e31fe84 1073741824 Nov 04 12:14:08 devstack sudo[91645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8f08f8c1-ab27-44b0-9ee0-c508851dadd1 tempest-BackendsCapabilitiesAdminTestsJSON-249943911 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6071128845215, 'free_capacity_gb': 1773.6071128845215, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87095) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 04 12:14:09 devstack sudo[91645]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-8a75af87-a8f1-4a27-baf2-916274dd3fc9 req-81ea62d3-b497-4376-a2f9-7e958c6916cf tempest-VolumesGetTestJSON-741973643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-3725af69-e62f-4ca0-8325-94b89e31fe84 1073741824" returned: 0 in 0.664s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-8a75af87-a8f1-4a27-baf2-916274dd3fc9 req-81ea62d3-b497-4376-a2f9-7e958c6916cf tempest-VolumesGetTestJSON-741973643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-3725af69-e62f-4ca0-8325-94b89e31fe84 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:09 devstack sudo[91651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-3725af69-e62f-4ca0-8325-94b89e31fe84 Nov 04 12:14:09 devstack sudo[91651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:09 devstack sudo[91651]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-8a75af87-a8f1-4a27-baf2-916274dd3fc9 req-81ea62d3-b497-4376-a2f9-7e958c6916cf tempest-VolumesGetTestJSON-741973643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-3725af69-e62f-4ca0-8325-94b89e31fe84" returned: 0 in 0.352s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:09 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [req-8a75af87-a8f1-4a27-baf2-916274dd3fc9 req-81ea62d3-b497-4376-a2f9-7e958c6916cf tempest-VolumesGetTestJSON-741973643 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:14:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-8a75af87-a8f1-4a27-baf2-916274dd3fc9 req-81ea62d3-b497-4376-a2f9-7e958c6916cf tempest-VolumesGetTestJSON-741973643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:14:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-8a75af87-a8f1-4a27-baf2-916274dd3fc9 req-81ea62d3-b497-4376-a2f9-7e958c6916cf tempest-VolumesGetTestJSON-741973643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7b036c9-38fa-4544-9d86-bc61e165c3d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3725af69-e62f-4ca0-8325-94b89e31fe84', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:14:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-8a75af87-a8f1-4a27-baf2-916274dd3fc9 req-81ea62d3-b497-4376-a2f9-7e958c6916cf tempest-VolumesGetTestJSON-741973643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05c9985f-1493-4deb-ad40-8c03999e113f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:14:09 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [req-8a75af87-a8f1-4a27-baf2-916274dd3fc9 req-81ea62d3-b497-4376-a2f9-7e958c6916cf tempest-VolumesGetTestJSON-741973643 None] Volume volume-3725af69-e62f-4ca0-8325-94b89e31fe84 (3725af69-e62f-4ca0-8325-94b89e31fe84): created successfully Nov 04 12:14:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-8a75af87-a8f1-4a27-baf2-916274dd3fc9 req-81ea62d3-b497-4376-a2f9-7e958c6916cf tempest-VolumesGetTestJSON-741973643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05c9985f-1493-4deb-ad40-8c03999e113f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:14:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-8a75af87-a8f1-4a27-baf2-916274dd3fc9 req-81ea62d3-b497-4376-a2f9-7e958c6916cf tempest-VolumesGetTestJSON-741973643 None] Flow 'volume_create_manager' (78edb193-a5b9-4e59-be09-97a2ffe5d190) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:14:09 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-8a75af87-a8f1-4a27-baf2-916274dd3fc9 req-81ea62d3-b497-4376-a2f9-7e958c6916cf tempest-VolumesGetTestJSON-741973643 None] Created volume successfully. Nov 04 12:14:11 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-94bd534a-7fec-4792-b6af-f297661e85ed req-a083e0c9-830a-46bc-94a3-33213ac77e52 tempest-ServerActionsTestOtherA-1526177158 None] Terminate volume connection completed successfully. Nov 04 12:14:11 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-94bd534a-7fec-4792-b6af-f297661e85ed req-a083e0c9-830a-46bc-94a3-33213ac77e52 tempest-ServerActionsTestOtherA-1526177158 None] Deleting attachment 69504058-ae6d-4857-aca2-e2a8fc420a87. {{(pid=87095) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 12:14:11 devstack cinder-volume[87095]: DEBUG cinder.coordination [req-65358789-9537-4e18-a138-5d6973d53a19 req-9762e422-e6be-44d6-8e77-61387cdd510d tempest-VolumesGetTestJSON-741973643 None] Acquiring lock "cinder-3725af69-e62f-4ca0-8325-94b89e31fe84-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:14:11 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9067077-83e4-460c-9275-b71190ca9369 tempest-VolumesTransfersV357Test-1762052666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:14:11 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c9067077-83e4-460c-9275-b71190ca9369 tempest-VolumesTransfersV357Test-1762052666 None] Flow 'volume_create_manager' (5a3598a3-4763-4ef6-aa52-fb6db5b13ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:14:11 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c9067077-83e4-460c-9275-b71190ca9369 tempest-VolumesTransfersV357Test-1762052666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3b32d2e-33af-439b-87b8-8c4884ae7926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:14:11 devstack cinder-volume[87095]: DEBUG cinder.coordination [req-65358789-9537-4e18-a138-5d6973d53a19 req-9762e422-e6be-44d6-8e77-61387cdd510d tempest-VolumesGetTestJSON-741973643 None] Lock "cinder-3725af69-e62f-4ca0-8325-94b89e31fe84-delete_volume" acquired by "delete_volume" :: waited 0.099s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:14:11 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c9067077-83e4-460c-9275-b71190ca9369 tempest-VolumesTransfersV357Test-1762052666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3b32d2e-33af-439b-87b8-8c4884ae7926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:14:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2020359718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdb646d1-a798-4450-ab1a-9ca0b0944f0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56550d40138642b5b2857f30738e5f0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:14:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:14:11Z,use_quota=True,user_id='54673b09c5aa48caadd7a29db3d7cc9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:14:11 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c9067077-83e4-460c-9275-b71190ca9369 tempest-VolumesTransfersV357Test-1762052666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e66db15-1420-4587-a228-e1eccd9d2707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:14:11 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c9067077-83e4-460c-9275-b71190ca9369 tempest-VolumesTransfersV357Test-1762052666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e66db15-1420-4587-a228-e1eccd9d2707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:14:11 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c9067077-83e4-460c-9275-b71190ca9369 tempest-VolumesTransfersV357Test-1762052666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34d079b2-f147-40a1-af88-ec70579b0736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:14:11 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c9067077-83e4-460c-9275-b71190ca9369 tempest-VolumesTransfersV357Test-1762052666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34d079b2-f147-40a1-af88-ec70579b0736) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdb646d1-a798-4450-ab1a-9ca0b0944f0a', 'volume_name': 'volume-bdb646d1-a798-4450-ab1a-9ca0b0944f0a', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:14:11 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c9067077-83e4-460c-9275-b71190ca9369 tempest-VolumesTransfersV357Test-1762052666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a99ab1ce-d241-4b23-9dd3-7cda81fd2d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:14:11 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c9067077-83e4-460c-9275-b71190ca9369 tempest-VolumesTransfersV357Test-1762052666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a99ab1ce-d241-4b23-9dd3-7cda81fd2d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:14:11 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c9067077-83e4-460c-9275-b71190ca9369 tempest-VolumesTransfersV357Test-1762052666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea19903b-5e42-4ee8-a310-bcf6a4e66257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:14:11 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-c9067077-83e4-460c-9275-b71190ca9369 tempest-VolumesTransfersV357Test-1762052666 None] Volume bdb646d1-a798-4450-ab1a-9ca0b0944f0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdb646d1-a798-4450-ab1a-9ca0b0944f0a', 'volume_size': 1} Nov 04 12:14:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c9067077-83e4-460c-9275-b71190ca9369 tempest-VolumesTransfersV357Test-1762052666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:14:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c9067077-83e4-460c-9275-b71190ca9369 tempest-VolumesTransfersV357Test-1762052666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:14:11 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c9067077-83e4-460c-9275-b71190ca9369 tempest-VolumesTransfersV357Test-1762052666 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:14:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2020359718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdb646d1-a798-4450-ab1a-9ca0b0944f0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56550d40138642b5b2857f30738e5f0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:14:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:14:11Z,use_quota=True,user_id='54673b09c5aa48caadd7a29db3d7cc9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:14:11 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-c9067077-83e4-460c-9275-b71190ca9369 tempest-VolumesTransfersV357Test-1762052666 None] Creating volume bdb646d1-a798-4450-ab1a-9ca0b0944f0a {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:14:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c9067077-83e4-460c-9275-b71190ca9369 tempest-VolumesTransfersV357Test-1762052666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:14:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c9067077-83e4-460c-9275-b71190ca9369 tempest-VolumesTransfersV357Test-1762052666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:14:11 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c9067077-83e4-460c-9275-b71190ca9369 tempest-VolumesTransfersV357Test-1762052666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:14:11 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c9067077-83e4-460c-9275-b71190ca9369 tempest-VolumesTransfersV357Test-1762052666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:14:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c9067077-83e4-460c-9275-b71190ca9369 tempest-VolumesTransfersV357Test-1762052666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:14:11 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c9067077-83e4-460c-9275-b71190ca9369 tempest-VolumesTransfersV357Test-1762052666 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:14:11 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-c9067077-83e4-460c-9275-b71190ca9369 tempest-VolumesTransfersV357Test-1762052666 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:14:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c9067077-83e4-460c-9275-b71190ca9369 tempest-VolumesTransfersV357Test-1762052666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bdb646d1-a798-4450-ab1a-9ca0b0944f0a 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:11 devstack sudo[91701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bdb646d1-a798-4450-ab1a-9ca0b0944f0a 1073741824 Nov 04 12:14:11 devstack sudo[91701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:11 devstack cinder-volume[87095]: DEBUG cinder.coordination [req-65358789-9537-4e18-a138-5d6973d53a19 req-9762e422-e6be-44d6-8e77-61387cdd510d tempest-VolumesGetTestJSON-741973643 None] Acquiring lock "cinder-quobyte-3725af69-e62f-4ca0-8325-94b89e31fe84" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:14:11 devstack cinder-volume[87095]: DEBUG cinder.coordination [req-65358789-9537-4e18-a138-5d6973d53a19 req-9762e422-e6be-44d6-8e77-61387cdd510d tempest-VolumesGetTestJSON-741973643 None] Lock "cinder-quobyte-3725af69-e62f-4ca0-8325-94b89e31fe84" acquired by "delete_volume" :: waited 0.036s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:14:11 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf0ebfbc-3d59-4360-8c68-5a9e402c34ad]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:14:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-65358789-9537-4e18-a138-5d6973d53a19 req-9762e422-e6be-44d6-8e77-61387cdd510d tempest-VolumesGetTestJSON-741973643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-3725af69-e62f-4ca0-8325-94b89e31fe84 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:12 devstack sudo[91705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-3725af69-e62f-4ca0-8325-94b89e31fe84 Nov 04 12:14:12 devstack sudo[91705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-94bd534a-7fec-4792-b6af-f297661e85ed req-84a33288-1366-4b45-9f27-7785fdaf6dce tempest-ServerActionsTestOtherA-1526177158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:14:12 devstack sudo[91701]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c9067077-83e4-460c-9275-b71190ca9369 tempest-VolumesTransfersV357Test-1762052666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bdb646d1-a798-4450-ab1a-9ca0b0944f0a 1073741824" returned: 0 in 0.803s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:12 devstack sudo[91705]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-65358789-9537-4e18-a138-5d6973d53a19 req-9762e422-e6be-44d6-8e77-61387cdd510d tempest-VolumesGetTestJSON-741973643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-3725af69-e62f-4ca0-8325-94b89e31fe84" returned: 0 in 0.664s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-65358789-9537-4e18-a138-5d6973d53a19 req-9762e422-e6be-44d6-8e77-61387cdd510d tempest-VolumesGetTestJSON-741973643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-3725af69-e62f-4ca0-8325-94b89e31fe84 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:12 devstack sudo[91729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-3725af69-e62f-4ca0-8325-94b89e31fe84 Nov 04 12:14:12 devstack sudo[91729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c9067077-83e4-460c-9275-b71190ca9369 tempest-VolumesTransfersV357Test-1762052666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bdb646d1-a798-4450-ab1a-9ca0b0944f0a {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:12 devstack sudo[91731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bdb646d1-a798-4450-ab1a-9ca0b0944f0a Nov 04 12:14:12 devstack sudo[91731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:12 devstack sudo[91729]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-65358789-9537-4e18-a138-5d6973d53a19 req-9762e422-e6be-44d6-8e77-61387cdd510d tempest-VolumesGetTestJSON-741973643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-3725af69-e62f-4ca0-8325-94b89e31fe84" returned: 0 in 0.303s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:12 devstack cinder-volume[87095]: DEBUG cinder.coordination [req-65358789-9537-4e18-a138-5d6973d53a19 req-9762e422-e6be-44d6-8e77-61387cdd510d tempest-VolumesGetTestJSON-741973643 None] Lock "cinder-quobyte-3725af69-e62f-4ca0-8325-94b89e31fe84" released by "delete_volume" :: held 1.046s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:14:12 devstack sudo[91731]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c9067077-83e4-460c-9275-b71190ca9369 tempest-VolumesTransfersV357Test-1762052666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bdb646d1-a798-4450-ab1a-9ca0b0944f0a" returned: 0 in 0.305s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:12 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c9067077-83e4-460c-9275-b71190ca9369 tempest-VolumesTransfersV357Test-1762052666 None] <== create_volume: return (1187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:14:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c9067077-83e4-460c-9275-b71190ca9369 tempest-VolumesTransfersV357Test-1762052666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.193s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:14:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-94bd534a-7fec-4792-b6af-f297661e85ed req-84a33288-1366-4b45-9f27-7785fdaf6dce tempest-ServerActionsTestOtherA-1526177158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.402s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:14:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-94bd534a-7fec-4792-b6af-f297661e85ed req-84a33288-1366-4b45-9f27-7785fdaf6dce tempest-ServerActionsTestOtherA-1526177158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:14:12 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c9067077-83e4-460c-9275-b71190ca9369 tempest-VolumesTransfersV357Test-1762052666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea19903b-5e42-4ee8-a310-bcf6a4e66257) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdb646d1-a798-4450-ab1a-9ca0b0944f0a', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:14:12 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c9067077-83e4-460c-9275-b71190ca9369 tempest-VolumesTransfersV357Test-1762052666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbb7aa02-e02c-4c14-8f13-b2e3ca9f4b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:14:12 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-c9067077-83e4-460c-9275-b71190ca9369 tempest-VolumesTransfersV357Test-1762052666 None] Volume volume-bdb646d1-a798-4450-ab1a-9ca0b0944f0a (bdb646d1-a798-4450-ab1a-9ca0b0944f0a): created successfully Nov 04 12:14:12 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c9067077-83e4-460c-9275-b71190ca9369 tempest-VolumesTransfersV357Test-1762052666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbb7aa02-e02c-4c14-8f13-b2e3ca9f4b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:14:12 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c9067077-83e4-460c-9275-b71190ca9369 tempest-VolumesTransfersV357Test-1762052666 None] Flow 'volume_create_manager' (5a3598a3-4763-4ef6-aa52-fb6db5b13ae2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:14:12 devstack cinder-volume[87095]: DEBUG cinder.quota [req-65358789-9537-4e18-a138-5d6973d53a19 req-9762e422-e6be-44d6-8e77-61387cdd510d tempest-VolumesGetTestJSON-741973643 None] Created reservations ['790ad6ff-73f7-4960-a064-234f777042b4', '6a9ee966-e7d2-4857-a724-69ef18eb9f93', '235d3906-ad20-4b99-a351-095ff33ffaf9', 'b49bfc52-6e8d-4723-b498-a11143ee8a9a'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:14:12 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-c9067077-83e4-460c-9275-b71190ca9369 tempest-VolumesTransfersV357Test-1762052666 None] Created volume successfully. Nov 04 12:14:12 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-94bd534a-7fec-4792-b6af-f297661e85ed req-84a33288-1366-4b45-9f27-7785fdaf6dce tempest-ServerActionsTestOtherA-1526177158 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784', 'name': 'volume-6e3403eb-f6e0-483a-9467-55820ca11ec9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '075d1abb-db9c-420d-8cc6-6fb51d7d2e64', 'enforce_multipath': True} {{(pid=87095) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 12:14:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-65358789-9537-4e18-a138-5d6973d53a19 req-9762e422-e6be-44d6-8e77-61387cdd510d tempest-VolumesGetTestJSON-741973643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:14:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-65358789-9537-4e18-a138-5d6973d53a19 req-9762e422-e6be-44d6-8e77-61387cdd510d tempest-VolumesGetTestJSON-741973643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:14:12 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [req-65358789-9537-4e18-a138-5d6973d53a19 req-9762e422-e6be-44d6-8e77-61387cdd510d tempest-VolumesGetTestJSON-741973643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:14:12 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [req-65358789-9537-4e18-a138-5d6973d53a19 req-9762e422-e6be-44d6-8e77-61387cdd510d tempest-VolumesGetTestJSON-741973643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:14:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-65358789-9537-4e18-a138-5d6973d53a19 req-9762e422-e6be-44d6-8e77-61387cdd510d tempest-VolumesGetTestJSON-741973643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:14:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-65358789-9537-4e18-a138-5d6973d53a19 req-9762e422-e6be-44d6-8e77-61387cdd510d tempest-VolumesGetTestJSON-741973643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:13 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-94bd534a-7fec-4792-b6af-f297661e85ed req-84a33288-1366-4b45-9f27-7785fdaf6dce tempest-ServerActionsTestOtherA-1526177158 None] attachment_update completed successfully. Nov 04 12:14:13 devstack sudo[91736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:14:13 devstack sudo[91736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:13 devstack sudo[91736]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-65358789-9537-4e18-a138-5d6973d53a19 req-9762e422-e6be-44d6-8e77-61387cdd510d tempest-VolumesGetTestJSON-741973643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.333s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:13 devstack cinder-volume[87095]: DEBUG cinder.manager [req-65358789-9537-4e18-a138-5d6973d53a19 req-9762e422-e6be-44d6-8e77-61387cdd510d tempest-VolumesGetTestJSON-741973643 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:14:13 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-65358789-9537-4e18-a138-5d6973d53a19 req-9762e422-e6be-44d6-8e77-61387cdd510d tempest-VolumesGetTestJSON-741973643 None] Deleted volume successfully. Nov 04 12:14:13 devstack cinder-volume[87095]: DEBUG cinder.coordination [req-65358789-9537-4e18-a138-5d6973d53a19 req-9762e422-e6be-44d6-8e77-61387cdd510d tempest-VolumesGetTestJSON-741973643 None] Lock "cinder-3725af69-e62f-4ca0-8325-94b89e31fe84-delete_volume" released by "delete_volume" :: held 1.949s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:14:14 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-30109c22-e11c-49e5-8407-fcf035332795 tempest-VolumesTransfersV357Test-789262182 None] Transfer volume completed successfully. Nov 04 12:14:16 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-52ba8668-2d31-4134-a699-8157d4cbdb54 tempest-VolumesTransfersV357Test-1346619449 None] Acquiring lock "cinder-bdb646d1-a798-4450-ab1a-9ca0b0944f0a-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:14:16 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-52ba8668-2d31-4134-a699-8157d4cbdb54 tempest-VolumesTransfersV357Test-1346619449 None] Lock "cinder-bdb646d1-a798-4450-ab1a-9ca0b0944f0a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:14:16 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-52ba8668-2d31-4134-a699-8157d4cbdb54 tempest-VolumesTransfersV357Test-1346619449 None] Acquiring lock "cinder-quobyte-bdb646d1-a798-4450-ab1a-9ca0b0944f0a" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:14:16 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-52ba8668-2d31-4134-a699-8157d4cbdb54 tempest-VolumesTransfersV357Test-1346619449 None] Lock "cinder-quobyte-bdb646d1-a798-4450-ab1a-9ca0b0944f0a" acquired by "delete_volume" :: waited 0.031s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:14:16 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[766726e9-1c7b-4dcd-8132-9ed5e0b7b14e]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:14:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-52ba8668-2d31-4134-a699-8157d4cbdb54 tempest-VolumesTransfersV357Test-1346619449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bdb646d1-a798-4450-ab1a-9ca0b0944f0a {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:16 devstack sudo[92245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bdb646d1-a798-4450-ab1a-9ca0b0944f0a Nov 04 12:14:16 devstack sudo[92245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:16 devstack sudo[92245]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-52ba8668-2d31-4134-a699-8157d4cbdb54 tempest-VolumesTransfersV357Test-1346619449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bdb646d1-a798-4450-ab1a-9ca0b0944f0a" returned: 0 in 0.465s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-52ba8668-2d31-4134-a699-8157d4cbdb54 tempest-VolumesTransfersV357Test-1346619449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bdb646d1-a798-4450-ab1a-9ca0b0944f0a {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:16 devstack sudo[92251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bdb646d1-a798-4450-ab1a-9ca0b0944f0a Nov 04 12:14:16 devstack sudo[92251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:17 devstack sudo[92251]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-52ba8668-2d31-4134-a699-8157d4cbdb54 tempest-VolumesTransfersV357Test-1346619449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bdb646d1-a798-4450-ab1a-9ca0b0944f0a" returned: 0 in 0.426s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:17 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-52ba8668-2d31-4134-a699-8157d4cbdb54 tempest-VolumesTransfersV357Test-1346619449 None] Lock "cinder-quobyte-bdb646d1-a798-4450-ab1a-9ca0b0944f0a" released by "delete_volume" :: held 0.985s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:14:17 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-52ba8668-2d31-4134-a699-8157d4cbdb54 tempest-VolumesTransfersV357Test-1346619449 None] Created reservations ['7e462b96-60e1-446d-8bc4-93c744de52ff', '5c30a0cd-404c-4c26-8d68-a5f75e33b882', '2bd16747-b1f0-41cc-a544-6c90785c7ad2', 'bb7475a5-bd38-42b7-8409-dc70f3be6935'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:14:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-52ba8668-2d31-4134-a699-8157d4cbdb54 tempest-VolumesTransfersV357Test-1346619449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:14:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-52ba8668-2d31-4134-a699-8157d4cbdb54 tempest-VolumesTransfersV357Test-1346619449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:14:17 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-52ba8668-2d31-4134-a699-8157d4cbdb54 tempest-VolumesTransfersV357Test-1346619449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:14:17 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-52ba8668-2d31-4134-a699-8157d4cbdb54 tempest-VolumesTransfersV357Test-1346619449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:14:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-52ba8668-2d31-4134-a699-8157d4cbdb54 tempest-VolumesTransfersV357Test-1346619449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:14:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-52ba8668-2d31-4134-a699-8157d4cbdb54 tempest-VolumesTransfersV357Test-1346619449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:17 devstack sudo[92256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:14:17 devstack sudo[92256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:17 devstack sudo[92256]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-52ba8668-2d31-4134-a699-8157d4cbdb54 tempest-VolumesTransfersV357Test-1346619449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.373s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:17 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-52ba8668-2d31-4134-a699-8157d4cbdb54 tempest-VolumesTransfersV357Test-1346619449 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:14:17 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-52ba8668-2d31-4134-a699-8157d4cbdb54 tempest-VolumesTransfersV357Test-1346619449 None] Deleted volume successfully. Nov 04 12:14:18 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-52ba8668-2d31-4134-a699-8157d4cbdb54 tempest-VolumesTransfersV357Test-1346619449 None] Lock "cinder-bdb646d1-a798-4450-ab1a-9ca0b0944f0a-delete_volume" released by "delete_volume" :: held 1.813s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:14:19 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-1bb0f1df-8398-40cd-99d1-2d8736fc30b6 tempest-GroupSnapshotsV319Test-1798514903 None] Group tempest-GroupSnapshotsV319Test-Group-650970744: creating Nov 04 12:14:19 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-1bb0f1df-8398-40cd-99d1-2d8736fc30b6 tempest-GroupSnapshotsV319Test-1798514903 None] Group tempest-GroupSnapshotsV319Test-Group-650970744: created successfully Nov 04 12:14:19 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-1bb0f1df-8398-40cd-99d1-2d8736fc30b6 tempest-GroupSnapshotsV319Test-1798514903 None] Create group completed successfully. Nov 04 12:14:19 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-668bba4d-5e5a-4039-a43b-9e570452120c tempest-VolumesTransfersV357Test-1762052666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:14:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-668bba4d-5e5a-4039-a43b-9e570452120c tempest-VolumesTransfersV357Test-1762052666 None] Flow 'volume_create_manager' (0a7ef0ff-dfa9-4d34-ab8b-b9c2c70017a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:14:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-668bba4d-5e5a-4039-a43b-9e570452120c tempest-VolumesTransfersV357Test-1762052666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcca07b1-7e24-4ba5-a222-dd2b87ed02db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:14:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-668bba4d-5e5a-4039-a43b-9e570452120c tempest-VolumesTransfersV357Test-1762052666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcca07b1-7e24-4ba5-a222-dd2b87ed02db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:14:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-474867648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54f09a68-872e-45ec-938b-e32e5095e20c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56550d40138642b5b2857f30738e5f0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:14:19Z,use_quota=True,user_id='54673b09c5aa48caadd7a29db3d7cc9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:14:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-668bba4d-5e5a-4039-a43b-9e570452120c tempest-VolumesTransfersV357Test-1762052666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db41e350-aa6b-4625-957d-d9affb5cfa94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:14:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-668bba4d-5e5a-4039-a43b-9e570452120c tempest-VolumesTransfersV357Test-1762052666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db41e350-aa6b-4625-957d-d9affb5cfa94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:14:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-668bba4d-5e5a-4039-a43b-9e570452120c tempest-VolumesTransfersV357Test-1762052666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc4a5ba8-a35f-4b26-b782-1c53f73b4cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:14:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-668bba4d-5e5a-4039-a43b-9e570452120c tempest-VolumesTransfersV357Test-1762052666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc4a5ba8-a35f-4b26-b782-1c53f73b4cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54f09a68-872e-45ec-938b-e32e5095e20c', 'volume_name': 'volume-54f09a68-872e-45ec-938b-e32e5095e20c', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:14:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-668bba4d-5e5a-4039-a43b-9e570452120c tempest-VolumesTransfersV357Test-1762052666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8178b4d-5675-4998-ae0d-a6b9214736e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:14:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-668bba4d-5e5a-4039-a43b-9e570452120c tempest-VolumesTransfersV357Test-1762052666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8178b4d-5675-4998-ae0d-a6b9214736e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:14:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-668bba4d-5e5a-4039-a43b-9e570452120c tempest-VolumesTransfersV357Test-1762052666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94d65e29-99d3-4e29-9b05-d31208a77b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:14:19 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-668bba4d-5e5a-4039-a43b-9e570452120c tempest-VolumesTransfersV357Test-1762052666 None] Volume 54f09a68-872e-45ec-938b-e32e5095e20c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54f09a68-872e-45ec-938b-e32e5095e20c', 'volume_size': 1} Nov 04 12:14:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-668bba4d-5e5a-4039-a43b-9e570452120c tempest-VolumesTransfersV357Test-1762052666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:14:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-668bba4d-5e5a-4039-a43b-9e570452120c tempest-VolumesTransfersV357Test-1762052666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:14:19 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-668bba4d-5e5a-4039-a43b-9e570452120c tempest-VolumesTransfersV357Test-1762052666 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:14:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-474867648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54f09a68-872e-45ec-938b-e32e5095e20c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56550d40138642b5b2857f30738e5f0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:14:19Z,use_quota=True,user_id='54673b09c5aa48caadd7a29db3d7cc9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:14:19 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-668bba4d-5e5a-4039-a43b-9e570452120c tempest-VolumesTransfersV357Test-1762052666 None] Creating volume 54f09a68-872e-45ec-938b-e32e5095e20c {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:14:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-668bba4d-5e5a-4039-a43b-9e570452120c tempest-VolumesTransfersV357Test-1762052666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:14:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-668bba4d-5e5a-4039-a43b-9e570452120c tempest-VolumesTransfersV357Test-1762052666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:14:19 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-668bba4d-5e5a-4039-a43b-9e570452120c tempest-VolumesTransfersV357Test-1762052666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:14:19 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-668bba4d-5e5a-4039-a43b-9e570452120c tempest-VolumesTransfersV357Test-1762052666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:14:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-668bba4d-5e5a-4039-a43b-9e570452120c tempest-VolumesTransfersV357Test-1762052666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:14:19 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-668bba4d-5e5a-4039-a43b-9e570452120c tempest-VolumesTransfersV357Test-1762052666 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:14:19 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-668bba4d-5e5a-4039-a43b-9e570452120c tempest-VolumesTransfersV357Test-1762052666 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:14:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-668bba4d-5e5a-4039-a43b-9e570452120c tempest-VolumesTransfersV357Test-1762052666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-54f09a68-872e-45ec-938b-e32e5095e20c 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:19 devstack sudo[92261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-54f09a68-872e-45ec-938b-e32e5095e20c 1073741824 Nov 04 12:14:19 devstack sudo[92261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:20 devstack sudo[92261]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-668bba4d-5e5a-4039-a43b-9e570452120c tempest-VolumesTransfersV357Test-1762052666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-54f09a68-872e-45ec-938b-e32e5095e20c 1073741824" returned: 0 in 0.558s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-668bba4d-5e5a-4039-a43b-9e570452120c tempest-VolumesTransfersV357Test-1762052666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-54f09a68-872e-45ec-938b-e32e5095e20c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:20 devstack sudo[92267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-54f09a68-872e-45ec-938b-e32e5095e20c Nov 04 12:14:20 devstack sudo[92267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:20 devstack sudo[92267]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-668bba4d-5e5a-4039-a43b-9e570452120c tempest-VolumesTransfersV357Test-1762052666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-54f09a68-872e-45ec-938b-e32e5095e20c" returned: 0 in 0.339s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:20 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-668bba4d-5e5a-4039-a43b-9e570452120c tempest-VolumesTransfersV357Test-1762052666 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:14:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-668bba4d-5e5a-4039-a43b-9e570452120c tempest-VolumesTransfersV357Test-1762052666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:14:20 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-668bba4d-5e5a-4039-a43b-9e570452120c tempest-VolumesTransfersV357Test-1762052666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94d65e29-99d3-4e29-9b05-d31208a77b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54f09a68-872e-45ec-938b-e32e5095e20c', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:14:20 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-668bba4d-5e5a-4039-a43b-9e570452120c tempest-VolumesTransfersV357Test-1762052666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6aad23be-43ca-4878-9ca7-8e68f2350902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:14:20 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-668bba4d-5e5a-4039-a43b-9e570452120c tempest-VolumesTransfersV357Test-1762052666 None] Volume volume-54f09a68-872e-45ec-938b-e32e5095e20c (54f09a68-872e-45ec-938b-e32e5095e20c): created successfully Nov 04 12:14:20 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-668bba4d-5e5a-4039-a43b-9e570452120c tempest-VolumesTransfersV357Test-1762052666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6aad23be-43ca-4878-9ca7-8e68f2350902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:14:20 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-668bba4d-5e5a-4039-a43b-9e570452120c tempest-VolumesTransfersV357Test-1762052666 None] Flow 'volume_create_manager' (0a7ef0ff-dfa9-4d34-ab8b-b9c2c70017a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:14:20 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-668bba4d-5e5a-4039-a43b-9e570452120c tempest-VolumesTransfersV357Test-1762052666 None] Created volume successfully. Nov 04 12:14:20 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-98b22fb9-dc34-4fc3-a318-28ba4787f344 tempest-GroupSnapshotsV319Test-1798514903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:14:21 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-98b22fb9-dc34-4fc3-a318-28ba4787f344 tempest-GroupSnapshotsV319Test-1798514903 None] Flow 'volume_create_manager' (1707fc44-46db-4caa-b7b0-e6356230b77d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:14:21 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-98b22fb9-dc34-4fc3-a318-28ba4787f344 tempest-GroupSnapshotsV319Test-1798514903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63983c39-04f3-4d7f-acb4-b9e446c95b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:14:21 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-98b22fb9-dc34-4fc3-a318-28ba4787f344 tempest-GroupSnapshotsV319Test-1798514903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63983c39-04f3-4d7f-acb4-b9e446c95b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:14:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-706632525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0602c9bf-27d6-4a24-b26d-923c527963ca,host='devstack@QuobyteHD#QuobyteHD',id=ec2826f0-b1aa-4f6f-8962-4f551c6c46f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='537d4a4582b14191990f87573f3e2fd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:14:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:14:21Z,use_quota=True,user_id='c61142dd09ef4c63b0c1b57b863d69e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de11e236-949f-4195-ad2b-bcb0c2559dc5),volume_type_id=de11e236-949f-4195-ad2b-bcb0c2559dc5)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:14:21 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-98b22fb9-dc34-4fc3-a318-28ba4787f344 tempest-GroupSnapshotsV319Test-1798514903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e09cff75-73bd-43ef-8a02-3504e0047450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:14:21 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-98b22fb9-dc34-4fc3-a318-28ba4787f344 tempest-GroupSnapshotsV319Test-1798514903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e09cff75-73bd-43ef-8a02-3504e0047450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:14:21 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-98b22fb9-dc34-4fc3-a318-28ba4787f344 tempest-GroupSnapshotsV319Test-1798514903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c839d36-fca5-4e75-815a-7b9f2588b5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:14:21 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-98b22fb9-dc34-4fc3-a318-28ba4787f344 tempest-GroupSnapshotsV319Test-1798514903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c839d36-fca5-4e75-815a-7b9f2588b5c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec2826f0-b1aa-4f6f-8962-4f551c6c46f8', 'volume_name': 'volume-ec2826f0-b1aa-4f6f-8962-4f551c6c46f8', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:14:21 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-98b22fb9-dc34-4fc3-a318-28ba4787f344 tempest-GroupSnapshotsV319Test-1798514903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c50e672-8950-437c-a97a-f24757239851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:14:21 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-98b22fb9-dc34-4fc3-a318-28ba4787f344 tempest-GroupSnapshotsV319Test-1798514903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c50e672-8950-437c-a97a-f24757239851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:14:21 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-98b22fb9-dc34-4fc3-a318-28ba4787f344 tempest-GroupSnapshotsV319Test-1798514903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b66f5ad0-7cf7-4b0e-858e-a4b767721c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:14:21 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-98b22fb9-dc34-4fc3-a318-28ba4787f344 tempest-GroupSnapshotsV319Test-1798514903 None] Volume ec2826f0-b1aa-4f6f-8962-4f551c6c46f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec2826f0-b1aa-4f6f-8962-4f551c6c46f8', 'volume_size': 1} Nov 04 12:14:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-98b22fb9-dc34-4fc3-a318-28ba4787f344 tempest-GroupSnapshotsV319Test-1798514903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:14:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-98b22fb9-dc34-4fc3-a318-28ba4787f344 tempest-GroupSnapshotsV319Test-1798514903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:14:21 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-98b22fb9-dc34-4fc3-a318-28ba4787f344 tempest-GroupSnapshotsV319Test-1798514903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0602c9bf-27d6-4a24-b26d-923c527963ca,created_at=2026-11-04T11:14:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-706632525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0602c9bf-27d6-4a24-b26d-923c527963ca,host='devstack@QuobyteHD#QuobyteHD',id=ec2826f0-b1aa-4f6f-8962-4f551c6c46f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='537d4a4582b14191990f87573f3e2fd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:14:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:14:21Z,use_quota=True,user_id='c61142dd09ef4c63b0c1b57b863d69e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de11e236-949f-4195-ad2b-bcb0c2559dc5),volume_type_id=de11e236-949f-4195-ad2b-bcb0c2559dc5)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:14:21 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-98b22fb9-dc34-4fc3-a318-28ba4787f344 tempest-GroupSnapshotsV319Test-1798514903 None] Creating volume ec2826f0-b1aa-4f6f-8962-4f551c6c46f8 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:14:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-98b22fb9-dc34-4fc3-a318-28ba4787f344 tempest-GroupSnapshotsV319Test-1798514903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:14:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-98b22fb9-dc34-4fc3-a318-28ba4787f344 tempest-GroupSnapshotsV319Test-1798514903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:14:21 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-98b22fb9-dc34-4fc3-a318-28ba4787f344 tempest-GroupSnapshotsV319Test-1798514903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:14:21 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-98b22fb9-dc34-4fc3-a318-28ba4787f344 tempest-GroupSnapshotsV319Test-1798514903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:14:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-98b22fb9-dc34-4fc3-a318-28ba4787f344 tempest-GroupSnapshotsV319Test-1798514903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:14:21 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-98b22fb9-dc34-4fc3-a318-28ba4787f344 tempest-GroupSnapshotsV319Test-1798514903 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:14:21 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-98b22fb9-dc34-4fc3-a318-28ba4787f344 tempest-GroupSnapshotsV319Test-1798514903 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:14:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-98b22fb9-dc34-4fc3-a318-28ba4787f344 tempest-GroupSnapshotsV319Test-1798514903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ec2826f0-b1aa-4f6f-8962-4f551c6c46f8 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:21 devstack sudo[92270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ec2826f0-b1aa-4f6f-8962-4f551c6c46f8 1073741824 Nov 04 12:14:21 devstack sudo[92270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:21 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-ae12fd6c-5fab-42f6-980e-844332ded1ce tempest-GroupsV320Test-1792509066 None] Group tempest-GroupsV320Test-Group-1613990920: creating Nov 04 12:14:21 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-ae12fd6c-5fab-42f6-980e-844332ded1ce tempest-GroupsV320Test-1792509066 None] Group tempest-GroupsV320Test-Group-1613990920: created successfully Nov 04 12:14:21 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-ae12fd6c-5fab-42f6-980e-844332ded1ce tempest-GroupsV320Test-1792509066 None] Create group completed successfully. Nov 04 12:14:21 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-342b9708-8a8b-4c4a-9699-2face6b87732 tempest-VolumesTransfersV357Test-1346619449 None] Acquiring lock "cinder-54f09a68-872e-45ec-938b-e32e5095e20c-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:14:21 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-342b9708-8a8b-4c4a-9699-2face6b87732 tempest-VolumesTransfersV357Test-1346619449 None] Lock "cinder-54f09a68-872e-45ec-938b-e32e5095e20c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:14:21 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-342b9708-8a8b-4c4a-9699-2face6b87732 tempest-VolumesTransfersV357Test-1346619449 None] Acquiring lock "cinder-quobyte-54f09a68-872e-45ec-938b-e32e5095e20c" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:14:21 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-342b9708-8a8b-4c4a-9699-2face6b87732 tempest-VolumesTransfersV357Test-1346619449 None] Lock "cinder-quobyte-54f09a68-872e-45ec-938b-e32e5095e20c" acquired by "delete_volume" :: waited 0.024s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:14:21 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[de01354d-82a9-422a-8dfe-41f01d536087]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:14:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-342b9708-8a8b-4c4a-9699-2face6b87732 tempest-VolumesTransfersV357Test-1346619449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-54f09a68-872e-45ec-938b-e32e5095e20c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:21 devstack sudo[92270]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:21 devstack sudo[92290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-54f09a68-872e-45ec-938b-e32e5095e20c Nov 04 12:14:21 devstack sudo[92290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-98b22fb9-dc34-4fc3-a318-28ba4787f344 tempest-GroupSnapshotsV319Test-1798514903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ec2826f0-b1aa-4f6f-8962-4f551c6c46f8 1073741824" returned: 0 in 0.489s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-98b22fb9-dc34-4fc3-a318-28ba4787f344 tempest-GroupSnapshotsV319Test-1798514903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ec2826f0-b1aa-4f6f-8962-4f551c6c46f8 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:21 devstack sudo[92292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ec2826f0-b1aa-4f6f-8962-4f551c6c46f8 Nov 04 12:14:21 devstack sudo[92292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:21 devstack sudo[92290]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-342b9708-8a8b-4c4a-9699-2face6b87732 tempest-VolumesTransfersV357Test-1346619449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-54f09a68-872e-45ec-938b-e32e5095e20c" returned: 0 in 0.388s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-342b9708-8a8b-4c4a-9699-2face6b87732 tempest-VolumesTransfersV357Test-1346619449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-54f09a68-872e-45ec-938b-e32e5095e20c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:21 devstack sudo[92292]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-98b22fb9-dc34-4fc3-a318-28ba4787f344 tempest-GroupSnapshotsV319Test-1798514903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ec2826f0-b1aa-4f6f-8962-4f551c6c46f8" returned: 0 in 0.249s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:21 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-98b22fb9-dc34-4fc3-a318-28ba4787f344 tempest-GroupSnapshotsV319Test-1798514903 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:14:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-98b22fb9-dc34-4fc3-a318-28ba4787f344 tempest-GroupSnapshotsV319Test-1798514903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:14:21 devstack sudo[92298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-54f09a68-872e-45ec-938b-e32e5095e20c Nov 04 12:14:21 devstack sudo[92298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:21 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-98b22fb9-dc34-4fc3-a318-28ba4787f344 tempest-GroupSnapshotsV319Test-1798514903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b66f5ad0-7cf7-4b0e-858e-a4b767721c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec2826f0-b1aa-4f6f-8962-4f551c6c46f8', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:14:21 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-98b22fb9-dc34-4fc3-a318-28ba4787f344 tempest-GroupSnapshotsV319Test-1798514903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (072bafd8-b755-4ea4-a525-d0ecd2ebe9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:14:21 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-98b22fb9-dc34-4fc3-a318-28ba4787f344 tempest-GroupSnapshotsV319Test-1798514903 None] Volume volume-ec2826f0-b1aa-4f6f-8962-4f551c6c46f8 (ec2826f0-b1aa-4f6f-8962-4f551c6c46f8): created successfully Nov 04 12:14:21 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-98b22fb9-dc34-4fc3-a318-28ba4787f344 tempest-GroupSnapshotsV319Test-1798514903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (072bafd8-b755-4ea4-a525-d0ecd2ebe9ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:14:21 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-98b22fb9-dc34-4fc3-a318-28ba4787f344 tempest-GroupSnapshotsV319Test-1798514903 None] Flow 'volume_create_manager' (1707fc44-46db-4caa-b7b0-e6356230b77d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:14:21 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-98b22fb9-dc34-4fc3-a318-28ba4787f344 tempest-GroupSnapshotsV319Test-1798514903 None] Created volume successfully. Nov 04 12:14:22 devstack sudo[92298]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-342b9708-8a8b-4c4a-9699-2face6b87732 tempest-VolumesTransfersV357Test-1346619449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-54f09a68-872e-45ec-938b-e32e5095e20c" returned: 0 in 0.266s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:22 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-342b9708-8a8b-4c4a-9699-2face6b87732 tempest-VolumesTransfersV357Test-1346619449 None] Lock "cinder-quobyte-54f09a68-872e-45ec-938b-e32e5095e20c" released by "delete_volume" :: held 0.701s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:14:22 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-342b9708-8a8b-4c4a-9699-2face6b87732 tempest-VolumesTransfersV357Test-1346619449 None] Created reservations ['d87ab4b4-50b7-476e-99a7-1547e406e3f1', '8b472829-f4ab-41bd-98da-a7d29669f3ab', '9d0af008-b37c-4e48-8e59-fb63267dcbfd', '5b84d872-d384-4917-a5a2-f08addea6e64'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:14:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-342b9708-8a8b-4c4a-9699-2face6b87732 tempest-VolumesTransfersV357Test-1346619449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:14:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-342b9708-8a8b-4c4a-9699-2face6b87732 tempest-VolumesTransfersV357Test-1346619449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:14:22 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-342b9708-8a8b-4c4a-9699-2face6b87732 tempest-VolumesTransfersV357Test-1346619449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:14:22 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-342b9708-8a8b-4c4a-9699-2face6b87732 tempest-VolumesTransfersV357Test-1346619449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:14:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-342b9708-8a8b-4c4a-9699-2face6b87732 tempest-VolumesTransfersV357Test-1346619449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:14:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-342b9708-8a8b-4c4a-9699-2face6b87732 tempest-VolumesTransfersV357Test-1346619449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:22 devstack sudo[92301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:14:22 devstack sudo[92301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:22 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-0b59efe4-1f38-43c5-86fa-91e8e8482f92 tempest-GroupSnapshotsV319Test-1798514903 None] GroupSnapshot 169c96dc-3f39-4f83-9da1-c119202d2685: creating. Nov 04 12:14:22 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0b59efe4-1f38-43c5-86fa-91e8e8482f92 tempest-GroupSnapshotsV319Test-1798514903 None] Group snapshot 169c96dc-3f39-4f83-9da1-c119202d2685: creating. {{(pid=87095) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 04 12:14:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0b59efe4-1f38-43c5-86fa-91e8e8482f92 tempest-GroupSnapshotsV319Test-1798514903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:14:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0b59efe4-1f38-43c5-86fa-91e8e8482f92 tempest-GroupSnapshotsV319Test-1798514903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:14:22 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-0b59efe4-1f38-43c5-86fa-91e8e8482f92 tempest-GroupSnapshotsV319Test-1798514903 None] Creating offline snapshot 24003e87-cc9d-4145-9bcc-20c7dc0b1de0 of volume ec2826f0-b1aa-4f6f-8962-4f551c6c46f8 {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 12:14:22 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aaa821d-d307-4050-8263-7c00eb7ce1ed]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:14:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0b59efe4-1f38-43c5-86fa-91e8e8482f92 tempest-GroupSnapshotsV319Test-1798514903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ec2826f0-b1aa-4f6f-8962-4f551c6c46f8 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:22 devstack sudo[92301]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-342b9708-8a8b-4c4a-9699-2face6b87732 tempest-VolumesTransfersV357Test-1346619449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.524s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:22 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-342b9708-8a8b-4c4a-9699-2face6b87732 tempest-VolumesTransfersV357Test-1346619449 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:14:22 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-342b9708-8a8b-4c4a-9699-2face6b87732 tempest-VolumesTransfersV357Test-1346619449 None] Deleted volume successfully. Nov 04 12:14:22 devstack sudo[92305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ec2826f0-b1aa-4f6f-8962-4f551c6c46f8 Nov 04 12:14:22 devstack sudo[92305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:22 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-342b9708-8a8b-4c4a-9699-2face6b87732 tempest-VolumesTransfersV357Test-1346619449 None] Lock "cinder-54f09a68-872e-45ec-938b-e32e5095e20c-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:14:23 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-04d23e5d-237a-4e5d-be7a-3ef58cf8c34b tempest-GroupsV320Test-1792509066 None] Created reservations ['dc047ef7-3ee3-412d-bda6-6079e17c5739'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:14:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-04d23e5d-237a-4e5d-be7a-3ef58cf8c34b tempest-GroupsV320Test-1792509066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:14:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-04d23e5d-237a-4e5d-be7a-3ef58cf8c34b tempest-GroupsV320Test-1792509066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:14:23 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-04d23e5d-237a-4e5d-be7a-3ef58cf8c34b tempest-GroupsV320Test-1792509066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:14:23 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-04d23e5d-237a-4e5d-be7a-3ef58cf8c34b tempest-GroupsV320Test-1792509066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:14:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-04d23e5d-237a-4e5d-be7a-3ef58cf8c34b tempest-GroupsV320Test-1792509066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:14:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-04d23e5d-237a-4e5d-be7a-3ef58cf8c34b tempest-GroupsV320Test-1792509066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:23 devstack sudo[92307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:14:23 devstack sudo[92307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:23 devstack sudo[92305]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0b59efe4-1f38-43c5-86fa-91e8e8482f92 tempest-GroupSnapshotsV319Test-1798514903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ec2826f0-b1aa-4f6f-8962-4f551c6c46f8" returned: 0 in 0.551s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0b59efe4-1f38-43c5-86fa-91e8e8482f92 tempest-GroupSnapshotsV319Test-1798514903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ec2826f0-b1aa-4f6f-8962-4f551c6c46f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ec2826f0-b1aa-4f6f-8962-4f551c6c46f8.24003e87-cc9d-4145-9bcc-20c7dc0b1de0 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:23 devstack sudo[92312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ec2826f0-b1aa-4f6f-8962-4f551c6c46f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ec2826f0-b1aa-4f6f-8962-4f551c6c46f8.24003e87-cc9d-4145-9bcc-20c7dc0b1de0 1G Nov 04 12:14:23 devstack sudo[92312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:23 devstack sudo[92307]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-04d23e5d-237a-4e5d-be7a-3ef58cf8c34b tempest-GroupsV320Test-1792509066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.345s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:23 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-04d23e5d-237a-4e5d-be7a-3ef58cf8c34b tempest-GroupsV320Test-1792509066 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:14:23 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-04d23e5d-237a-4e5d-be7a-3ef58cf8c34b tempest-GroupsV320Test-1792509066 None] Delete group completed successfully. Nov 04 12:14:23 devstack sudo[92312]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0b59efe4-1f38-43c5-86fa-91e8e8482f92 tempest-GroupSnapshotsV319Test-1798514903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ec2826f0-b1aa-4f6f-8962-4f551c6c46f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ec2826f0-b1aa-4f6f-8962-4f551c6c46f8.24003e87-cc9d-4145-9bcc-20c7dc0b1de0 1G" returned: 0 in 0.608s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0b59efe4-1f38-43c5-86fa-91e8e8482f92 tempest-GroupSnapshotsV319Test-1798514903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec2826f0-b1aa-4f6f-8962-4f551c6c46f8 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ec2826f0-b1aa-4f6f-8962-4f551c6c46f8.24003e87-cc9d-4145-9bcc-20c7dc0b1de0 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:24 devstack sudo[92324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec2826f0-b1aa-4f6f-8962-4f551c6c46f8 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ec2826f0-b1aa-4f6f-8962-4f551c6c46f8.24003e87-cc9d-4145-9bcc-20c7dc0b1de0 Nov 04 12:14:24 devstack sudo[92324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:24 devstack sudo[92324]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0b59efe4-1f38-43c5-86fa-91e8e8482f92 tempest-GroupSnapshotsV319Test-1798514903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec2826f0-b1aa-4f6f-8962-4f551c6c46f8 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ec2826f0-b1aa-4f6f-8962-4f551c6c46f8.24003e87-cc9d-4145-9bcc-20c7dc0b1de0" returned: 0 in 0.530s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:24 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-0b59efe4-1f38-43c5-86fa-91e8e8482f92 tempest-GroupSnapshotsV319Test-1798514903 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ec2826f0-b1aa-4f6f-8962-4f551c6c46f8.24003e87-cc9d-4145-9bcc-20c7dc0b1de0 is being set with open permissions: ugo+rw: NotImplementedError Nov 04 12:14:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0b59efe4-1f38-43c5-86fa-91e8e8482f92 tempest-GroupSnapshotsV319Test-1798514903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ec2826f0-b1aa-4f6f-8962-4f551c6c46f8.24003e87-cc9d-4145-9bcc-20c7dc0b1de0 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:24 devstack sudo[92337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ec2826f0-b1aa-4f6f-8962-4f551c6c46f8.24003e87-cc9d-4145-9bcc-20c7dc0b1de0 Nov 04 12:14:24 devstack sudo[92337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:24 devstack sudo[92337]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0b59efe4-1f38-43c5-86fa-91e8e8482f92 tempest-GroupSnapshotsV319Test-1798514903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ec2826f0-b1aa-4f6f-8962-4f551c6c46f8.24003e87-cc9d-4145-9bcc-20c7dc0b1de0" returned: 0 in 0.365s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0b59efe4-1f38-43c5-86fa-91e8e8482f92 tempest-GroupSnapshotsV319Test-1798514903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ec2826f0-b1aa-4f6f-8962-4f551c6c46f8.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:24 devstack sudo[92343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ec2826f0-b1aa-4f6f-8962-4f551c6c46f8.info Nov 04 12:14:24 devstack sudo[92343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:25 devstack sudo[92343]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0b59efe4-1f38-43c5-86fa-91e8e8482f92 tempest-GroupSnapshotsV319Test-1798514903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ec2826f0-b1aa-4f6f-8962-4f551c6c46f8.info" returned: 0 in 0.393s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:25 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-0b59efe4-1f38-43c5-86fa-91e8e8482f92 tempest-GroupSnapshotsV319Test-1798514903 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ec2826f0-b1aa-4f6f-8962-4f551c6c46f8.info is being set with open permissions: ugo+rw: NotImplementedError Nov 04 12:14:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0b59efe4-1f38-43c5-86fa-91e8e8482f92 tempest-GroupSnapshotsV319Test-1798514903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ec2826f0-b1aa-4f6f-8962-4f551c6c46f8.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:25 devstack sudo[92346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ec2826f0-b1aa-4f6f-8962-4f551c6c46f8.info Nov 04 12:14:25 devstack sudo[92346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:25 devstack sudo[92346]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0b59efe4-1f38-43c5-86fa-91e8e8482f92 tempest-GroupSnapshotsV319Test-1798514903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ec2826f0-b1aa-4f6f-8962-4f551c6c46f8.info" returned: 0 in 0.481s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0b59efe4-1f38-43c5-86fa-91e8e8482f92 tempest-GroupSnapshotsV319Test-1798514903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.106s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:14:25 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-0b59efe4-1f38-43c5-86fa-91e8e8482f92 tempest-GroupSnapshotsV319Test-1798514903 None] group_snapshot 169c96dc-3f39-4f83-9da1-c119202d2685: created successfully Nov 04 12:14:28 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-118a0ec6-8613-40f5-94d9-1e8a8afecee7 tempest-GroupSnapshotsV319Test-1798514903 None] group_snapshot 169c96dc-3f39-4f83-9da1-c119202d2685: deleting Nov 04 12:14:28 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-118a0ec6-8613-40f5-94d9-1e8a8afecee7 tempest-GroupSnapshotsV319Test-1798514903 None] group_snapshot 169c96dc-3f39-4f83-9da1-c119202d2685: deleting {{(pid=87095) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 04 12:14:28 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-118a0ec6-8613-40f5-94d9-1e8a8afecee7 tempest-GroupSnapshotsV319Test-1798514903 None] Acquiring lock "cinder-quobyte-ec2826f0-b1aa-4f6f-8962-4f551c6c46f8" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:14:28 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-118a0ec6-8613-40f5-94d9-1e8a8afecee7 tempest-GroupSnapshotsV319Test-1798514903 None] Lock "cinder-quobyte-ec2826f0-b1aa-4f6f-8962-4f551c6c46f8" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:14:28 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-118a0ec6-8613-40f5-94d9-1e8a8afecee7 tempest-GroupSnapshotsV319Test-1798514903 None] Acquiring lock "cinder-quobyte-24003e87-cc9d-4145-9bcc-20c7dc0b1de0" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:14:28 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-118a0ec6-8613-40f5-94d9-1e8a8afecee7 tempest-GroupSnapshotsV319Test-1798514903 None] Lock "cinder-quobyte-24003e87-cc9d-4145-9bcc-20c7dc0b1de0" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:14:28 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-118a0ec6-8613-40f5-94d9-1e8a8afecee7 tempest-GroupSnapshotsV319Test-1798514903 None] Deleting offline snapshot 24003e87-cc9d-4145-9bcc-20c7dc0b1de0 of volume ec2826f0-b1aa-4f6f-8962-4f551c6c46f8 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 12:14:28 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-118a0ec6-8613-40f5-94d9-1e8a8afecee7 tempest-GroupSnapshotsV319Test-1798514903 None] snapshot_file for this snap is: volume-ec2826f0-b1aa-4f6f-8962-4f551c6c46f8.24003e87-cc9d-4145-9bcc-20c7dc0b1de0 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 12:14:28 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe694318-07d4-4367-b3e0-dcfcb5c3f59c]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:14:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-118a0ec6-8613-40f5-94d9-1e8a8afecee7 tempest-GroupSnapshotsV319Test-1798514903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ec2826f0-b1aa-4f6f-8962-4f551c6c46f8.24003e87-cc9d-4145-9bcc-20c7dc0b1de0 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:28 devstack sudo[92355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ec2826f0-b1aa-4f6f-8962-4f551c6c46f8.24003e87-cc9d-4145-9bcc-20c7dc0b1de0 Nov 04 12:14:28 devstack sudo[92355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:28 devstack sudo[92355]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-118a0ec6-8613-40f5-94d9-1e8a8afecee7 tempest-GroupSnapshotsV319Test-1798514903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ec2826f0-b1aa-4f6f-8962-4f551c6c46f8.24003e87-cc9d-4145-9bcc-20c7dc0b1de0" returned: 0 in 0.494s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:28 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-118a0ec6-8613-40f5-94d9-1e8a8afecee7 tempest-GroupSnapshotsV319Test-1798514903 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec2826f0-b1aa-4f6f-8962-4f551c6c46f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 12:14:28 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c700a521-2434-4121-b19c-0611910a8922]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:14:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-118a0ec6-8613-40f5-94d9-1e8a8afecee7 tempest-GroupSnapshotsV319Test-1798514903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ec2826f0-b1aa-4f6f-8962-4f551c6c46f8 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:28 devstack sudo[92361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ec2826f0-b1aa-4f6f-8962-4f551c6c46f8 Nov 04 12:14:28 devstack sudo[92361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:29 devstack sudo[92361]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-118a0ec6-8613-40f5-94d9-1e8a8afecee7 tempest-GroupSnapshotsV319Test-1798514903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ec2826f0-b1aa-4f6f-8962-4f551c6c46f8" returned: 0 in 0.566s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-118a0ec6-8613-40f5-94d9-1e8a8afecee7 tempest-GroupSnapshotsV319Test-1798514903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ec2826f0-b1aa-4f6f-8962-4f551c6c46f8.24003e87-cc9d-4145-9bcc-20c7dc0b1de0 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:29 devstack sudo[92366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ec2826f0-b1aa-4f6f-8962-4f551c6c46f8.24003e87-cc9d-4145-9bcc-20c7dc0b1de0 Nov 04 12:14:29 devstack sudo[92366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:29 devstack sudo[92366]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-118a0ec6-8613-40f5-94d9-1e8a8afecee7 tempest-GroupSnapshotsV319Test-1798514903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ec2826f0-b1aa-4f6f-8962-4f551c6c46f8.24003e87-cc9d-4145-9bcc-20c7dc0b1de0" returned: 0 in 0.507s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-118a0ec6-8613-40f5-94d9-1e8a8afecee7 tempest-GroupSnapshotsV319Test-1798514903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ec2826f0-b1aa-4f6f-8962-4f551c6c46f8.24003e87-cc9d-4145-9bcc-20c7dc0b1de0 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:29 devstack sudo[92400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ec2826f0-b1aa-4f6f-8962-4f551c6c46f8.24003e87-cc9d-4145-9bcc-20c7dc0b1de0 Nov 04 12:14:29 devstack sudo[92400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:30 devstack sudo[92400]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-118a0ec6-8613-40f5-94d9-1e8a8afecee7 tempest-GroupSnapshotsV319Test-1798514903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ec2826f0-b1aa-4f6f-8962-4f551c6c46f8.24003e87-cc9d-4145-9bcc-20c7dc0b1de0" returned: 0 in 0.335s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:30 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-118a0ec6-8613-40f5-94d9-1e8a8afecee7 tempest-GroupSnapshotsV319Test-1798514903 None] Lock "cinder-quobyte-24003e87-cc9d-4145-9bcc-20c7dc0b1de0" released by "_delete_snapshot" :: held 2.076s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:14:30 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-118a0ec6-8613-40f5-94d9-1e8a8afecee7 tempest-GroupSnapshotsV319Test-1798514903 None] Lock "cinder-quobyte-ec2826f0-b1aa-4f6f-8962-4f551c6c46f8" released by "delete_snapshot" :: held 2.116s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:14:30 devstack cinder-volume[87095]: WARNING cinder.quota [None req-118a0ec6-8613-40f5-94d9-1e8a8afecee7 tempest-GroupSnapshotsV319Test-1798514903 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-748918480 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-748918480, it is now deprecated. Please use the default quota class for default quota. Nov 04 12:14:30 devstack cinder-volume[87095]: WARNING cinder.quota [None req-118a0ec6-8613-40f5-94d9-1e8a8afecee7 tempest-GroupSnapshotsV319Test-1798514903 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-748918480 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-748918480, it is now deprecated. Please use the default quota class for default quota. Nov 04 12:14:30 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-118a0ec6-8613-40f5-94d9-1e8a8afecee7 tempest-GroupSnapshotsV319Test-1798514903 None] Created reservations ['0ec31a0c-5d5b-4d84-a30c-59b92c888d8f', '3c349576-0da6-454c-8e0e-f18f26cc301a', 'da73fd51-e6a7-4b5b-b9ff-c8fcb4d71827', '7124818e-5975-4802-80cf-eb6896db2170'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:14:30 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-118a0ec6-8613-40f5-94d9-1e8a8afecee7 tempest-GroupSnapshotsV319Test-1798514903 None] group_snapshot 169c96dc-3f39-4f83-9da1-c119202d2685: deleted successfully Nov 04 12:14:30 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b09a44a8-d6bc-42b9-aee9-e3ae7280530c tempest-GroupSnapshotsV319Test-1798514903 None] Acquiring lock "cinder-quobyte-ec2826f0-b1aa-4f6f-8962-4f551c6c46f8" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:14:31 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b09a44a8-d6bc-42b9-aee9-e3ae7280530c tempest-GroupSnapshotsV319Test-1798514903 None] Lock "cinder-quobyte-ec2826f0-b1aa-4f6f-8962-4f551c6c46f8" acquired by "delete_volume" :: waited 0.022s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:14:31 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb353ae-626e-46a5-9c2f-98817ddccc16]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:14:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b09a44a8-d6bc-42b9-aee9-e3ae7280530c tempest-GroupSnapshotsV319Test-1798514903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ec2826f0-b1aa-4f6f-8962-4f551c6c46f8 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:31 devstack sudo[92403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ec2826f0-b1aa-4f6f-8962-4f551c6c46f8 Nov 04 12:14:31 devstack sudo[92403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:31 devstack sudo[92403]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b09a44a8-d6bc-42b9-aee9-e3ae7280530c tempest-GroupSnapshotsV319Test-1798514903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ec2826f0-b1aa-4f6f-8962-4f551c6c46f8" returned: 0 in 0.448s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b09a44a8-d6bc-42b9-aee9-e3ae7280530c tempest-GroupSnapshotsV319Test-1798514903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ec2826f0-b1aa-4f6f-8962-4f551c6c46f8 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:31 devstack sudo[92408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ec2826f0-b1aa-4f6f-8962-4f551c6c46f8 Nov 04 12:14:31 devstack sudo[92408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:31 devstack sudo[92408]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b09a44a8-d6bc-42b9-aee9-e3ae7280530c tempest-GroupSnapshotsV319Test-1798514903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ec2826f0-b1aa-4f6f-8962-4f551c6c46f8" returned: 0 in 0.287s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:31 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b09a44a8-d6bc-42b9-aee9-e3ae7280530c tempest-GroupSnapshotsV319Test-1798514903 None] Lock "cinder-quobyte-ec2826f0-b1aa-4f6f-8962-4f551c6c46f8" released by "delete_volume" :: held 0.825s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:14:31 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-b09a44a8-d6bc-42b9-aee9-e3ae7280530c tempest-GroupSnapshotsV319Test-1798514903 None] Created reservations ['95e4c2b5-83aa-407d-8d87-60a1b2185b8d'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:14:31 devstack cinder-volume[87095]: WARNING cinder.quota [None req-b09a44a8-d6bc-42b9-aee9-e3ae7280530c tempest-GroupSnapshotsV319Test-1798514903 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-748918480 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-748918480, it is now deprecated. Please use the default quota class for default quota. Nov 04 12:14:31 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-b09a44a8-d6bc-42b9-aee9-e3ae7280530c tempest-GroupSnapshotsV319Test-1798514903 None] Created reservations ['ce2a3463-12e1-416e-ae53-a2ed8f1fe8f7', '0bc4ac80-1a10-4d11-8b78-b9bea54fa9b9', 'b27e0d79-f2ca-4a06-b69e-fb5951a7fca7', '01c39b00-c7e2-4ff8-9098-56ab15a5a6b7'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:14:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b09a44a8-d6bc-42b9-aee9-e3ae7280530c tempest-GroupSnapshotsV319Test-1798514903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:14:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b09a44a8-d6bc-42b9-aee9-e3ae7280530c tempest-GroupSnapshotsV319Test-1798514903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:14:32 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b09a44a8-d6bc-42b9-aee9-e3ae7280530c tempest-GroupSnapshotsV319Test-1798514903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:14:32 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b09a44a8-d6bc-42b9-aee9-e3ae7280530c tempest-GroupSnapshotsV319Test-1798514903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:14:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b09a44a8-d6bc-42b9-aee9-e3ae7280530c tempest-GroupSnapshotsV319Test-1798514903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:14:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b09a44a8-d6bc-42b9-aee9-e3ae7280530c tempest-GroupSnapshotsV319Test-1798514903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:32 devstack sudo[92411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:14:32 devstack sudo[92411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:32 devstack sudo[92411]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b09a44a8-d6bc-42b9-aee9-e3ae7280530c tempest-GroupSnapshotsV319Test-1798514903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.327s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:32 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-b09a44a8-d6bc-42b9-aee9-e3ae7280530c tempest-GroupSnapshotsV319Test-1798514903 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:14:32 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-b09a44a8-d6bc-42b9-aee9-e3ae7280530c tempest-GroupSnapshotsV319Test-1798514903 None] Delete group completed successfully. Nov 04 12:14:33 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-626c7ef4-d4b4-4cf0-9659-14df281d9abe tempest-SnapshotsActionsTest-1983587027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:14:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-626c7ef4-d4b4-4cf0-9659-14df281d9abe tempest-SnapshotsActionsTest-1983587027 None] Flow 'volume_create_manager' (f5ce19e5-f20e-40da-915e-ec3086365b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:14:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-626c7ef4-d4b4-4cf0-9659-14df281d9abe tempest-SnapshotsActionsTest-1983587027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1c76361-711d-4c8e-b5d3-e877ef9b14af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:14:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-626c7ef4-d4b4-4cf0-9659-14df281d9abe tempest-SnapshotsActionsTest-1983587027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1c76361-711d-4c8e-b5d3-e877ef9b14af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:14:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2034124475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee4e9386-0b3c-4207-8b14-32b073ed06da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4a7a73e7aa7480ab2c71b4511e42e07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:14:33Z,use_quota=True,user_id='b74ffbe4ce1f4d748326e6f37d54cc62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:14:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-626c7ef4-d4b4-4cf0-9659-14df281d9abe tempest-SnapshotsActionsTest-1983587027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a90b7bbd-331f-42cd-bba0-0d60acde7d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:14:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-626c7ef4-d4b4-4cf0-9659-14df281d9abe tempest-SnapshotsActionsTest-1983587027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a90b7bbd-331f-42cd-bba0-0d60acde7d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:14:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-626c7ef4-d4b4-4cf0-9659-14df281d9abe tempest-SnapshotsActionsTest-1983587027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aef42df-6305-4376-81f8-4d113d1734ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:14:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-626c7ef4-d4b4-4cf0-9659-14df281d9abe tempest-SnapshotsActionsTest-1983587027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aef42df-6305-4376-81f8-4d113d1734ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee4e9386-0b3c-4207-8b14-32b073ed06da', 'volume_name': 'volume-ee4e9386-0b3c-4207-8b14-32b073ed06da', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:14:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-626c7ef4-d4b4-4cf0-9659-14df281d9abe tempest-SnapshotsActionsTest-1983587027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a55e27ea-ce0e-4b40-af42-ca4e6d34ff2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:14:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-626c7ef4-d4b4-4cf0-9659-14df281d9abe tempest-SnapshotsActionsTest-1983587027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a55e27ea-ce0e-4b40-af42-ca4e6d34ff2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:14:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-626c7ef4-d4b4-4cf0-9659-14df281d9abe tempest-SnapshotsActionsTest-1983587027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d000292e-4121-4d14-b33e-315a458d8db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:14:33 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-626c7ef4-d4b4-4cf0-9659-14df281d9abe tempest-SnapshotsActionsTest-1983587027 None] Volume ee4e9386-0b3c-4207-8b14-32b073ed06da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee4e9386-0b3c-4207-8b14-32b073ed06da', 'volume_size': 1} Nov 04 12:14:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-626c7ef4-d4b4-4cf0-9659-14df281d9abe tempest-SnapshotsActionsTest-1983587027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:14:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-626c7ef4-d4b4-4cf0-9659-14df281d9abe tempest-SnapshotsActionsTest-1983587027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:14:33 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-626c7ef4-d4b4-4cf0-9659-14df281d9abe tempest-SnapshotsActionsTest-1983587027 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:14:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2034124475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee4e9386-0b3c-4207-8b14-32b073ed06da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4a7a73e7aa7480ab2c71b4511e42e07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:14:33Z,use_quota=True,user_id='b74ffbe4ce1f4d748326e6f37d54cc62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:14:33 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-626c7ef4-d4b4-4cf0-9659-14df281d9abe tempest-SnapshotsActionsTest-1983587027 None] Creating volume ee4e9386-0b3c-4207-8b14-32b073ed06da {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:14:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-626c7ef4-d4b4-4cf0-9659-14df281d9abe tempest-SnapshotsActionsTest-1983587027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:14:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-626c7ef4-d4b4-4cf0-9659-14df281d9abe tempest-SnapshotsActionsTest-1983587027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:14:33 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-626c7ef4-d4b4-4cf0-9659-14df281d9abe tempest-SnapshotsActionsTest-1983587027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:14:33 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-626c7ef4-d4b4-4cf0-9659-14df281d9abe tempest-SnapshotsActionsTest-1983587027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:14:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-626c7ef4-d4b4-4cf0-9659-14df281d9abe tempest-SnapshotsActionsTest-1983587027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:14:33 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-626c7ef4-d4b4-4cf0-9659-14df281d9abe tempest-SnapshotsActionsTest-1983587027 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:14:33 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-626c7ef4-d4b4-4cf0-9659-14df281d9abe tempest-SnapshotsActionsTest-1983587027 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:14:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-626c7ef4-d4b4-4cf0-9659-14df281d9abe tempest-SnapshotsActionsTest-1983587027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:33 devstack sudo[92415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da 1073741824 Nov 04 12:14:33 devstack sudo[92415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:33 devstack sudo[92415]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-626c7ef4-d4b4-4cf0-9659-14df281d9abe tempest-SnapshotsActionsTest-1983587027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da 1073741824" returned: 0 in 0.492s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-626c7ef4-d4b4-4cf0-9659-14df281d9abe tempest-SnapshotsActionsTest-1983587027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:33 devstack sudo[92420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da Nov 04 12:14:33 devstack sudo[92420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:34 devstack sudo[92420]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-626c7ef4-d4b4-4cf0-9659-14df281d9abe tempest-SnapshotsActionsTest-1983587027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da" returned: 0 in 0.287s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:34 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-626c7ef4-d4b4-4cf0-9659-14df281d9abe tempest-SnapshotsActionsTest-1983587027 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:14:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-626c7ef4-d4b4-4cf0-9659-14df281d9abe tempest-SnapshotsActionsTest-1983587027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:14:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-626c7ef4-d4b4-4cf0-9659-14df281d9abe tempest-SnapshotsActionsTest-1983587027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d000292e-4121-4d14-b33e-315a458d8db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee4e9386-0b3c-4207-8b14-32b073ed06da', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:14:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-626c7ef4-d4b4-4cf0-9659-14df281d9abe tempest-SnapshotsActionsTest-1983587027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bf899a0-d3c5-4157-96da-94f540389529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:14:34 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-626c7ef4-d4b4-4cf0-9659-14df281d9abe tempest-SnapshotsActionsTest-1983587027 None] Volume volume-ee4e9386-0b3c-4207-8b14-32b073ed06da (ee4e9386-0b3c-4207-8b14-32b073ed06da): created successfully Nov 04 12:14:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-626c7ef4-d4b4-4cf0-9659-14df281d9abe tempest-SnapshotsActionsTest-1983587027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bf899a0-d3c5-4157-96da-94f540389529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:14:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-626c7ef4-d4b4-4cf0-9659-14df281d9abe tempest-SnapshotsActionsTest-1983587027 None] Flow 'volume_create_manager' (f5ce19e5-f20e-40da-915e-ec3086365b08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:14:34 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-626c7ef4-d4b4-4cf0-9659-14df281d9abe tempest-SnapshotsActionsTest-1983587027 None] Created volume successfully. Nov 04 12:14:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-48e49974-cac9-4706-bfae-95ee860e59fb tempest-SnapshotsActionsTest-1983587027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:14:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-48e49974-cac9-4706-bfae-95ee860e59fb tempest-SnapshotsActionsTest-1983587027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:14:35 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-48e49974-cac9-4706-bfae-95ee860e59fb tempest-SnapshotsActionsTest-1983587027 None] Creating offline snapshot 18ddc5e3-c5b2-4dc1-9836-90658e310a86 of volume ee4e9386-0b3c-4207-8b14-32b073ed06da {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 12:14:35 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f7ca54-f6a6-480b-8d94-0afe05ab91c3]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:14:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-48e49974-cac9-4706-bfae-95ee860e59fb tempest-SnapshotsActionsTest-1983587027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:35 devstack sudo[92448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da Nov 04 12:14:35 devstack sudo[92448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:36 devstack sudo[92448]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-48e49974-cac9-4706-bfae-95ee860e59fb tempest-SnapshotsActionsTest-1983587027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da" returned: 0 in 0.449s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-48e49974-cac9-4706-bfae-95ee860e59fb tempest-SnapshotsActionsTest-1983587027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.18ddc5e3-c5b2-4dc1-9836-90658e310a86 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:36 devstack sudo[92453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.18ddc5e3-c5b2-4dc1-9836-90658e310a86 1G Nov 04 12:14:36 devstack sudo[92453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:36 devstack sudo[92453]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-48e49974-cac9-4706-bfae-95ee860e59fb tempest-SnapshotsActionsTest-1983587027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.18ddc5e3-c5b2-4dc1-9836-90658e310a86 1G" returned: 0 in 0.572s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-48e49974-cac9-4706-bfae-95ee860e59fb tempest-SnapshotsActionsTest-1983587027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee4e9386-0b3c-4207-8b14-32b073ed06da -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.18ddc5e3-c5b2-4dc1-9836-90658e310a86 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:36 devstack sudo[92459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee4e9386-0b3c-4207-8b14-32b073ed06da -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.18ddc5e3-c5b2-4dc1-9836-90658e310a86 Nov 04 12:14:36 devstack sudo[92459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:37 devstack sudo[92459]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-48e49974-cac9-4706-bfae-95ee860e59fb tempest-SnapshotsActionsTest-1983587027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee4e9386-0b3c-4207-8b14-32b073ed06da -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.18ddc5e3-c5b2-4dc1-9836-90658e310a86" returned: 0 in 0.409s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:37 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-48e49974-cac9-4706-bfae-95ee860e59fb tempest-SnapshotsActionsTest-1983587027 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.18ddc5e3-c5b2-4dc1-9836-90658e310a86 is being set with open permissions: ugo+rw Nov 04 12:14:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-48e49974-cac9-4706-bfae-95ee860e59fb tempest-SnapshotsActionsTest-1983587027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.18ddc5e3-c5b2-4dc1-9836-90658e310a86 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:37 devstack sudo[92464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.18ddc5e3-c5b2-4dc1-9836-90658e310a86 Nov 04 12:14:37 devstack sudo[92464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:37 devstack sudo[92464]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-48e49974-cac9-4706-bfae-95ee860e59fb tempest-SnapshotsActionsTest-1983587027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.18ddc5e3-c5b2-4dc1-9836-90658e310a86" returned: 0 in 0.401s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-48e49974-cac9-4706-bfae-95ee860e59fb tempest-SnapshotsActionsTest-1983587027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:37 devstack sudo[92467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.info Nov 04 12:14:37 devstack sudo[92467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:37 devstack sudo[92467]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-48e49974-cac9-4706-bfae-95ee860e59fb tempest-SnapshotsActionsTest-1983587027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.info" returned: 0 in 0.393s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:37 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-48e49974-cac9-4706-bfae-95ee860e59fb tempest-SnapshotsActionsTest-1983587027 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.info is being set with open permissions: ugo+rw Nov 04 12:14:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-48e49974-cac9-4706-bfae-95ee860e59fb tempest-SnapshotsActionsTest-1983587027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:37 devstack sudo[92470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.info Nov 04 12:14:37 devstack sudo[92470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:38 devstack sudo[92470]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-48e49974-cac9-4706-bfae-95ee860e59fb tempest-SnapshotsActionsTest-1983587027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.info" returned: 0 in 0.421s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-48e49974-cac9-4706-bfae-95ee860e59fb tempest-SnapshotsActionsTest-1983587027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.785s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:14:38 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-48e49974-cac9-4706-bfae-95ee860e59fb tempest-SnapshotsActionsTest-1983587027 None] Create snapshot completed successfully Nov 04 12:14:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-84e3f7d9-97f1-417e-b16d-b75e83d5feb3 tempest-SnapshotsActionsTest-1983587027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:14:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-84e3f7d9-97f1-417e-b16d-b75e83d5feb3 tempest-SnapshotsActionsTest-1983587027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:14:39 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-84e3f7d9-97f1-417e-b16d-b75e83d5feb3 tempest-SnapshotsActionsTest-1983587027 None] Creating offline snapshot c347d8f4-3c44-4469-8c24-168ed8269519 of volume ee4e9386-0b3c-4207-8b14-32b073ed06da {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 12:14:39 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecfbd2d7-f0d2-4cff-bd00-9b5b5f68e595]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:14:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-84e3f7d9-97f1-417e-b16d-b75e83d5feb3 tempest-SnapshotsActionsTest-1983587027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.18ddc5e3-c5b2-4dc1-9836-90658e310a86 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:39 devstack sudo[92475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.18ddc5e3-c5b2-4dc1-9836-90658e310a86 Nov 04 12:14:39 devstack sudo[92475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:40 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-120a72ae-2e2c-43f3-844b-7058d717b1b0 tempest-GroupsTest-1749445549 None] Group tempest-Group1-1594969421: creating Nov 04 12:14:40 devstack sudo[92475]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-84e3f7d9-97f1-417e-b16d-b75e83d5feb3 tempest-SnapshotsActionsTest-1983587027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.18ddc5e3-c5b2-4dc1-9836-90658e310a86" returned: 0 in 0.488s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:40 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-84e3f7d9-97f1-417e-b16d-b75e83d5feb3 tempest-SnapshotsActionsTest-1983587027 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee4e9386-0b3c-4207-8b14-32b073ed06da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 12:14:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-84e3f7d9-97f1-417e-b16d-b75e83d5feb3 tempest-SnapshotsActionsTest-1983587027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.18ddc5e3-c5b2-4dc1-9836-90658e310a86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.c347d8f4-3c44-4469-8c24-168ed8269519 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:40 devstack sudo[92480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.18ddc5e3-c5b2-4dc1-9836-90658e310a86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.c347d8f4-3c44-4469-8c24-168ed8269519 1G Nov 04 12:14:40 devstack sudo[92480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:40 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-120a72ae-2e2c-43f3-844b-7058d717b1b0 tempest-GroupsTest-1749445549 None] Group tempest-Group1-1594969421: created successfully Nov 04 12:14:40 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-120a72ae-2e2c-43f3-844b-7058d717b1b0 tempest-GroupsTest-1749445549 None] Create group completed successfully. Nov 04 12:14:40 devstack sudo[92480]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-84e3f7d9-97f1-417e-b16d-b75e83d5feb3 tempest-SnapshotsActionsTest-1983587027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.18ddc5e3-c5b2-4dc1-9836-90658e310a86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.c347d8f4-3c44-4469-8c24-168ed8269519 1G" returned: 0 in 0.676s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-84e3f7d9-97f1-417e-b16d-b75e83d5feb3 tempest-SnapshotsActionsTest-1983587027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.18ddc5e3-c5b2-4dc1-9836-90658e310a86 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.c347d8f4-3c44-4469-8c24-168ed8269519 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:41 devstack sudo[92487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.18ddc5e3-c5b2-4dc1-9836-90658e310a86 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.c347d8f4-3c44-4469-8c24-168ed8269519 Nov 04 12:14:41 devstack sudo[92487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:41 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-e8dca213-596b-43ae-8872-86e452a655ae req-96ede357-67ac-4699-97f7-9cb330bf2b9a tempest-ServerActionsTestOtherA-1526177158 None] Terminate volume connection completed successfully. Nov 04 12:14:41 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-e8dca213-596b-43ae-8872-86e452a655ae req-96ede357-67ac-4699-97f7-9cb330bf2b9a tempest-ServerActionsTestOtherA-1526177158 None] Deleting attachment 075d1abb-db9c-420d-8cc6-6fb51d7d2e64. {{(pid=87095) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 12:14:41 devstack sudo[92487]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-84e3f7d9-97f1-417e-b16d-b75e83d5feb3 tempest-SnapshotsActionsTest-1983587027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.18ddc5e3-c5b2-4dc1-9836-90658e310a86 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.c347d8f4-3c44-4469-8c24-168ed8269519" returned: 0 in 0.514s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:41 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-84e3f7d9-97f1-417e-b16d-b75e83d5feb3 tempest-SnapshotsActionsTest-1983587027 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.c347d8f4-3c44-4469-8c24-168ed8269519 is being set with open permissions: ugo+rw Nov 04 12:14:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-84e3f7d9-97f1-417e-b16d-b75e83d5feb3 tempest-SnapshotsActionsTest-1983587027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.c347d8f4-3c44-4469-8c24-168ed8269519 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:41 devstack sudo[92495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.c347d8f4-3c44-4469-8c24-168ed8269519 Nov 04 12:14:41 devstack sudo[92495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:41 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-8d6acc5e-894a-46e2-ab90-846b0348bd95 tempest-GroupsTest-1749445549 None] Group tempest-Group2-1982473943: creating Nov 04 12:14:41 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-8d6acc5e-894a-46e2-ab90-846b0348bd95 tempest-GroupsTest-1749445549 None] Group tempest-Group2-1982473943: created successfully Nov 04 12:14:41 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-8d6acc5e-894a-46e2-ab90-846b0348bd95 tempest-GroupsTest-1749445549 None] Create group completed successfully. Nov 04 12:14:41 devstack sudo[92495]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-84e3f7d9-97f1-417e-b16d-b75e83d5feb3 tempest-SnapshotsActionsTest-1983587027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.c347d8f4-3c44-4469-8c24-168ed8269519" returned: 0 in 0.355s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-84e3f7d9-97f1-417e-b16d-b75e83d5feb3 tempest-SnapshotsActionsTest-1983587027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.212s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:14:41 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-84e3f7d9-97f1-417e-b16d-b75e83d5feb3 tempest-SnapshotsActionsTest-1983587027 None] Create snapshot completed successfully Nov 04 12:14:43 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-3798e5be-0e2b-4b6c-ae48-a4ce293f87ec tempest-VolumesActionsTest-77504308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:14:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3798e5be-0e2b-4b6c-ae48-a4ce293f87ec tempest-VolumesActionsTest-77504308 None] Flow 'volume_create_manager' (5a1a02e4-43ea-49d4-9de5-e41a099959e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:14:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3798e5be-0e2b-4b6c-ae48-a4ce293f87ec tempest-VolumesActionsTest-77504308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcfdcb4a-67d1-4bbc-8b6b-1f35c75a8ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:14:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3798e5be-0e2b-4b6c-ae48-a4ce293f87ec tempest-VolumesActionsTest-77504308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcfdcb4a-67d1-4bbc-8b6b-1f35c75a8ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:14:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2041038098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63ea78bf-277d-4ebd-833d-39b9f3f67bd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a7a89799a5f40bb84b4a0f4acf86118',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:14:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:14:43Z,use_quota=True,user_id='9fad84cb0eee4558b4ab644ddfee4972',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:14:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3798e5be-0e2b-4b6c-ae48-a4ce293f87ec tempest-VolumesActionsTest-77504308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a18ddbc-1eb2-4b7a-add5-c006dc72f6de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:14:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3798e5be-0e2b-4b6c-ae48-a4ce293f87ec tempest-VolumesActionsTest-77504308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a18ddbc-1eb2-4b7a-add5-c006dc72f6de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:14:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3798e5be-0e2b-4b6c-ae48-a4ce293f87ec tempest-VolumesActionsTest-77504308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69fd68ec-d84d-4eff-a800-ddf3bd48fc6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:14:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3798e5be-0e2b-4b6c-ae48-a4ce293f87ec tempest-VolumesActionsTest-77504308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69fd68ec-d84d-4eff-a800-ddf3bd48fc6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63ea78bf-277d-4ebd-833d-39b9f3f67bd8', 'volume_name': 'volume-63ea78bf-277d-4ebd-833d-39b9f3f67bd8', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:14:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3798e5be-0e2b-4b6c-ae48-a4ce293f87ec tempest-VolumesActionsTest-77504308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (035c24c3-3ff9-4004-bc32-3a897706d100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:14:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3798e5be-0e2b-4b6c-ae48-a4ce293f87ec tempest-VolumesActionsTest-77504308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (035c24c3-3ff9-4004-bc32-3a897706d100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:14:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3798e5be-0e2b-4b6c-ae48-a4ce293f87ec tempest-VolumesActionsTest-77504308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (914d0b3c-e671-4468-8bc1-870965967256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:14:43 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-3798e5be-0e2b-4b6c-ae48-a4ce293f87ec tempest-VolumesActionsTest-77504308 None] Volume 63ea78bf-277d-4ebd-833d-39b9f3f67bd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63ea78bf-277d-4ebd-833d-39b9f3f67bd8', 'volume_size': 1} Nov 04 12:14:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3798e5be-0e2b-4b6c-ae48-a4ce293f87ec tempest-VolumesActionsTest-77504308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:14:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3798e5be-0e2b-4b6c-ae48-a4ce293f87ec tempest-VolumesActionsTest-77504308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:14:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3798e5be-0e2b-4b6c-ae48-a4ce293f87ec tempest-VolumesActionsTest-77504308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:14:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2041038098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63ea78bf-277d-4ebd-833d-39b9f3f67bd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a7a89799a5f40bb84b4a0f4acf86118',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:14:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:14:43Z,use_quota=True,user_id='9fad84cb0eee4558b4ab644ddfee4972',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:14:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-3798e5be-0e2b-4b6c-ae48-a4ce293f87ec tempest-VolumesActionsTest-77504308 None] Creating volume 63ea78bf-277d-4ebd-833d-39b9f3f67bd8 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:14:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3798e5be-0e2b-4b6c-ae48-a4ce293f87ec tempest-VolumesActionsTest-77504308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:14:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3798e5be-0e2b-4b6c-ae48-a4ce293f87ec tempest-VolumesActionsTest-77504308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:14:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3798e5be-0e2b-4b6c-ae48-a4ce293f87ec tempest-VolumesActionsTest-77504308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:14:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3798e5be-0e2b-4b6c-ae48-a4ce293f87ec tempest-VolumesActionsTest-77504308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:14:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3798e5be-0e2b-4b6c-ae48-a4ce293f87ec tempest-VolumesActionsTest-77504308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:14:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3798e5be-0e2b-4b6c-ae48-a4ce293f87ec tempest-VolumesActionsTest-77504308 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:14:43 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-3798e5be-0e2b-4b6c-ae48-a4ce293f87ec tempest-VolumesActionsTest-77504308 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:14:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3798e5be-0e2b-4b6c-ae48-a4ce293f87ec tempest-VolumesActionsTest-77504308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-63ea78bf-277d-4ebd-833d-39b9f3f67bd8 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:43 devstack sudo[92524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-63ea78bf-277d-4ebd-833d-39b9f3f67bd8 1073741824 Nov 04 12:14:43 devstack sudo[92524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:43 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3084a381-3894-44fe-b43e-d56162bc0489 tempest-SnapshotsActionsTest-572905002 None] Acquiring lock "cinder-c347d8f4-3c44-4469-8c24-168ed8269519-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:14:43 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3084a381-3894-44fe-b43e-d56162bc0489 tempest-SnapshotsActionsTest-572905002 None] Lock "cinder-c347d8f4-3c44-4469-8c24-168ed8269519-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:14:43 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3084a381-3894-44fe-b43e-d56162bc0489 tempest-SnapshotsActionsTest-572905002 None] Acquiring lock "cinder-quobyte-ee4e9386-0b3c-4207-8b14-32b073ed06da" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:14:43 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3084a381-3894-44fe-b43e-d56162bc0489 tempest-SnapshotsActionsTest-572905002 None] Lock "cinder-quobyte-ee4e9386-0b3c-4207-8b14-32b073ed06da" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:14:43 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3084a381-3894-44fe-b43e-d56162bc0489 tempest-SnapshotsActionsTest-572905002 None] Acquiring lock "cinder-quobyte-c347d8f4-3c44-4469-8c24-168ed8269519" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:14:43 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3084a381-3894-44fe-b43e-d56162bc0489 tempest-SnapshotsActionsTest-572905002 None] Lock "cinder-quobyte-c347d8f4-3c44-4469-8c24-168ed8269519" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:14:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-3084a381-3894-44fe-b43e-d56162bc0489 tempest-SnapshotsActionsTest-572905002 None] Deleting offline snapshot c347d8f4-3c44-4469-8c24-168ed8269519 of volume ee4e9386-0b3c-4207-8b14-32b073ed06da {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 12:14:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-3084a381-3894-44fe-b43e-d56162bc0489 tempest-SnapshotsActionsTest-572905002 None] snapshot_file for this snap is: volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.c347d8f4-3c44-4469-8c24-168ed8269519 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 12:14:43 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb985f8e-9d6c-4789-a601-9a5c9ca9455f]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:14:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3084a381-3894-44fe-b43e-d56162bc0489 tempest-SnapshotsActionsTest-572905002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.c347d8f4-3c44-4469-8c24-168ed8269519 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:43 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b3445f5-af1d-4d60-b0d0-ada43a414184 tempest-GroupsTest-1749445549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:14:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1b3445f5-af1d-4d60-b0d0-ada43a414184 tempest-GroupsTest-1749445549 None] Flow 'volume_create_manager' (eeccbed6-d912-4bdb-8bc2-385df4c1efe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:14:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1b3445f5-af1d-4d60-b0d0-ada43a414184 tempest-GroupsTest-1749445549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f461f83b-4730-40ef-9a48-879394c01889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:14:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1b3445f5-af1d-4d60-b0d0-ada43a414184 tempest-GroupsTest-1749445549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f461f83b-4730-40ef-9a48-879394c01889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:14:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1497688884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=92af0b23-8ffe-4705-967e-218a46ab606c,host='devstack@QuobyteHD#QuobyteHD',id=91a10a7f-45a5-479f-adcf-4d1d9ba8f26e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c25fa29436f0490bb78fad935bf08b25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:14:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:14:44Z,use_quota=True,user_id='d9b9b56464bd48148cd36757f93c4324',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d406ac-5844-48aa-8ffd-6bd703aec8d8),volume_type_id=15d406ac-5844-48aa-8ffd-6bd703aec8d8)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:14:43 devstack sudo[92528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.c347d8f4-3c44-4469-8c24-168ed8269519 Nov 04 12:14:43 devstack sudo[92528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1b3445f5-af1d-4d60-b0d0-ada43a414184 tempest-GroupsTest-1749445549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb4433ec-cd94-4583-be47-ea2bfc80d335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:14:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1b3445f5-af1d-4d60-b0d0-ada43a414184 tempest-GroupsTest-1749445549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb4433ec-cd94-4583-be47-ea2bfc80d335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:14:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1b3445f5-af1d-4d60-b0d0-ada43a414184 tempest-GroupsTest-1749445549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a890bd1b-105b-4dd0-93d5-f5e1380b2052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:14:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1b3445f5-af1d-4d60-b0d0-ada43a414184 tempest-GroupsTest-1749445549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a890bd1b-105b-4dd0-93d5-f5e1380b2052) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91a10a7f-45a5-479f-adcf-4d1d9ba8f26e', 'volume_name': 'volume-91a10a7f-45a5-479f-adcf-4d1d9ba8f26e', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:14:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1b3445f5-af1d-4d60-b0d0-ada43a414184 tempest-GroupsTest-1749445549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3eec3364-908e-43f5-ae71-71187fd5145d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:14:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1b3445f5-af1d-4d60-b0d0-ada43a414184 tempest-GroupsTest-1749445549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3eec3364-908e-43f5-ae71-71187fd5145d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:14:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1b3445f5-af1d-4d60-b0d0-ada43a414184 tempest-GroupsTest-1749445549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c35d7b93-714a-4d89-bc39-708b06c844c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:14:43 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-1b3445f5-af1d-4d60-b0d0-ada43a414184 tempest-GroupsTest-1749445549 None] Volume 91a10a7f-45a5-479f-adcf-4d1d9ba8f26e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91a10a7f-45a5-479f-adcf-4d1d9ba8f26e', 'volume_size': 1} Nov 04 12:14:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1b3445f5-af1d-4d60-b0d0-ada43a414184 tempest-GroupsTest-1749445549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:14:43 devstack sudo[92524]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3798e5be-0e2b-4b6c-ae48-a4ce293f87ec tempest-VolumesActionsTest-77504308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-63ea78bf-277d-4ebd-833d-39b9f3f67bd8 1073741824" returned: 0 in 0.698s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3798e5be-0e2b-4b6c-ae48-a4ce293f87ec tempest-VolumesActionsTest-77504308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-63ea78bf-277d-4ebd-833d-39b9f3f67bd8 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:44 devstack sudo[92536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-63ea78bf-277d-4ebd-833d-39b9f3f67bd8 Nov 04 12:14:44 devstack sudo[92536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:44 devstack sudo[92528]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3084a381-3894-44fe-b43e-d56162bc0489 tempest-SnapshotsActionsTest-572905002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.c347d8f4-3c44-4469-8c24-168ed8269519" returned: 0 in 0.477s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:44 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-3084a381-3894-44fe-b43e-d56162bc0489 tempest-SnapshotsActionsTest-572905002 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee4e9386-0b3c-4207-8b14-32b073ed06da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 12:14:44 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b90daa-320f-48e5-b976-57c34ffb3f5e]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:14:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3084a381-3894-44fe-b43e-d56162bc0489 tempest-SnapshotsActionsTest-572905002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.18ddc5e3-c5b2-4dc1-9836-90658e310a86 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:44 devstack sudo[92539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.18ddc5e3-c5b2-4dc1-9836-90658e310a86 Nov 04 12:14:44 devstack sudo[92539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:44 devstack sudo[92536]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3798e5be-0e2b-4b6c-ae48-a4ce293f87ec tempest-VolumesActionsTest-77504308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-63ea78bf-277d-4ebd-833d-39b9f3f67bd8" returned: 0 in 0.332s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:44 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3798e5be-0e2b-4b6c-ae48-a4ce293f87ec tempest-VolumesActionsTest-77504308 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:14:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3798e5be-0e2b-4b6c-ae48-a4ce293f87ec tempest-VolumesActionsTest-77504308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:14:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1b3445f5-af1d-4d60-b0d0-ada43a414184 tempest-GroupsTest-1749445549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.518s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:14:44 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1b3445f5-af1d-4d60-b0d0-ada43a414184 tempest-GroupsTest-1749445549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=92af0b23-8ffe-4705-967e-218a46ab606c,created_at=2026-11-04T11:14:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1497688884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=92af0b23-8ffe-4705-967e-218a46ab606c,host='devstack@QuobyteHD#QuobyteHD',id=91a10a7f-45a5-479f-adcf-4d1d9ba8f26e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c25fa29436f0490bb78fad935bf08b25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:14:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:14:44Z,use_quota=True,user_id='d9b9b56464bd48148cd36757f93c4324',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d406ac-5844-48aa-8ffd-6bd703aec8d8),volume_type_id=15d406ac-5844-48aa-8ffd-6bd703aec8d8)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:14:44 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-1b3445f5-af1d-4d60-b0d0-ada43a414184 tempest-GroupsTest-1749445549 None] Creating volume 91a10a7f-45a5-479f-adcf-4d1d9ba8f26e {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:14:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1b3445f5-af1d-4d60-b0d0-ada43a414184 tempest-GroupsTest-1749445549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:14:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1b3445f5-af1d-4d60-b0d0-ada43a414184 tempest-GroupsTest-1749445549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:14:44 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1b3445f5-af1d-4d60-b0d0-ada43a414184 tempest-GroupsTest-1749445549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:14:44 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1b3445f5-af1d-4d60-b0d0-ada43a414184 tempest-GroupsTest-1749445549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:14:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1b3445f5-af1d-4d60-b0d0-ada43a414184 tempest-GroupsTest-1749445549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:14:44 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1b3445f5-af1d-4d60-b0d0-ada43a414184 tempest-GroupsTest-1749445549 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:14:44 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-1b3445f5-af1d-4d60-b0d0-ada43a414184 tempest-GroupsTest-1749445549 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:14:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1b3445f5-af1d-4d60-b0d0-ada43a414184 tempest-GroupsTest-1749445549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-91a10a7f-45a5-479f-adcf-4d1d9ba8f26e 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3798e5be-0e2b-4b6c-ae48-a4ce293f87ec tempest-VolumesActionsTest-77504308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (914d0b3c-e671-4468-8bc1-870965967256) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63ea78bf-277d-4ebd-833d-39b9f3f67bd8', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:14:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3798e5be-0e2b-4b6c-ae48-a4ce293f87ec tempest-VolumesActionsTest-77504308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ab6f3ae-9f40-47fd-9e6a-4db3134d27a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:14:44 devstack sudo[92543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-91a10a7f-45a5-479f-adcf-4d1d9ba8f26e 1073741824 Nov 04 12:14:44 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-3798e5be-0e2b-4b6c-ae48-a4ce293f87ec tempest-VolumesActionsTest-77504308 None] Volume volume-63ea78bf-277d-4ebd-833d-39b9f3f67bd8 (63ea78bf-277d-4ebd-833d-39b9f3f67bd8): created successfully Nov 04 12:14:44 devstack sudo[92543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3798e5be-0e2b-4b6c-ae48-a4ce293f87ec tempest-VolumesActionsTest-77504308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ab6f3ae-9f40-47fd-9e6a-4db3134d27a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:14:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3798e5be-0e2b-4b6c-ae48-a4ce293f87ec tempest-VolumesActionsTest-77504308 None] Flow 'volume_create_manager' (5a1a02e4-43ea-49d4-9de5-e41a099959e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:14:44 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-3798e5be-0e2b-4b6c-ae48-a4ce293f87ec tempest-VolumesActionsTest-77504308 None] Created volume successfully. Nov 04 12:14:44 devstack sudo[92539]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3084a381-3894-44fe-b43e-d56162bc0489 tempest-SnapshotsActionsTest-572905002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.18ddc5e3-c5b2-4dc1-9836-90658e310a86" returned: 0 in 0.448s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:44 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-3084a381-3894-44fe-b43e-d56162bc0489 tempest-SnapshotsActionsTest-572905002 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee4e9386-0b3c-4207-8b14-32b073ed06da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 12:14:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3084a381-3894-44fe-b43e-d56162bc0489 tempest-SnapshotsActionsTest-572905002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.c347d8f4-3c44-4469-8c24-168ed8269519 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:44 devstack sudo[92548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.c347d8f4-3c44-4469-8c24-168ed8269519 Nov 04 12:14:44 devstack sudo[92548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:44 devstack sudo[92543]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1b3445f5-af1d-4d60-b0d0-ada43a414184 tempest-GroupsTest-1749445549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-91a10a7f-45a5-479f-adcf-4d1d9ba8f26e 1073741824" returned: 0 in 0.593s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1b3445f5-af1d-4d60-b0d0-ada43a414184 tempest-GroupsTest-1749445549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-91a10a7f-45a5-479f-adcf-4d1d9ba8f26e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:45 devstack sudo[92557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-91a10a7f-45a5-479f-adcf-4d1d9ba8f26e Nov 04 12:14:45 devstack sudo[92557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:45 devstack sudo[92548]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3084a381-3894-44fe-b43e-d56162bc0489 tempest-SnapshotsActionsTest-572905002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.c347d8f4-3c44-4469-8c24-168ed8269519" returned: 0 in 0.549s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3084a381-3894-44fe-b43e-d56162bc0489 tempest-SnapshotsActionsTest-572905002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.c347d8f4-3c44-4469-8c24-168ed8269519 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:45 devstack sudo[92559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.c347d8f4-3c44-4469-8c24-168ed8269519 Nov 04 12:14:45 devstack sudo[92559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:45 devstack sudo[92557]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1b3445f5-af1d-4d60-b0d0-ada43a414184 tempest-GroupsTest-1749445549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-91a10a7f-45a5-479f-adcf-4d1d9ba8f26e" returned: 0 in 0.276s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:45 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1b3445f5-af1d-4d60-b0d0-ada43a414184 tempest-GroupsTest-1749445549 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:14:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1b3445f5-af1d-4d60-b0d0-ada43a414184 tempest-GroupsTest-1749445549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:14:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1b3445f5-af1d-4d60-b0d0-ada43a414184 tempest-GroupsTest-1749445549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c35d7b93-714a-4d89-bc39-708b06c844c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91a10a7f-45a5-479f-adcf-4d1d9ba8f26e', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:14:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1b3445f5-af1d-4d60-b0d0-ada43a414184 tempest-GroupsTest-1749445549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6ac917a-5aef-49b3-a194-710e98292fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:14:45 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-1b3445f5-af1d-4d60-b0d0-ada43a414184 tempest-GroupsTest-1749445549 None] Volume volume-91a10a7f-45a5-479f-adcf-4d1d9ba8f26e (91a10a7f-45a5-479f-adcf-4d1d9ba8f26e): created successfully Nov 04 12:14:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1b3445f5-af1d-4d60-b0d0-ada43a414184 tempest-GroupsTest-1749445549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6ac917a-5aef-49b3-a194-710e98292fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:14:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1b3445f5-af1d-4d60-b0d0-ada43a414184 tempest-GroupsTest-1749445549 None] Flow 'volume_create_manager' (eeccbed6-d912-4bdb-8bc2-385df4c1efe7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:14:45 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-1b3445f5-af1d-4d60-b0d0-ada43a414184 tempest-GroupsTest-1749445549 None] Created volume successfully. Nov 04 12:14:45 devstack sudo[92559]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3084a381-3894-44fe-b43e-d56162bc0489 tempest-SnapshotsActionsTest-572905002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.c347d8f4-3c44-4469-8c24-168ed8269519" returned: 0 in 0.271s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:45 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3084a381-3894-44fe-b43e-d56162bc0489 tempest-SnapshotsActionsTest-572905002 None] Lock "cinder-quobyte-c347d8f4-3c44-4469-8c24-168ed8269519" released by "_delete_snapshot" :: held 1.911s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:14:45 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3084a381-3894-44fe-b43e-d56162bc0489 tempest-SnapshotsActionsTest-572905002 None] Lock "cinder-quobyte-ee4e9386-0b3c-4207-8b14-32b073ed06da" released by "delete_snapshot" :: held 1.953s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:14:45 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-3084a381-3894-44fe-b43e-d56162bc0489 tempest-SnapshotsActionsTest-572905002 None] Created reservations ['cff95502-c010-47ae-a71e-d1437a5efd78', '5c41c8d1-1051-4bf5-b214-a1c6bde62bac', '5a4315f4-73d5-42ef-a4a2-63cda99eaa7c', '34061aac-0bef-4ac9-858c-d29119d9a0ae'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:14:45 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-3084a381-3894-44fe-b43e-d56162bc0489 tempest-SnapshotsActionsTest-572905002 None] Delete snapshot completed successfully. Nov 04 12:14:45 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3084a381-3894-44fe-b43e-d56162bc0489 tempest-SnapshotsActionsTest-572905002 None] Lock "cinder-c347d8f4-3c44-4469-8c24-168ed8269519-delete_snapshot" released by "delete_snapshot" :: held 2.128s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:14:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6c7b71b9-e003-4865-8fcd-e54446c135c4 tempest-SnapshotsActionsTest-1983587027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:14:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6c7b71b9-e003-4865-8fcd-e54446c135c4 tempest-SnapshotsActionsTest-1983587027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:14:45 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-6c7b71b9-e003-4865-8fcd-e54446c135c4 tempest-SnapshotsActionsTest-1983587027 None] Creating offline snapshot 1ac89c2e-db94-4ddd-acf4-c95b95fbf8cb of volume ee4e9386-0b3c-4207-8b14-32b073ed06da {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 12:14:45 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b4cb5d-5da6-421f-9e58-71ce3bb2490b]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:14:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6c7b71b9-e003-4865-8fcd-e54446c135c4 tempest-SnapshotsActionsTest-1983587027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.18ddc5e3-c5b2-4dc1-9836-90658e310a86 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:46 devstack sudo[92566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.18ddc5e3-c5b2-4dc1-9836-90658e310a86 Nov 04 12:14:46 devstack sudo[92566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:46 devstack sudo[92566]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6c7b71b9-e003-4865-8fcd-e54446c135c4 tempest-SnapshotsActionsTest-1983587027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.18ddc5e3-c5b2-4dc1-9836-90658e310a86" returned: 0 in 0.477s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:46 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-6c7b71b9-e003-4865-8fcd-e54446c135c4 tempest-SnapshotsActionsTest-1983587027 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee4e9386-0b3c-4207-8b14-32b073ed06da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 12:14:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6c7b71b9-e003-4865-8fcd-e54446c135c4 tempest-SnapshotsActionsTest-1983587027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.18ddc5e3-c5b2-4dc1-9836-90658e310a86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.1ac89c2e-db94-4ddd-acf4-c95b95fbf8cb 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:46 devstack sudo[92571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.18ddc5e3-c5b2-4dc1-9836-90658e310a86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.1ac89c2e-db94-4ddd-acf4-c95b95fbf8cb 1G Nov 04 12:14:46 devstack sudo[92571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:47 devstack sudo[92571]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6c7b71b9-e003-4865-8fcd-e54446c135c4 tempest-SnapshotsActionsTest-1983587027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.18ddc5e3-c5b2-4dc1-9836-90658e310a86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.1ac89c2e-db94-4ddd-acf4-c95b95fbf8cb 1G" returned: 0 in 0.733s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6c7b71b9-e003-4865-8fcd-e54446c135c4 tempest-SnapshotsActionsTest-1983587027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.18ddc5e3-c5b2-4dc1-9836-90658e310a86 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.1ac89c2e-db94-4ddd-acf4-c95b95fbf8cb {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:47 devstack sudo[92578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.18ddc5e3-c5b2-4dc1-9836-90658e310a86 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.1ac89c2e-db94-4ddd-acf4-c95b95fbf8cb Nov 04 12:14:47 devstack sudo[92578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:47 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-cdae469a-7b65-456a-9e1a-8e6164c754ad tempest-GroupsTest-1749445549 None] Acquiring lock "cinder-quobyte-91a10a7f-45a5-479f-adcf-4d1d9ba8f26e" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:14:47 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-cdae469a-7b65-456a-9e1a-8e6164c754ad tempest-GroupsTest-1749445549 None] Lock "cinder-quobyte-91a10a7f-45a5-479f-adcf-4d1d9ba8f26e" acquired by "delete_volume" :: waited 0.022s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:14:47 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[01dba3b2-1df2-494e-97b1-4321c3c29ebb]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:14:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cdae469a-7b65-456a-9e1a-8e6164c754ad tempest-GroupsTest-1749445549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-91a10a7f-45a5-479f-adcf-4d1d9ba8f26e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:47 devstack sudo[92580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-91a10a7f-45a5-479f-adcf-4d1d9ba8f26e Nov 04 12:14:47 devstack sudo[92580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:47 devstack sudo[92578]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6c7b71b9-e003-4865-8fcd-e54446c135c4 tempest-SnapshotsActionsTest-1983587027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.18ddc5e3-c5b2-4dc1-9836-90658e310a86 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.1ac89c2e-db94-4ddd-acf4-c95b95fbf8cb" returned: 0 in 0.598s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:47 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-6c7b71b9-e003-4865-8fcd-e54446c135c4 tempest-SnapshotsActionsTest-1983587027 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.1ac89c2e-db94-4ddd-acf4-c95b95fbf8cb is being set with open permissions: ugo+rw Nov 04 12:14:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6c7b71b9-e003-4865-8fcd-e54446c135c4 tempest-SnapshotsActionsTest-1983587027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.1ac89c2e-db94-4ddd-acf4-c95b95fbf8cb {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:47 devstack sudo[92586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.1ac89c2e-db94-4ddd-acf4-c95b95fbf8cb Nov 04 12:14:47 devstack sudo[92586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:48 devstack sudo[92580]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cdae469a-7b65-456a-9e1a-8e6164c754ad tempest-GroupsTest-1749445549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-91a10a7f-45a5-479f-adcf-4d1d9ba8f26e" returned: 0 in 0.628s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cdae469a-7b65-456a-9e1a-8e6164c754ad tempest-GroupsTest-1749445549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-91a10a7f-45a5-479f-adcf-4d1d9ba8f26e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:48 devstack sudo[92595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-91a10a7f-45a5-479f-adcf-4d1d9ba8f26e Nov 04 12:14:48 devstack sudo[92595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:48 devstack sudo[92586]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6c7b71b9-e003-4865-8fcd-e54446c135c4 tempest-SnapshotsActionsTest-1983587027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.1ac89c2e-db94-4ddd-acf4-c95b95fbf8cb" returned: 0 in 0.383s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6c7b71b9-e003-4865-8fcd-e54446c135c4 tempest-SnapshotsActionsTest-1983587027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.374s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:14:48 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-6c7b71b9-e003-4865-8fcd-e54446c135c4 tempest-SnapshotsActionsTest-1983587027 None] Create snapshot completed successfully Nov 04 12:14:48 devstack sudo[92595]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cdae469a-7b65-456a-9e1a-8e6164c754ad tempest-GroupsTest-1749445549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-91a10a7f-45a5-479f-adcf-4d1d9ba8f26e" returned: 0 in 0.427s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:48 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-cdae469a-7b65-456a-9e1a-8e6164c754ad tempest-GroupsTest-1749445549 None] Lock "cinder-quobyte-91a10a7f-45a5-479f-adcf-4d1d9ba8f26e" released by "delete_volume" :: held 1.132s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:14:48 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-cdae469a-7b65-456a-9e1a-8e6164c754ad tempest-GroupsTest-1749445549 None] Created reservations ['0a55af5e-c74d-452e-b3a2-3f69f65aac20'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:14:48 devstack cinder-volume[87095]: WARNING cinder.quota [None req-cdae469a-7b65-456a-9e1a-8e6164c754ad tempest-GroupsTest-1749445549 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1589424217 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1589424217, it is now deprecated. Please use the default quota class for default quota. Nov 04 12:14:48 devstack cinder-volume[87095]: WARNING cinder.quota [None req-cdae469a-7b65-456a-9e1a-8e6164c754ad tempest-GroupsTest-1749445549 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1589424217 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1589424217, it is now deprecated. Please use the default quota class for default quota. Nov 04 12:14:48 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-cdae469a-7b65-456a-9e1a-8e6164c754ad tempest-GroupsTest-1749445549 None] Created reservations ['caf387a6-938b-4d01-a5cb-2e2ceb517ca6', '0814c044-d49f-44f0-85c9-1c284300b266', '1d6ecaf7-acaf-47f0-b280-85ebb8f5aca9', 'b2448d12-37b4-4e4d-ba43-2ad4210b5053'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:14:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cdae469a-7b65-456a-9e1a-8e6164c754ad tempest-GroupsTest-1749445549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:14:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cdae469a-7b65-456a-9e1a-8e6164c754ad tempest-GroupsTest-1749445549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:14:48 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-cdae469a-7b65-456a-9e1a-8e6164c754ad tempest-GroupsTest-1749445549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:14:48 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-cdae469a-7b65-456a-9e1a-8e6164c754ad tempest-GroupsTest-1749445549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:14:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cdae469a-7b65-456a-9e1a-8e6164c754ad tempest-GroupsTest-1749445549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:14:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cdae469a-7b65-456a-9e1a-8e6164c754ad tempest-GroupsTest-1749445549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:48 devstack sudo[92611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:14:48 devstack sudo[92611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:49 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-fad26763-4cc9-4ab3-900c-203082975b03 tempest-SnapshotsActionsTest-572905002 None] Acquiring lock "cinder-1ac89c2e-db94-4ddd-acf4-c95b95fbf8cb-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:14:49 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-fad26763-4cc9-4ab3-900c-203082975b03 tempest-SnapshotsActionsTest-572905002 None] Lock "cinder-1ac89c2e-db94-4ddd-acf4-c95b95fbf8cb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:14:49 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-fad26763-4cc9-4ab3-900c-203082975b03 tempest-SnapshotsActionsTest-572905002 None] Acquiring lock "cinder-quobyte-ee4e9386-0b3c-4207-8b14-32b073ed06da" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:14:49 devstack sudo[92611]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:49 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-fad26763-4cc9-4ab3-900c-203082975b03 tempest-SnapshotsActionsTest-572905002 None] Lock "cinder-quobyte-ee4e9386-0b3c-4207-8b14-32b073ed06da" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:14:49 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-fad26763-4cc9-4ab3-900c-203082975b03 tempest-SnapshotsActionsTest-572905002 None] Acquiring lock "cinder-quobyte-1ac89c2e-db94-4ddd-acf4-c95b95fbf8cb" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:14:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cdae469a-7b65-456a-9e1a-8e6164c754ad tempest-GroupsTest-1749445549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.402s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:49 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-cdae469a-7b65-456a-9e1a-8e6164c754ad tempest-GroupsTest-1749445549 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:14:49 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9725426-6854-4c32-9b1b-232407df27c8 tempest-ServerActionsTestOtherA-1526177158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:14:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a9725426-6854-4c32-9b1b-232407df27c8 tempest-ServerActionsTestOtherA-1526177158 None] Flow 'volume_create_manager' (e1e1c423-c821-4594-9fd3-222eff584834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:14:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a9725426-6854-4c32-9b1b-232407df27c8 tempest-ServerActionsTestOtherA-1526177158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab33f631-453f-4bb8-8826-8daa17bcfb51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:14:49 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-cdae469a-7b65-456a-9e1a-8e6164c754ad tempest-GroupsTest-1749445549 None] Delete group completed successfully. Nov 04 12:14:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a9725426-6854-4c32-9b1b-232407df27c8 tempest-ServerActionsTestOtherA-1526177158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab33f631-453f-4bb8-8826-8daa17bcfb51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:14:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-538653052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f5306af-c4b6-474c-93fa-aa3638b46630,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91f7feb2ed564a598d1806a492a31193',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:14:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:14:49Z,use_quota=True,user_id='1de4ad7c8f3848f3b97b917a5f9d3c0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:14:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a9725426-6854-4c32-9b1b-232407df27c8 tempest-ServerActionsTestOtherA-1526177158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47645555-0ab6-44f5-ad9f-b3b3cf3a03a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:14:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a9725426-6854-4c32-9b1b-232407df27c8 tempest-ServerActionsTestOtherA-1526177158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47645555-0ab6-44f5-ad9f-b3b3cf3a03a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:14:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a9725426-6854-4c32-9b1b-232407df27c8 tempest-ServerActionsTestOtherA-1526177158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac6333c6-ab2f-4f78-84a0-53448977dea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:14:49 devstack cinder-volume[87095]: DEBUG cinder.image.glance [None req-a9725426-6854-4c32-9b1b-232407df27c8 tempest-ServerActionsTestOtherA-1526177158 None] Creating Keystone auth plugin from conf {{(pid=87095) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 04 12:14:49 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-fad26763-4cc9-4ab3-900c-203082975b03 tempest-SnapshotsActionsTest-572905002 None] Lock "cinder-quobyte-1ac89c2e-db94-4ddd-acf4-c95b95fbf8cb" acquired by "_delete_snapshot" :: waited 0.111s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:14:49 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-fad26763-4cc9-4ab3-900c-203082975b03 tempest-SnapshotsActionsTest-572905002 None] Deleting offline snapshot 1ac89c2e-db94-4ddd-acf4-c95b95fbf8cb of volume ee4e9386-0b3c-4207-8b14-32b073ed06da {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 12:14:49 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-fad26763-4cc9-4ab3-900c-203082975b03 tempest-SnapshotsActionsTest-572905002 None] snapshot_file for this snap is: volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.1ac89c2e-db94-4ddd-acf4-c95b95fbf8cb {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 12:14:49 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2fe785-84e5-486f-9179-d69af2372cb1]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:14:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fad26763-4cc9-4ab3-900c-203082975b03 tempest-SnapshotsActionsTest-572905002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.1ac89c2e-db94-4ddd-acf4-c95b95fbf8cb {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:49 devstack sudo[92614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.1ac89c2e-db94-4ddd-acf4-c95b95fbf8cb Nov 04 12:14:49 devstack sudo[92614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a9725426-6854-4c32-9b1b-232407df27c8 tempest-ServerActionsTestOtherA-1526177158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac6333c6-ab2f-4f78-84a0-53448977dea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4f5306af-c4b6-474c-93fa-aa3638b46630', 'volume_name': 'volume-4f5306af-c4b6-474c-93fa-aa3638b46630', 'volume_size': 1, 'image_id': 'b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '021c36f8b23249aabf2d5e363bccb8bc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af', 'created_at': datetime.datetime(2026, 11, 4, 11, 4, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 11, 4, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:14:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a9725426-6854-4c32-9b1b-232407df27c8 tempest-ServerActionsTestOtherA-1526177158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b74eb52-5680-454a-afb4-501c6c7f0c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:14:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a9725426-6854-4c32-9b1b-232407df27c8 tempest-ServerActionsTestOtherA-1526177158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b74eb52-5680-454a-afb4-501c6c7f0c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:14:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a9725426-6854-4c32-9b1b-232407df27c8 tempest-ServerActionsTestOtherA-1526177158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e160994b-732a-409f-94c5-5d2bce20d5ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:14:49 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-a9725426-6854-4c32-9b1b-232407df27c8 tempest-ServerActionsTestOtherA-1526177158 None] Volume 4f5306af-c4b6-474c-93fa-aa3638b46630: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4f5306af-c4b6-474c-93fa-aa3638b46630', 'volume_size': 1, 'image_id': 'b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '021c36f8b23249aabf2d5e363bccb8bc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af', 'created_at': datetime.datetime(2026, 11, 4, 11, 4, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 11, 4, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 04 12:14:49 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9725426-6854-4c32-9b1b-232407df27c8 tempest-ServerActionsTestOtherA-1526177158 None] Trying to clone 4f5306af-c4b6-474c-93fa-aa3638b46630 from image b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af at location (None, [{'url': 'file:///opt/stack/data/glance/images/b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af', 'metadata': {}}]). {{(pid=87095) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 04 12:14:49 devstack sudo[92614]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fad26763-4cc9-4ab3-900c-203082975b03 tempest-SnapshotsActionsTest-572905002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.1ac89c2e-db94-4ddd-acf4-c95b95fbf8cb" returned: 0 in 0.493s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:49 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-fad26763-4cc9-4ab3-900c-203082975b03 tempest-SnapshotsActionsTest-572905002 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee4e9386-0b3c-4207-8b14-32b073ed06da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 12:14:49 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f5e568-82e7-4536-9493-6ac4b683e9e7]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:14:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fad26763-4cc9-4ab3-900c-203082975b03 tempest-SnapshotsActionsTest-572905002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.18ddc5e3-c5b2-4dc1-9836-90658e310a86 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:50 devstack sudo[92621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.18ddc5e3-c5b2-4dc1-9836-90658e310a86 Nov 04 12:14:50 devstack sudo[92621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:50 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-42f1fb67-9e6d-4452-bfea-61955d971442 tempest-GroupsTest-1749445549 None] Created reservations ['7fdbce9f-5984-47de-b6c9-0872877baa54'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:14:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-42f1fb67-9e6d-4452-bfea-61955d971442 tempest-GroupsTest-1749445549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:14:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-42f1fb67-9e6d-4452-bfea-61955d971442 tempest-GroupsTest-1749445549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:14:50 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-42f1fb67-9e6d-4452-bfea-61955d971442 tempest-GroupsTest-1749445549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:14:50 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-42f1fb67-9e6d-4452-bfea-61955d971442 tempest-GroupsTest-1749445549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:14:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-42f1fb67-9e6d-4452-bfea-61955d971442 tempest-GroupsTest-1749445549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:14:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-42f1fb67-9e6d-4452-bfea-61955d971442 tempest-GroupsTest-1749445549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:50 devstack sudo[92643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:14:50 devstack sudo[92643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:50 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-a9725426-6854-4c32-9b1b-232407df27c8 tempest-ServerActionsTestOtherA-1526177158 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_n4txwivndevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87095) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 04 12:14:50 devstack cinder-volume[87095]: INFO cinder.image.image_utils [None req-a9725426-6854-4c32-9b1b-232407df27c8 tempest-ServerActionsTestOtherA-1526177158 None] Image download 20.69 MB at 20.69 MB/s Nov 04 12:14:50 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f42c9bc7-49f0-40f5-b41d-687fad9067bf]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:14:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a9725426-6854-4c32-9b1b-232407df27c8 tempest-ServerActionsTestOtherA-1526177158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_n4txwivndevstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:50 devstack sudo[92621]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fad26763-4cc9-4ab3-900c-203082975b03 tempest-SnapshotsActionsTest-572905002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.18ddc5e3-c5b2-4dc1-9836-90658e310a86" returned: 0 in 0.549s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:50 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-fad26763-4cc9-4ab3-900c-203082975b03 tempest-SnapshotsActionsTest-572905002 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee4e9386-0b3c-4207-8b14-32b073ed06da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 12:14:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fad26763-4cc9-4ab3-900c-203082975b03 tempest-SnapshotsActionsTest-572905002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.1ac89c2e-db94-4ddd-acf4-c95b95fbf8cb {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:50 devstack sudo[92650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.1ac89c2e-db94-4ddd-acf4-c95b95fbf8cb Nov 04 12:14:50 devstack sudo[92650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:50 devstack sudo[92649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_n4txwivndevstack@QuobyteHD Nov 04 12:14:50 devstack sudo[92649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:50 devstack sudo[92643]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-42f1fb67-9e6d-4452-bfea-61955d971442 tempest-GroupsTest-1749445549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.464s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:50 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-42f1fb67-9e6d-4452-bfea-61955d971442 tempest-GroupsTest-1749445549 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:14:50 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-42f1fb67-9e6d-4452-bfea-61955d971442 tempest-GroupsTest-1749445549 None] Delete group completed successfully. Nov 04 12:14:51 devstack sudo[92649]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a9725426-6854-4c32-9b1b-232407df27c8 tempest-ServerActionsTestOtherA-1526177158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_n4txwivndevstack@QuobyteHD" returned: 0 in 0.654s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:51 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-a9725426-6854-4c32-9b1b-232407df27c8 tempest-ServerActionsTestOtherA-1526177158 None] Temporary image b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af is fetched for user 1de4ad7c8f3848f3b97b917a5f9d3c0d. {{(pid=87095) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 04 12:14:51 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a5e30a-5aad-4cca-8cac-ce2493a9b41d]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:14:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a9725426-6854-4c32-9b1b-232407df27c8 tempest-ServerActionsTestOtherA-1526177158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_n4txwivndevstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:51 devstack sudo[92650]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fad26763-4cc9-4ab3-900c-203082975b03 tempest-SnapshotsActionsTest-572905002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.1ac89c2e-db94-4ddd-acf4-c95b95fbf8cb" returned: 0 in 0.878s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fad26763-4cc9-4ab3-900c-203082975b03 tempest-SnapshotsActionsTest-572905002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.1ac89c2e-db94-4ddd-acf4-c95b95fbf8cb {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:51 devstack sudo[92717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.1ac89c2e-db94-4ddd-acf4-c95b95fbf8cb Nov 04 12:14:51 devstack sudo[92717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:51 devstack sudo[92715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_n4txwivndevstack@QuobyteHD Nov 04 12:14:51 devstack sudo[92715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:52 devstack sudo[92717]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fad26763-4cc9-4ab3-900c-203082975b03 tempest-SnapshotsActionsTest-572905002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.1ac89c2e-db94-4ddd-acf4-c95b95fbf8cb" returned: 0 in 0.607s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:52 devstack sudo[92715]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a9725426-6854-4c32-9b1b-232407df27c8 tempest-ServerActionsTestOtherA-1526177158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_n4txwivndevstack@QuobyteHD" returned: 0 in 0.709s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a9725426-6854-4c32-9b1b-232407df27c8 tempest-ServerActionsTestOtherA-1526177158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:14:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a9725426-6854-4c32-9b1b-232407df27c8 tempest-ServerActionsTestOtherA-1526177158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:14:52 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a9725426-6854-4c32-9b1b-232407df27c8 tempest-ServerActionsTestOtherA-1526177158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:14:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-538653052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f5306af-c4b6-474c-93fa-aa3638b46630,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91f7feb2ed564a598d1806a492a31193',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:14:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:14:49Z,use_quota=True,user_id='1de4ad7c8f3848f3b97b917a5f9d3c0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:14:52 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-a9725426-6854-4c32-9b1b-232407df27c8 tempest-ServerActionsTestOtherA-1526177158 None] Creating volume 4f5306af-c4b6-474c-93fa-aa3638b46630 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:14:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a9725426-6854-4c32-9b1b-232407df27c8 tempest-ServerActionsTestOtherA-1526177158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:14:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a9725426-6854-4c32-9b1b-232407df27c8 tempest-ServerActionsTestOtherA-1526177158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:14:52 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a9725426-6854-4c32-9b1b-232407df27c8 tempest-ServerActionsTestOtherA-1526177158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:14:52 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a9725426-6854-4c32-9b1b-232407df27c8 tempest-ServerActionsTestOtherA-1526177158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:14:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a9725426-6854-4c32-9b1b-232407df27c8 tempest-ServerActionsTestOtherA-1526177158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:14:52 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a9725426-6854-4c32-9b1b-232407df27c8 tempest-ServerActionsTestOtherA-1526177158 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:14:52 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-a9725426-6854-4c32-9b1b-232407df27c8 tempest-ServerActionsTestOtherA-1526177158 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:14:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a9725426-6854-4c32-9b1b-232407df27c8 tempest-ServerActionsTestOtherA-1526177158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4f5306af-c4b6-474c-93fa-aa3638b46630 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-fad26763-4cc9-4ab3-900c-203082975b03 tempest-SnapshotsActionsTest-572905002 None] Lock "cinder-quobyte-1ac89c2e-db94-4ddd-acf4-c95b95fbf8cb" released by "_delete_snapshot" :: held 2.772s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:14:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-fad26763-4cc9-4ab3-900c-203082975b03 tempest-SnapshotsActionsTest-572905002 None] Lock "cinder-quobyte-ee4e9386-0b3c-4207-8b14-32b073ed06da" released by "delete_snapshot" :: held 2.904s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:14:52 devstack sudo[92734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4f5306af-c4b6-474c-93fa-aa3638b46630 1073741824 Nov 04 12:14:52 devstack sudo[92734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:52 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-fad26763-4cc9-4ab3-900c-203082975b03 tempest-SnapshotsActionsTest-572905002 None] Created reservations ['aea59779-5006-4f34-8594-a549f83e1e53', '50f24280-9e2f-4311-9a20-1f73161db01b', 'e558b018-0442-4812-9b4e-389dad1ab528', 'cb1e45f3-12ab-4857-aeef-bb5638f8d5a2'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:14:52 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-ee2afe46-ef72-4f3d-85b3-8edceb0ac9d9 tempest-GroupsTest-1749445549 None] Group tempest-GroupsTest-Group-1790784870: creating Nov 04 12:14:52 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-fad26763-4cc9-4ab3-900c-203082975b03 tempest-SnapshotsActionsTest-572905002 None] Delete snapshot completed successfully. Nov 04 12:14:52 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-ee2afe46-ef72-4f3d-85b3-8edceb0ac9d9 tempest-GroupsTest-1749445549 None] Group tempest-GroupsTest-Group-1790784870: created successfully Nov 04 12:14:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-fad26763-4cc9-4ab3-900c-203082975b03 tempest-SnapshotsActionsTest-572905002 None] Lock "cinder-1ac89c2e-db94-4ddd-acf4-c95b95fbf8cb-delete_snapshot" released by "delete_snapshot" :: held 3.202s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:14:52 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-ee2afe46-ef72-4f3d-85b3-8edceb0ac9d9 tempest-GroupsTest-1749445549 None] Create group completed successfully. Nov 04 12:14:53 devstack sudo[92734]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a9725426-6854-4c32-9b1b-232407df27c8 tempest-ServerActionsTestOtherA-1526177158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4f5306af-c4b6-474c-93fa-aa3638b46630 1073741824" returned: 0 in 0.903s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-43721dbb-e6f9-4e45-a8e5-776aefde1491 tempest-SnapshotsActionsTest-1983587027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:14:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a9725426-6854-4c32-9b1b-232407df27c8 tempest-ServerActionsTestOtherA-1526177158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4f5306af-c4b6-474c-93fa-aa3638b46630 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:53 devstack sudo[92748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4f5306af-c4b6-474c-93fa-aa3638b46630 Nov 04 12:14:53 devstack sudo[92748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:53 devstack sudo[92748]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a9725426-6854-4c32-9b1b-232407df27c8 tempest-ServerActionsTestOtherA-1526177158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4f5306af-c4b6-474c-93fa-aa3638b46630" returned: 0 in 0.300s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:53 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a9725426-6854-4c32-9b1b-232407df27c8 tempest-ServerActionsTestOtherA-1526177158 None] <== create_volume: return (1287ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:14:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a9725426-6854-4c32-9b1b-232407df27c8 tempest-ServerActionsTestOtherA-1526177158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.297s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:14:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-43721dbb-e6f9-4e45-a8e5-776aefde1491 tempest-SnapshotsActionsTest-1983587027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.337s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:14:53 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-43721dbb-e6f9-4e45-a8e5-776aefde1491 tempest-SnapshotsActionsTest-1983587027 None] Creating offline snapshot aebf65f4-a334-4850-9c61-2b6400c0e12d of volume ee4e9386-0b3c-4207-8b14-32b073ed06da {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 12:14:53 devstack cinder-volume[87095]: DEBUG cinder.volume.volume_utils [None req-a9725426-6854-4c32-9b1b-232407df27c8 tempest-ServerActionsTestOtherA-1526177158 None] Attempting download of b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af ((None, [{'url': 'file:///opt/stack/data/glance/images/b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af', 'metadata': {}}])) to volume 4f5306af-c4b6-474c-93fa-aa3638b46630. {{(pid=87095) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 04 12:14:53 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57aa1c6-5721-448c-87cc-c55345fb45d8]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:14:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-43721dbb-e6f9-4e45-a8e5-776aefde1491 tempest-SnapshotsActionsTest-1983587027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.18ddc5e3-c5b2-4dc1-9836-90658e310a86 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:53 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b7ca69-ac3d-414d-ae6a-d6239581b8bf]: (4, 'raw') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:14:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a9725426-6854-4c32-9b1b-232407df27c8 tempest-ServerActionsTestOtherA-1526177158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af__ojl9npr {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:53 devstack sudo[92751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.18ddc5e3-c5b2-4dc1-9836-90658e310a86 Nov 04 12:14:53 devstack sudo[92751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:53 devstack sudo[92752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af__ojl9npr Nov 04 12:14:53 devstack sudo[92752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:53 devstack sudo[92751]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-43721dbb-e6f9-4e45-a8e5-776aefde1491 tempest-SnapshotsActionsTest-1983587027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.18ddc5e3-c5b2-4dc1-9836-90658e310a86" returned: 0 in 0.491s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:53 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-43721dbb-e6f9-4e45-a8e5-776aefde1491 tempest-SnapshotsActionsTest-1983587027 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee4e9386-0b3c-4207-8b14-32b073ed06da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 12:14:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-43721dbb-e6f9-4e45-a8e5-776aefde1491 tempest-SnapshotsActionsTest-1983587027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.18ddc5e3-c5b2-4dc1-9836-90658e310a86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.aebf65f4-a334-4850-9c61-2b6400c0e12d 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:54 devstack sudo[92760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.18ddc5e3-c5b2-4dc1-9836-90658e310a86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.aebf65f4-a334-4850-9c61-2b6400c0e12d 1G Nov 04 12:14:54 devstack sudo[92760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:54 devstack sudo[92752]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a9725426-6854-4c32-9b1b-232407df27c8 tempest-ServerActionsTestOtherA-1526177158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af__ojl9npr" returned: 0 in 0.563s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a9725426-6854-4c32-9b1b-232407df27c8 tempest-ServerActionsTestOtherA-1526177158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af__ojl9npr {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:54 devstack sudo[92763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af__ojl9npr Nov 04 12:14:54 devstack sudo[92763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:54 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-fefe3624-e11d-4d51-be1e-f6623975bb5f tempest-GroupsTest-1749445549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:14:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-fefe3624-e11d-4d51-be1e-f6623975bb5f tempest-GroupsTest-1749445549 None] Flow 'volume_create_manager' (91f7682e-4240-4e86-83c4-2206a6bbc704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:14:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-fefe3624-e11d-4d51-be1e-f6623975bb5f tempest-GroupsTest-1749445549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49b00bd7-35e4-45b2-a0cc-9bde8dae95e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:14:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-fefe3624-e11d-4d51-be1e-f6623975bb5f tempest-GroupsTest-1749445549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49b00bd7-35e4-45b2-a0cc-9bde8dae95e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:14:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1328045913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a016b20f-0b9e-491a-ae7d-5d73e5722dec,host='devstack@QuobyteHD#QuobyteHD',id=da194500-a506-40ba-ac7c-525d90baba9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c25fa29436f0490bb78fad935bf08b25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:14:54Z,use_quota=True,user_id='d9b9b56464bd48148cd36757f93c4324',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7381b70e-c704-456f-a303-71628e9167ea),volume_type_id=7381b70e-c704-456f-a303-71628e9167ea)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:14:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-fefe3624-e11d-4d51-be1e-f6623975bb5f tempest-GroupsTest-1749445549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad2461f3-ae39-4093-b72c-c18d4ebb1992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:14:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-fefe3624-e11d-4d51-be1e-f6623975bb5f tempest-GroupsTest-1749445549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad2461f3-ae39-4093-b72c-c18d4ebb1992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:14:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-fefe3624-e11d-4d51-be1e-f6623975bb5f tempest-GroupsTest-1749445549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49fc4b48-1c46-44f1-bbe6-11b48132a8c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:14:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-fefe3624-e11d-4d51-be1e-f6623975bb5f tempest-GroupsTest-1749445549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49fc4b48-1c46-44f1-bbe6-11b48132a8c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da194500-a506-40ba-ac7c-525d90baba9e', 'volume_name': 'volume-da194500-a506-40ba-ac7c-525d90baba9e', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:14:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-fefe3624-e11d-4d51-be1e-f6623975bb5f tempest-GroupsTest-1749445549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25cfea8d-3bec-475b-a12b-c5901cf7dedb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:14:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-fefe3624-e11d-4d51-be1e-f6623975bb5f tempest-GroupsTest-1749445549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25cfea8d-3bec-475b-a12b-c5901cf7dedb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:14:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-fefe3624-e11d-4d51-be1e-f6623975bb5f tempest-GroupsTest-1749445549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3595ea79-66cf-4687-bb92-73c94df52cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:14:54 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-fefe3624-e11d-4d51-be1e-f6623975bb5f tempest-GroupsTest-1749445549 None] Volume da194500-a506-40ba-ac7c-525d90baba9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da194500-a506-40ba-ac7c-525d90baba9e', 'volume_size': 1} Nov 04 12:14:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-fefe3624-e11d-4d51-be1e-f6623975bb5f tempest-GroupsTest-1749445549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:14:54 devstack sudo[92763]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a9725426-6854-4c32-9b1b-232407df27c8 tempest-ServerActionsTestOtherA-1526177158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af__ojl9npr" returned: 1 in 0.564s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a9725426-6854-4c32-9b1b-232407df27c8 tempest-ServerActionsTestOtherA-1526177158 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af__ojl9npr' failed. Not Retrying. {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 12:14:54 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b091e3-6702-488d-912c-1db664221da1]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:14:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a9725426-6854-4c32-9b1b-232407df27c8 tempest-ServerActionsTestOtherA-1526177158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_n4txwivndevstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:54 devstack sudo[92760]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-43721dbb-e6f9-4e45-a8e5-776aefde1491 tempest-SnapshotsActionsTest-1983587027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.18ddc5e3-c5b2-4dc1-9836-90658e310a86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.aebf65f4-a334-4850-9c61-2b6400c0e12d 1G" returned: 0 in 0.785s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-43721dbb-e6f9-4e45-a8e5-776aefde1491 tempest-SnapshotsActionsTest-1983587027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.18ddc5e3-c5b2-4dc1-9836-90658e310a86 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.aebf65f4-a334-4850-9c61-2b6400c0e12d {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:54 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-d239ef79-f60d-4592-bf87-bfb42ba38f65 tempest-VolumesActionsTest-77504308 None] Acquiring lock "cinder-63ea78bf-277d-4ebd-833d-39b9f3f67bd8" by "attach_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:14:54 devstack sudo[92772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.18ddc5e3-c5b2-4dc1-9836-90658e310a86 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.aebf65f4-a334-4850-9c61-2b6400c0e12d Nov 04 12:14:54 devstack sudo[92772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:54 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-d239ef79-f60d-4592-bf87-bfb42ba38f65 tempest-VolumesActionsTest-77504308 None] Lock "cinder-63ea78bf-277d-4ebd-833d-39b9f3f67bd8" acquired by "attach_volume" :: waited 0.020s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:14:54 devstack sudo[92771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_n4txwivndevstack@QuobyteHD Nov 04 12:14:54 devstack sudo[92771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:54 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-d239ef79-f60d-4592-bf87-bfb42ba38f65 tempest-VolumesActionsTest-77504308 None] Attaching volume 63ea78bf-277d-4ebd-833d-39b9f3f67bd8 to instance be65f419-3458-42a4-8882-23fa5817ae87 at mountpoint /dev/vdb on host None. Nov 04 12:14:54 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-d239ef79-f60d-4592-bf87-bfb42ba38f65 tempest-VolumesActionsTest-77504308 None] Attach volume completed successfully. Nov 04 12:14:54 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-d239ef79-f60d-4592-bf87-bfb42ba38f65 tempest-VolumesActionsTest-77504308 None] Lock "cinder-63ea78bf-277d-4ebd-833d-39b9f3f67bd8" released by "attach_volume" :: held 0.138s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:14:55 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0f463630-d6dd-43a7-9f17-0ff4f935bb33 tempest-VolumesActionsTest-77504308 None] Acquiring lock "cinder-63ea78bf-277d-4ebd-833d-39b9f3f67bd8-detach_volume" by "detach_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:14:55 devstack sudo[92772]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:55 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0f463630-d6dd-43a7-9f17-0ff4f935bb33 tempest-VolumesActionsTest-77504308 None] Lock "cinder-63ea78bf-277d-4ebd-833d-39b9f3f67bd8-detach_volume" acquired by "detach_volume" :: waited 0.032s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:14:55 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-0f463630-d6dd-43a7-9f17-0ff4f935bb33 tempest-VolumesActionsTest-77504308 None] Detaching volume 63ea78bf-277d-4ebd-833d-39b9f3f67bd8 from instance be65f419-3458-42a4-8882-23fa5817ae87. Nov 04 12:14:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-43721dbb-e6f9-4e45-a8e5-776aefde1491 tempest-SnapshotsActionsTest-1983587027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.18ddc5e3-c5b2-4dc1-9836-90658e310a86 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.aebf65f4-a334-4850-9c61-2b6400c0e12d" returned: 0 in 0.483s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:55 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-43721dbb-e6f9-4e45-a8e5-776aefde1491 tempest-SnapshotsActionsTest-1983587027 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.aebf65f4-a334-4850-9c61-2b6400c0e12d is being set with open permissions: ugo+rw Nov 04 12:14:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-43721dbb-e6f9-4e45-a8e5-776aefde1491 tempest-SnapshotsActionsTest-1983587027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.aebf65f4-a334-4850-9c61-2b6400c0e12d {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:55 devstack sudo[92771]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a9725426-6854-4c32-9b1b-232407df27c8 tempest-ServerActionsTestOtherA-1526177158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_n4txwivndevstack@QuobyteHD" returned: 0 in 0.567s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:55 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-a9725426-6854-4c32-9b1b-232407df27c8 tempest-ServerActionsTestOtherA-1526177158 None] b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af was qcow2, converting to qcow2 {{(pid=87095) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 04 12:14:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a9725426-6854-4c32-9b1b-232407df27c8 tempest-ServerActionsTestOtherA-1526177158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_n4txwivndevstack@QuobyteHD /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4f5306af-c4b6-474c-93fa-aa3638b46630 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:55 devstack sudo[92783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.aebf65f4-a334-4850-9c61-2b6400c0e12d Nov 04 12:14:55 devstack sudo[92783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:55 devstack sudo[92785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_n4txwivndevstack@QuobyteHD /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4f5306af-c4b6-474c-93fa-aa3638b46630 Nov 04 12:14:55 devstack sudo[92785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:55 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-0f463630-d6dd-43a7-9f17-0ff4f935bb33 tempest-VolumesActionsTest-77504308 None] Detach volume completed successfully. Nov 04 12:14:55 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0f463630-d6dd-43a7-9f17-0ff4f935bb33 tempest-VolumesActionsTest-77504308 None] Lock "cinder-63ea78bf-277d-4ebd-833d-39b9f3f67bd8-detach_volume" released by "detach_volume" :: held 0.210s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:14:55 devstack sudo[92783]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-43721dbb-e6f9-4e45-a8e5-776aefde1491 tempest-SnapshotsActionsTest-1983587027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.aebf65f4-a334-4850-9c61-2b6400c0e12d" returned: 0 in 0.415s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-43721dbb-e6f9-4e45-a8e5-776aefde1491 tempest-SnapshotsActionsTest-1983587027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.319s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:14:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-fefe3624-e11d-4d51-be1e-f6623975bb5f tempest-GroupsTest-1749445549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.132s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:14:55 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-fefe3624-e11d-4d51-be1e-f6623975bb5f tempest-GroupsTest-1749445549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a016b20f-0b9e-491a-ae7d-5d73e5722dec,created_at=2026-11-04T11:14:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1328045913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a016b20f-0b9e-491a-ae7d-5d73e5722dec,host='devstack@QuobyteHD#QuobyteHD',id=da194500-a506-40ba-ac7c-525d90baba9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c25fa29436f0490bb78fad935bf08b25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:14:54Z,use_quota=True,user_id='d9b9b56464bd48148cd36757f93c4324',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7381b70e-c704-456f-a303-71628e9167ea),volume_type_id=7381b70e-c704-456f-a303-71628e9167ea)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:14:55 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-fefe3624-e11d-4d51-be1e-f6623975bb5f tempest-GroupsTest-1749445549 None] Creating volume da194500-a506-40ba-ac7c-525d90baba9e {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:14:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-fefe3624-e11d-4d51-be1e-f6623975bb5f tempest-GroupsTest-1749445549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:14:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-fefe3624-e11d-4d51-be1e-f6623975bb5f tempest-GroupsTest-1749445549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:14:55 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-fefe3624-e11d-4d51-be1e-f6623975bb5f tempest-GroupsTest-1749445549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:14:55 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-fefe3624-e11d-4d51-be1e-f6623975bb5f tempest-GroupsTest-1749445549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:14:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-fefe3624-e11d-4d51-be1e-f6623975bb5f tempest-GroupsTest-1749445549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:14:55 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-fefe3624-e11d-4d51-be1e-f6623975bb5f tempest-GroupsTest-1749445549 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:14:55 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-fefe3624-e11d-4d51-be1e-f6623975bb5f tempest-GroupsTest-1749445549 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:14:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fefe3624-e11d-4d51-be1e-f6623975bb5f tempest-GroupsTest-1749445549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-da194500-a506-40ba-ac7c-525d90baba9e 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:55 devstack sudo[92792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-da194500-a506-40ba-ac7c-525d90baba9e 1073741824 Nov 04 12:14:55 devstack sudo[92792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:55 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-43721dbb-e6f9-4e45-a8e5-776aefde1491 tempest-SnapshotsActionsTest-1983587027 None] Create snapshot completed successfully Nov 04 12:14:56 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6c88b5fe-f40a-4595-b1bb-dd0d444d2739 tempest-SnapshotsActionsTest-572905002 None] Acquiring lock "cinder-aebf65f4-a334-4850-9c61-2b6400c0e12d-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:14:56 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6c88b5fe-f40a-4595-b1bb-dd0d444d2739 tempest-SnapshotsActionsTest-572905002 None] Lock "cinder-aebf65f4-a334-4850-9c61-2b6400c0e12d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:14:56 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6c88b5fe-f40a-4595-b1bb-dd0d444d2739 tempest-SnapshotsActionsTest-572905002 None] Acquiring lock "cinder-quobyte-ee4e9386-0b3c-4207-8b14-32b073ed06da" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:14:56 devstack sudo[92792]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fefe3624-e11d-4d51-be1e-f6623975bb5f tempest-GroupsTest-1749445549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-da194500-a506-40ba-ac7c-525d90baba9e 1073741824" returned: 0 in 0.855s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:56 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6c88b5fe-f40a-4595-b1bb-dd0d444d2739 tempest-SnapshotsActionsTest-572905002 None] Lock "cinder-quobyte-ee4e9386-0b3c-4207-8b14-32b073ed06da" acquired by "delete_snapshot" :: waited 0.066s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:14:56 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6c88b5fe-f40a-4595-b1bb-dd0d444d2739 tempest-SnapshotsActionsTest-572905002 None] Acquiring lock "cinder-quobyte-aebf65f4-a334-4850-9c61-2b6400c0e12d" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:14:56 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6c88b5fe-f40a-4595-b1bb-dd0d444d2739 tempest-SnapshotsActionsTest-572905002 None] Lock "cinder-quobyte-aebf65f4-a334-4850-9c61-2b6400c0e12d" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:14:56 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-6c88b5fe-f40a-4595-b1bb-dd0d444d2739 tempest-SnapshotsActionsTest-572905002 None] Deleting offline snapshot aebf65f4-a334-4850-9c61-2b6400c0e12d of volume ee4e9386-0b3c-4207-8b14-32b073ed06da {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 12:14:56 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-6c88b5fe-f40a-4595-b1bb-dd0d444d2739 tempest-SnapshotsActionsTest-572905002 None] snapshot_file for this snap is: volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.aebf65f4-a334-4850-9c61-2b6400c0e12d {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 12:14:56 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9759f8c5-66b5-4d0c-a77f-3d72349eb9d6]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:14:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6c88b5fe-f40a-4595-b1bb-dd0d444d2739 tempest-SnapshotsActionsTest-572905002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.aebf65f4-a334-4850-9c61-2b6400c0e12d {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fefe3624-e11d-4d51-be1e-f6623975bb5f tempest-GroupsTest-1749445549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-da194500-a506-40ba-ac7c-525d90baba9e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:56 devstack sudo[92822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-da194500-a506-40ba-ac7c-525d90baba9e Nov 04 12:14:56 devstack sudo[92822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:56 devstack sudo[92821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.aebf65f4-a334-4850-9c61-2b6400c0e12d Nov 04 12:14:56 devstack sudo[92821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:57 devstack sudo[92822]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fefe3624-e11d-4d51-be1e-f6623975bb5f tempest-GroupsTest-1749445549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-da194500-a506-40ba-ac7c-525d90baba9e" returned: 0 in 0.455s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:57 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-fefe3624-e11d-4d51-be1e-f6623975bb5f tempest-GroupsTest-1749445549 None] <== create_volume: return (1470ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:14:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-fefe3624-e11d-4d51-be1e-f6623975bb5f tempest-GroupsTest-1749445549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.476s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:14:57 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-fefe3624-e11d-4d51-be1e-f6623975bb5f tempest-GroupsTest-1749445549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3595ea79-66cf-4687-bb92-73c94df52cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da194500-a506-40ba-ac7c-525d90baba9e', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:14:57 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-fefe3624-e11d-4d51-be1e-f6623975bb5f tempest-GroupsTest-1749445549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c5e969c-b3de-4aea-9466-35ccd4dc1601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:14:57 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-fefe3624-e11d-4d51-be1e-f6623975bb5f tempest-GroupsTest-1749445549 None] Volume volume-da194500-a506-40ba-ac7c-525d90baba9e (da194500-a506-40ba-ac7c-525d90baba9e): created successfully Nov 04 12:14:57 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-fefe3624-e11d-4d51-be1e-f6623975bb5f tempest-GroupsTest-1749445549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c5e969c-b3de-4aea-9466-35ccd4dc1601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:14:57 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-fefe3624-e11d-4d51-be1e-f6623975bb5f tempest-GroupsTest-1749445549 None] Flow 'volume_create_manager' (91f7682e-4240-4e86-83c4-2206a6bbc704) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:14:57 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-fefe3624-e11d-4d51-be1e-f6623975bb5f tempest-GroupsTest-1749445549 None] Created volume successfully. Nov 04 12:14:57 devstack sudo[92821]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6c88b5fe-f40a-4595-b1bb-dd0d444d2739 tempest-SnapshotsActionsTest-572905002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.aebf65f4-a334-4850-9c61-2b6400c0e12d" returned: 0 in 0.716s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:57 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-6c88b5fe-f40a-4595-b1bb-dd0d444d2739 tempest-SnapshotsActionsTest-572905002 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee4e9386-0b3c-4207-8b14-32b073ed06da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 12:14:57 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[633bcce7-7a43-4efc-ac73-a18951301910]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:14:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6c88b5fe-f40a-4595-b1bb-dd0d444d2739 tempest-SnapshotsActionsTest-572905002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.18ddc5e3-c5b2-4dc1-9836-90658e310a86 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:57 devstack sudo[92832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.18ddc5e3-c5b2-4dc1-9836-90658e310a86 Nov 04 12:14:57 devstack sudo[92832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:58 devstack sudo[92832]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6c88b5fe-f40a-4595-b1bb-dd0d444d2739 tempest-SnapshotsActionsTest-572905002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.18ddc5e3-c5b2-4dc1-9836-90658e310a86" returned: 0 in 0.532s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:58 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-6c88b5fe-f40a-4595-b1bb-dd0d444d2739 tempest-SnapshotsActionsTest-572905002 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee4e9386-0b3c-4207-8b14-32b073ed06da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 12:14:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6c88b5fe-f40a-4595-b1bb-dd0d444d2739 tempest-SnapshotsActionsTest-572905002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.aebf65f4-a334-4850-9c61-2b6400c0e12d {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:58 devstack sudo[92839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.aebf65f4-a334-4850-9c61-2b6400c0e12d Nov 04 12:14:58 devstack sudo[92839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:58 devstack sudo[92785]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a9725426-6854-4c32-9b1b-232407df27c8 tempest-ServerActionsTestOtherA-1526177158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_n4txwivndevstack@QuobyteHD /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4f5306af-c4b6-474c-93fa-aa3638b46630" returned: 0 in 3.015s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:58 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-a9725426-6854-4c32-9b1b-232407df27c8 tempest-ServerActionsTestOtherA-1526177158 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_n4txwivndevstack@QuobyteHD, size 112.00 MB, duration 3.02 sec, destination /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4f5306af-c4b6-474c-93fa-aa3638b46630 {{(pid=87095) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 12:14:58 devstack cinder-volume[87095]: INFO cinder.image.image_utils [None req-a9725426-6854-4c32-9b1b-232407df27c8 tempest-ServerActionsTestOtherA-1526177158 None] Converted 112.00 MB image at 37.11 MB/s Nov 04 12:14:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a9725426-6854-4c32-9b1b-232407df27c8 tempest-ServerActionsTestOtherA-1526177158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4f5306af-c4b6-474c-93fa-aa3638b46630 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:58 devstack sudo[92843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4f5306af-c4b6-474c-93fa-aa3638b46630 1G Nov 04 12:14:58 devstack sudo[92843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:58 devstack sudo[92839]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6c88b5fe-f40a-4595-b1bb-dd0d444d2739 tempest-SnapshotsActionsTest-572905002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.aebf65f4-a334-4850-9c61-2b6400c0e12d" returned: 0 in 0.512s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6c88b5fe-f40a-4595-b1bb-dd0d444d2739 tempest-SnapshotsActionsTest-572905002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.aebf65f4-a334-4850-9c61-2b6400c0e12d {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:58 devstack sudo[92846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.aebf65f4-a334-4850-9c61-2b6400c0e12d Nov 04 12:14:58 devstack sudo[92846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:58 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4a7dbf4-897e-44ab-9a01-5b345f7216c4 tempest-GroupsTest-1749445549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:14:58 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f4a7dbf4-897e-44ab-9a01-5b345f7216c4 tempest-GroupsTest-1749445549 None] Flow 'volume_create_manager' (80c270f3-d47e-40e1-9337-2c174d455602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:14:58 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f4a7dbf4-897e-44ab-9a01-5b345f7216c4 tempest-GroupsTest-1749445549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95cc3f18-2aef-44b7-ab9b-e3ae972bd9a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:14:58 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f4a7dbf4-897e-44ab-9a01-5b345f7216c4 tempest-GroupsTest-1749445549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95cc3f18-2aef-44b7-ab9b-e3ae972bd9a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1489036251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a016b20f-0b9e-491a-ae7d-5d73e5722dec,host='devstack@QuobyteHD#QuobyteHD',id=d46f89b3-dd0b-4eb1-9c5b-895640087534,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c25fa29436f0490bb78fad935bf08b25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:14:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:14:59Z,use_quota=True,user_id='d9b9b56464bd48148cd36757f93c4324',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7381b70e-c704-456f-a303-71628e9167ea),volume_type_id=7381b70e-c704-456f-a303-71628e9167ea)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:14:58 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f4a7dbf4-897e-44ab-9a01-5b345f7216c4 tempest-GroupsTest-1749445549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (098e8b2f-c491-41a7-848e-6c03f909c9c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:14:58 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f4a7dbf4-897e-44ab-9a01-5b345f7216c4 tempest-GroupsTest-1749445549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (098e8b2f-c491-41a7-848e-6c03f909c9c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:14:58 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f4a7dbf4-897e-44ab-9a01-5b345f7216c4 tempest-GroupsTest-1749445549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6ab1953-afde-4845-a8ed-167af4eaf5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:14:58 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f4a7dbf4-897e-44ab-9a01-5b345f7216c4 tempest-GroupsTest-1749445549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6ab1953-afde-4845-a8ed-167af4eaf5c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd46f89b3-dd0b-4eb1-9c5b-895640087534', 'volume_name': 'volume-d46f89b3-dd0b-4eb1-9c5b-895640087534', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:14:58 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f4a7dbf4-897e-44ab-9a01-5b345f7216c4 tempest-GroupsTest-1749445549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffaebfbf-433a-45a7-bfe4-7aacef2a6ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:14:58 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f4a7dbf4-897e-44ab-9a01-5b345f7216c4 tempest-GroupsTest-1749445549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffaebfbf-433a-45a7-bfe4-7aacef2a6ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:14:58 devstack sudo[92843]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:58 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f4a7dbf4-897e-44ab-9a01-5b345f7216c4 tempest-GroupsTest-1749445549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65065487-09ca-4034-b4f6-86c6dc3833ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:14:58 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-f4a7dbf4-897e-44ab-9a01-5b345f7216c4 tempest-GroupsTest-1749445549 None] Volume d46f89b3-dd0b-4eb1-9c5b-895640087534: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d46f89b3-dd0b-4eb1-9c5b-895640087534', 'volume_size': 1} Nov 04 12:14:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f4a7dbf4-897e-44ab-9a01-5b345f7216c4 tempest-GroupsTest-1749445549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:14:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f4a7dbf4-897e-44ab-9a01-5b345f7216c4 tempest-GroupsTest-1749445549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:14:58 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f4a7dbf4-897e-44ab-9a01-5b345f7216c4 tempest-GroupsTest-1749445549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a016b20f-0b9e-491a-ae7d-5d73e5722dec,created_at=2026-11-04T11:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1489036251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a016b20f-0b9e-491a-ae7d-5d73e5722dec,host='devstack@QuobyteHD#QuobyteHD',id=d46f89b3-dd0b-4eb1-9c5b-895640087534,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c25fa29436f0490bb78fad935bf08b25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:14:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:14:59Z,use_quota=True,user_id='d9b9b56464bd48148cd36757f93c4324',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7381b70e-c704-456f-a303-71628e9167ea),volume_type_id=7381b70e-c704-456f-a303-71628e9167ea)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:14:58 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-f4a7dbf4-897e-44ab-9a01-5b345f7216c4 tempest-GroupsTest-1749445549 None] Creating volume d46f89b3-dd0b-4eb1-9c5b-895640087534 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:14:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f4a7dbf4-897e-44ab-9a01-5b345f7216c4 tempest-GroupsTest-1749445549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:14:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f4a7dbf4-897e-44ab-9a01-5b345f7216c4 tempest-GroupsTest-1749445549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:14:58 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f4a7dbf4-897e-44ab-9a01-5b345f7216c4 tempest-GroupsTest-1749445549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:14:58 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f4a7dbf4-897e-44ab-9a01-5b345f7216c4 tempest-GroupsTest-1749445549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:14:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f4a7dbf4-897e-44ab-9a01-5b345f7216c4 tempest-GroupsTest-1749445549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:14:58 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f4a7dbf4-897e-44ab-9a01-5b345f7216c4 tempest-GroupsTest-1749445549 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:14:58 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-f4a7dbf4-897e-44ab-9a01-5b345f7216c4 tempest-GroupsTest-1749445549 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:14:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f4a7dbf4-897e-44ab-9a01-5b345f7216c4 tempest-GroupsTest-1749445549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d46f89b3-dd0b-4eb1-9c5b-895640087534 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a9725426-6854-4c32-9b1b-232407df27c8 tempest-ServerActionsTestOtherA-1526177158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4f5306af-c4b6-474c-93fa-aa3638b46630 1G" returned: 0 in 0.558s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:58 devstack cinder-volume[87095]: DEBUG cinder.volume.volume_utils [None req-a9725426-6854-4c32-9b1b-232407df27c8 tempest-ServerActionsTestOtherA-1526177158 None] Downloaded image b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af ((None, [{'url': 'file:///opt/stack/data/glance/images/b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af', 'metadata': {}}])) to volume 4f5306af-c4b6-474c-93fa-aa3638b46630 successfully. {{(pid=87095) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 04 12:14:58 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-a9725426-6854-4c32-9b1b-232407df27c8 tempest-ServerActionsTestOtherA-1526177158 None] Temporary image b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af for user 1de4ad7c8f3848f3b97b917a5f9d3c0d is deleted. {{(pid=87095) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 04 12:14:58 devstack cinder-volume[87095]: DEBUG cinder.volume.volume_utils [None req-a9725426-6854-4c32-9b1b-232407df27c8 tempest-ServerActionsTestOtherA-1526177158 None] Marking volume 4f5306af-c4b6-474c-93fa-aa3638b46630 as bootable. {{(pid=87095) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 04 12:14:58 devstack sudo[92852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d46f89b3-dd0b-4eb1-9c5b-895640087534 1073741824 Nov 04 12:14:58 devstack sudo[92852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:58 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9725426-6854-4c32-9b1b-232407df27c8 tempest-ServerActionsTestOtherA-1526177158 None] Copying metadata from image b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af to 4f5306af-c4b6-474c-93fa-aa3638b46630. {{(pid=87095) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 04 12:14:58 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9725426-6854-4c32-9b1b-232407df27c8 tempest-ServerActionsTestOtherA-1526177158 None] Creating volume glance metadata for volume 4f5306af-c4b6-474c-93fa-aa3638b46630 backed by image b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87095) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 04 12:14:58 devstack sudo[92846]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6c88b5fe-f40a-4595-b1bb-dd0d444d2739 tempest-SnapshotsActionsTest-572905002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.aebf65f4-a334-4850-9c61-2b6400c0e12d" returned: 0 in 0.399s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:59 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6c88b5fe-f40a-4595-b1bb-dd0d444d2739 tempest-SnapshotsActionsTest-572905002 None] Lock "cinder-quobyte-aebf65f4-a334-4850-9c61-2b6400c0e12d" released by "_delete_snapshot" :: held 2.360s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:14:59 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6c88b5fe-f40a-4595-b1bb-dd0d444d2739 tempest-SnapshotsActionsTest-572905002 None] Lock "cinder-quobyte-ee4e9386-0b3c-4207-8b14-32b073ed06da" released by "delete_snapshot" :: held 2.409s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:14:59 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a9725426-6854-4c32-9b1b-232407df27c8 tempest-ServerActionsTestOtherA-1526177158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e160994b-732a-409f-94c5-5d2bce20d5ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f5306af-c4b6-474c-93fa-aa3638b46630', 'volume_size': 1, 'image_id': 'b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '021c36f8b23249aabf2d5e363bccb8bc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af', 'created_at': datetime.datetime(2026, 11, 4, 11, 4, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 11, 4, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:14:59 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a9725426-6854-4c32-9b1b-232407df27c8 tempest-ServerActionsTestOtherA-1526177158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f8a7020-376f-4bd2-9c41-47e387c3935c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:14:59 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-a9725426-6854-4c32-9b1b-232407df27c8 tempest-ServerActionsTestOtherA-1526177158 None] Volume volume-4f5306af-c4b6-474c-93fa-aa3638b46630 (4f5306af-c4b6-474c-93fa-aa3638b46630): created successfully Nov 04 12:14:59 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a9725426-6854-4c32-9b1b-232407df27c8 tempest-ServerActionsTestOtherA-1526177158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f8a7020-376f-4bd2-9c41-47e387c3935c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:14:59 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a9725426-6854-4c32-9b1b-232407df27c8 tempest-ServerActionsTestOtherA-1526177158 None] Flow 'volume_create_manager' (e1e1c423-c821-4594-9fd3-222eff584834) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:14:59 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-a9725426-6854-4c32-9b1b-232407df27c8 tempest-ServerActionsTestOtherA-1526177158 None] Created volume successfully. Nov 04 12:14:59 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-6c88b5fe-f40a-4595-b1bb-dd0d444d2739 tempest-SnapshotsActionsTest-572905002 None] Created reservations ['688ee528-f451-415d-97b2-5b5e7d948d28', 'acd10b7b-742b-4734-bd77-7f2f43012728', '5a906f66-b44b-416a-9b8c-3123e1b937c4', 'abef9772-8c7f-4d12-ba89-7ca0cda51564'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:14:59 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-6c88b5fe-f40a-4595-b1bb-dd0d444d2739 tempest-SnapshotsActionsTest-572905002 None] Delete snapshot completed successfully. Nov 04 12:14:59 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6c88b5fe-f40a-4595-b1bb-dd0d444d2739 tempest-SnapshotsActionsTest-572905002 None] Lock "cinder-aebf65f4-a334-4850-9c61-2b6400c0e12d-delete_snapshot" released by "delete_snapshot" :: held 2.667s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:14:59 devstack sudo[92852]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f4a7dbf4-897e-44ab-9a01-5b345f7216c4 tempest-GroupsTest-1749445549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d46f89b3-dd0b-4eb1-9c5b-895640087534 1073741824" returned: 0 in 0.588s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f4a7dbf4-897e-44ab-9a01-5b345f7216c4 tempest-GroupsTest-1749445549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d46f89b3-dd0b-4eb1-9c5b-895640087534 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:14:59 devstack sudo[92859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d46f89b3-dd0b-4eb1-9c5b-895640087534 Nov 04 12:14:59 devstack sudo[92859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:14:59 devstack sudo[92859]: pam_unix(sudo:session): session closed for user root Nov 04 12:14:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f4a7dbf4-897e-44ab-9a01-5b345f7216c4 tempest-GroupsTest-1749445549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d46f89b3-dd0b-4eb1-9c5b-895640087534" returned: 0 in 0.323s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:14:59 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f4a7dbf4-897e-44ab-9a01-5b345f7216c4 tempest-GroupsTest-1749445549 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:14:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f4a7dbf4-897e-44ab-9a01-5b345f7216c4 tempest-GroupsTest-1749445549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:14:59 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f4a7dbf4-897e-44ab-9a01-5b345f7216c4 tempest-GroupsTest-1749445549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65065487-09ca-4034-b4f6-86c6dc3833ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d46f89b3-dd0b-4eb1-9c5b-895640087534', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:14:59 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f4a7dbf4-897e-44ab-9a01-5b345f7216c4 tempest-GroupsTest-1749445549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41d57f8f-163c-44a7-9c59-e28e19bc691f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:14:59 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-f4a7dbf4-897e-44ab-9a01-5b345f7216c4 tempest-GroupsTest-1749445549 None] Volume volume-d46f89b3-dd0b-4eb1-9c5b-895640087534 (d46f89b3-dd0b-4eb1-9c5b-895640087534): created successfully Nov 04 12:14:59 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f4a7dbf4-897e-44ab-9a01-5b345f7216c4 tempest-GroupsTest-1749445549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41d57f8f-163c-44a7-9c59-e28e19bc691f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:14:59 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f4a7dbf4-897e-44ab-9a01-5b345f7216c4 tempest-GroupsTest-1749445549 None] Flow 'volume_create_manager' (80c270f3-d47e-40e1-9337-2c174d455602) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:14:59 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-f4a7dbf4-897e-44ab-9a01-5b345f7216c4 tempest-GroupsTest-1749445549 None] Created volume successfully. Nov 04 12:15:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1507e260-c02e-47b0-bc86-fff92c4d4686 tempest-SnapshotsActionsTest-1983587027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:15:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1507e260-c02e-47b0-bc86-fff92c4d4686 tempest-SnapshotsActionsTest-1983587027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:15:00 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-1507e260-c02e-47b0-bc86-fff92c4d4686 tempest-SnapshotsActionsTest-1983587027 None] Creating offline snapshot b2bddeb3-9fb2-49a4-9f55-383af93ef1fb of volume ee4e9386-0b3c-4207-8b14-32b073ed06da {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 12:15:00 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3258658c-4a2d-4408-a322-3e47b403554d]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:15:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1507e260-c02e-47b0-bc86-fff92c4d4686 tempest-SnapshotsActionsTest-1983587027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.18ddc5e3-c5b2-4dc1-9836-90658e310a86 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:15:00 devstack sudo[92865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.18ddc5e3-c5b2-4dc1-9836-90658e310a86 Nov 04 12:15:00 devstack sudo[92865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:15:00 devstack sudo[92865]: pam_unix(sudo:session): session closed for user root Nov 04 12:15:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1507e260-c02e-47b0-bc86-fff92c4d4686 tempest-SnapshotsActionsTest-1983587027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.18ddc5e3-c5b2-4dc1-9836-90658e310a86" returned: 0 in 0.454s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:15:00 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-1507e260-c02e-47b0-bc86-fff92c4d4686 tempest-SnapshotsActionsTest-1983587027 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee4e9386-0b3c-4207-8b14-32b073ed06da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 12:15:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1507e260-c02e-47b0-bc86-fff92c4d4686 tempest-SnapshotsActionsTest-1983587027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.18ddc5e3-c5b2-4dc1-9836-90658e310a86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.b2bddeb3-9fb2-49a4-9f55-383af93ef1fb 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:15:00 devstack sudo[92874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.18ddc5e3-c5b2-4dc1-9836-90658e310a86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.b2bddeb3-9fb2-49a4-9f55-383af93ef1fb 1G Nov 04 12:15:00 devstack sudo[92874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:15:01 devstack sudo[92874]: pam_unix(sudo:session): session closed for user root Nov 04 12:15:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1507e260-c02e-47b0-bc86-fff92c4d4686 tempest-SnapshotsActionsTest-1983587027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.18ddc5e3-c5b2-4dc1-9836-90658e310a86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.b2bddeb3-9fb2-49a4-9f55-383af93ef1fb 1G" returned: 0 in 0.698s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:15:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1507e260-c02e-47b0-bc86-fff92c4d4686 tempest-SnapshotsActionsTest-1983587027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.18ddc5e3-c5b2-4dc1-9836-90658e310a86 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.b2bddeb3-9fb2-49a4-9f55-383af93ef1fb {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:15:01 devstack sudo[92885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.18ddc5e3-c5b2-4dc1-9836-90658e310a86 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.b2bddeb3-9fb2-49a4-9f55-383af93ef1fb Nov 04 12:15:01 devstack sudo[92885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:15:01 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-10b0f0c2-fb46-4ffa-b639-8f82e91812ec tempest-GroupsTest-1749445549 None] Update group completed successfully. Nov 04 12:15:01 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 12:15:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:15:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:15:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:15:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:15:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:15:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:15:01 devstack sudo[92888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:15:01 devstack sudo[92888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:15:01 devstack sudo[92885]: pam_unix(sudo:session): session closed for user root Nov 04 12:15:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1507e260-c02e-47b0-bc86-fff92c4d4686 tempest-SnapshotsActionsTest-1983587027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.18ddc5e3-c5b2-4dc1-9836-90658e310a86 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.b2bddeb3-9fb2-49a4-9f55-383af93ef1fb" returned: 0 in 0.473s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:15:02 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-1507e260-c02e-47b0-bc86-fff92c4d4686 tempest-SnapshotsActionsTest-1983587027 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.b2bddeb3-9fb2-49a4-9f55-383af93ef1fb is being set with open permissions: ugo+rw Nov 04 12:15:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1507e260-c02e-47b0-bc86-fff92c4d4686 tempest-SnapshotsActionsTest-1983587027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.b2bddeb3-9fb2-49a4-9f55-383af93ef1fb {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:15:02 devstack sudo[92897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.b2bddeb3-9fb2-49a4-9f55-383af93ef1fb Nov 04 12:15:02 devstack sudo[92897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:15:02 devstack sudo[92888]: pam_unix(sudo:session): session closed for user root Nov 04 12:15:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.487s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:15:02 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:15:02 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Running periodic task VolumeManager._thread_info {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 12:15:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] thread count: 28 {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 12:15:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] thread info: [<_MainThread(MainThread, started 140610387472512)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 12:15:02 devstack sudo[92897]: pam_unix(sudo:session): session closed for user root Nov 04 12:15:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1507e260-c02e-47b0-bc86-fff92c4d4686 tempest-SnapshotsActionsTest-1983587027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.b2bddeb3-9fb2-49a4-9f55-383af93ef1fb" returned: 0 in 0.322s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:15:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1507e260-c02e-47b0-bc86-fff92c4d4686 tempest-SnapshotsActionsTest-1983587027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.120s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:15:02 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-1507e260-c02e-47b0-bc86-fff92c4d4686 tempest-SnapshotsActionsTest-1983587027 None] Create snapshot completed successfully Nov 04 12:15:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-d7a20856-0a11-4198-a5f5-0b70555e8e35 req-9d41f4a9-62fe-47b5-8312-0bb1984a0eb8 tempest-ServerActionsTestOtherA-1526177158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:15:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-d7a20856-0a11-4198-a5f5-0b70555e8e35 req-9d41f4a9-62fe-47b5-8312-0bb1984a0eb8 tempest-ServerActionsTestOtherA-1526177158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:15:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-d7a20856-0a11-4198-a5f5-0b70555e8e35 req-9d41f4a9-62fe-47b5-8312-0bb1984a0eb8 tempest-ServerActionsTestOtherA-1526177158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:15:03 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-9afe665c-3e5a-412b-998b-a91de2b4451c tempest-GroupsTest-1749445549 None] Update group completed successfully. Nov 04 12:15:03 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-d7a20856-0a11-4198-a5f5-0b70555e8e35 req-9d41f4a9-62fe-47b5-8312-0bb1984a0eb8 tempest-ServerActionsTestOtherA-1526177158 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784', 'name': 'volume-4f5306af-c4b6-474c-93fa-aa3638b46630', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c86f412e-9388-4d51-94e3-eb11f4d43458', 'enforce_multipath': True} {{(pid=87095) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 12:15:03 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-d7a20856-0a11-4198-a5f5-0b70555e8e35 req-9d41f4a9-62fe-47b5-8312-0bb1984a0eb8 tempest-ServerActionsTestOtherA-1526177158 None] attachment_update completed successfully. Nov 04 12:15:03 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7995972f-e843-43b0-b136-c7c9c70d47f7 tempest-SnapshotsActionsTest-572905002 None] Acquiring lock "cinder-b2bddeb3-9fb2-49a4-9f55-383af93ef1fb-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:15:03 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7995972f-e843-43b0-b136-c7c9c70d47f7 tempest-SnapshotsActionsTest-572905002 None] Lock "cinder-b2bddeb3-9fb2-49a4-9f55-383af93ef1fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:15:03 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7995972f-e843-43b0-b136-c7c9c70d47f7 tempest-SnapshotsActionsTest-572905002 None] Acquiring lock "cinder-quobyte-ee4e9386-0b3c-4207-8b14-32b073ed06da" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:15:03 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7995972f-e843-43b0-b136-c7c9c70d47f7 tempest-SnapshotsActionsTest-572905002 None] Lock "cinder-quobyte-ee4e9386-0b3c-4207-8b14-32b073ed06da" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:15:03 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7995972f-e843-43b0-b136-c7c9c70d47f7 tempest-SnapshotsActionsTest-572905002 None] Acquiring lock "cinder-quobyte-b2bddeb3-9fb2-49a4-9f55-383af93ef1fb" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:15:03 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7995972f-e843-43b0-b136-c7c9c70d47f7 tempest-SnapshotsActionsTest-572905002 None] Lock "cinder-quobyte-b2bddeb3-9fb2-49a4-9f55-383af93ef1fb" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:15:03 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-7995972f-e843-43b0-b136-c7c9c70d47f7 tempest-SnapshotsActionsTest-572905002 None] Deleting offline snapshot b2bddeb3-9fb2-49a4-9f55-383af93ef1fb of volume ee4e9386-0b3c-4207-8b14-32b073ed06da {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 12:15:03 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-7995972f-e843-43b0-b136-c7c9c70d47f7 tempest-SnapshotsActionsTest-572905002 None] snapshot_file for this snap is: volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.b2bddeb3-9fb2-49a4-9f55-383af93ef1fb {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 12:15:03 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f8c8c6e-acaa-4729-b4b1-05b4ce5c8c1a]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:15:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7995972f-e843-43b0-b136-c7c9c70d47f7 tempest-SnapshotsActionsTest-572905002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.b2bddeb3-9fb2-49a4-9f55-383af93ef1fb {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:15:03 devstack sudo[92923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.b2bddeb3-9fb2-49a4-9f55-383af93ef1fb Nov 04 12:15:03 devstack sudo[92923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:15:04 devstack sudo[92923]: pam_unix(sudo:session): session closed for user root Nov 04 12:15:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7995972f-e843-43b0-b136-c7c9c70d47f7 tempest-SnapshotsActionsTest-572905002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.b2bddeb3-9fb2-49a4-9f55-383af93ef1fb" returned: 0 in 0.470s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:15:04 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-7995972f-e843-43b0-b136-c7c9c70d47f7 tempest-SnapshotsActionsTest-572905002 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee4e9386-0b3c-4207-8b14-32b073ed06da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 12:15:04 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96baf54-37f7-4082-9beb-d7ab64f22ec5]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:15:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7995972f-e843-43b0-b136-c7c9c70d47f7 tempest-SnapshotsActionsTest-572905002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.18ddc5e3-c5b2-4dc1-9836-90658e310a86 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:15:04 devstack sudo[92928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.18ddc5e3-c5b2-4dc1-9836-90658e310a86 Nov 04 12:15:04 devstack sudo[92928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:15:04 devstack sudo[92928]: pam_unix(sudo:session): session closed for user root Nov 04 12:15:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7995972f-e843-43b0-b136-c7c9c70d47f7 tempest-SnapshotsActionsTest-572905002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.18ddc5e3-c5b2-4dc1-9836-90658e310a86" returned: 0 in 0.508s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:15:04 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-7995972f-e843-43b0-b136-c7c9c70d47f7 tempest-SnapshotsActionsTest-572905002 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee4e9386-0b3c-4207-8b14-32b073ed06da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 12:15:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7995972f-e843-43b0-b136-c7c9c70d47f7 tempest-SnapshotsActionsTest-572905002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.b2bddeb3-9fb2-49a4-9f55-383af93ef1fb {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:15:04 devstack sudo[92935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.b2bddeb3-9fb2-49a4-9f55-383af93ef1fb Nov 04 12:15:04 devstack sudo[92935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:15:05 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-71c4422e-02d4-4c00-9a97-ae4c2315111e tempest-GroupsTest-1749445549 None] Acquiring lock "cinder-quobyte-d46f89b3-dd0b-4eb1-9c5b-895640087534" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:15:05 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-71c4422e-02d4-4c00-9a97-ae4c2315111e tempest-GroupsTest-1749445549 None] Lock "cinder-quobyte-d46f89b3-dd0b-4eb1-9c5b-895640087534" acquired by "delete_volume" :: waited 0.031s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:15:05 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aee53a6-e93e-42a9-ab42-5950b9119182]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:15:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-71c4422e-02d4-4c00-9a97-ae4c2315111e tempest-GroupsTest-1749445549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d46f89b3-dd0b-4eb1-9c5b-895640087534 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:15:05 devstack sudo[92940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d46f89b3-dd0b-4eb1-9c5b-895640087534 Nov 04 12:15:05 devstack sudo[92940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:15:05 devstack sudo[92935]: pam_unix(sudo:session): session closed for user root Nov 04 12:15:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7995972f-e843-43b0-b136-c7c9c70d47f7 tempest-SnapshotsActionsTest-572905002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.b2bddeb3-9fb2-49a4-9f55-383af93ef1fb" returned: 0 in 0.652s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:15:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7995972f-e843-43b0-b136-c7c9c70d47f7 tempest-SnapshotsActionsTest-572905002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.b2bddeb3-9fb2-49a4-9f55-383af93ef1fb {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:15:05 devstack sudo[92955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.b2bddeb3-9fb2-49a4-9f55-383af93ef1fb Nov 04 12:15:05 devstack sudo[92955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:15:05 devstack sudo[92955]: pam_unix(sudo:session): session closed for user root Nov 04 12:15:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7995972f-e843-43b0-b136-c7c9c70d47f7 tempest-SnapshotsActionsTest-572905002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.b2bddeb3-9fb2-49a4-9f55-383af93ef1fb" returned: 0 in 0.495s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:15:05 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7995972f-e843-43b0-b136-c7c9c70d47f7 tempest-SnapshotsActionsTest-572905002 None] Lock "cinder-quobyte-b2bddeb3-9fb2-49a4-9f55-383af93ef1fb" released by "_delete_snapshot" :: held 2.296s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:15:05 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7995972f-e843-43b0-b136-c7c9c70d47f7 tempest-SnapshotsActionsTest-572905002 None] Lock "cinder-quobyte-ee4e9386-0b3c-4207-8b14-32b073ed06da" released by "delete_snapshot" :: held 2.330s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:15:06 devstack sudo[92940]: pam_unix(sudo:session): session closed for user root Nov 04 12:15:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-71c4422e-02d4-4c00-9a97-ae4c2315111e tempest-GroupsTest-1749445549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d46f89b3-dd0b-4eb1-9c5b-895640087534" returned: 0 in 0.930s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:15:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-71c4422e-02d4-4c00-9a97-ae4c2315111e tempest-GroupsTest-1749445549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d46f89b3-dd0b-4eb1-9c5b-895640087534 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:15:06 devstack sudo[93002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d46f89b3-dd0b-4eb1-9c5b-895640087534 Nov 04 12:15:06 devstack sudo[93002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:15:06 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-7995972f-e843-43b0-b136-c7c9c70d47f7 tempest-SnapshotsActionsTest-572905002 None] Created reservations ['ff83b98f-952c-438a-93b4-34585626d961', 'a2bf0478-b498-4894-8c4a-1d6676772ff0', 'd318cbed-2e19-4ba9-8b72-4705962790b0', 'd3e5c270-2eac-46f6-98fb-df8fd5009f73'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:15:06 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-7995972f-e843-43b0-b136-c7c9c70d47f7 tempest-SnapshotsActionsTest-572905002 None] Delete snapshot completed successfully. Nov 04 12:15:06 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7995972f-e843-43b0-b136-c7c9c70d47f7 tempest-SnapshotsActionsTest-572905002 None] Lock "cinder-b2bddeb3-9fb2-49a4-9f55-383af93ef1fb-delete_snapshot" released by "delete_snapshot" :: held 2.726s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:15:06 devstack sudo[93002]: pam_unix(sudo:session): session closed for user root Nov 04 12:15:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-71c4422e-02d4-4c00-9a97-ae4c2315111e tempest-GroupsTest-1749445549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d46f89b3-dd0b-4eb1-9c5b-895640087534" returned: 0 in 0.504s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:15:06 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-71c4422e-02d4-4c00-9a97-ae4c2315111e tempest-GroupsTest-1749445549 None] Lock "cinder-quobyte-d46f89b3-dd0b-4eb1-9c5b-895640087534" released by "delete_volume" :: held 1.512s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:15:06 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-71c4422e-02d4-4c00-9a97-ae4c2315111e tempest-GroupsTest-1749445549 None] Acquiring lock "cinder-quobyte-da194500-a506-40ba-ac7c-525d90baba9e" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:15:06 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-71c4422e-02d4-4c00-9a97-ae4c2315111e tempest-GroupsTest-1749445549 None] Lock "cinder-quobyte-da194500-a506-40ba-ac7c-525d90baba9e" acquired by "delete_volume" :: waited 0.021s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:15:06 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[404c6280-385a-4334-93e2-8b8713f640b2]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:15:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-71c4422e-02d4-4c00-9a97-ae4c2315111e tempest-GroupsTest-1749445549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-da194500-a506-40ba-ac7c-525d90baba9e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:15:06 devstack sudo[93016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-da194500-a506-40ba-ac7c-525d90baba9e Nov 04 12:15:06 devstack sudo[93016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:15:07 devstack sudo[93016]: pam_unix(sudo:session): session closed for user root Nov 04 12:15:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-71c4422e-02d4-4c00-9a97-ae4c2315111e tempest-GroupsTest-1749445549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-da194500-a506-40ba-ac7c-525d90baba9e" returned: 0 in 0.589s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:15:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-71c4422e-02d4-4c00-9a97-ae4c2315111e tempest-GroupsTest-1749445549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-da194500-a506-40ba-ac7c-525d90baba9e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:15:07 devstack sudo[93025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-da194500-a506-40ba-ac7c-525d90baba9e Nov 04 12:15:07 devstack sudo[93025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:15:07 devstack sudo[93025]: pam_unix(sudo:session): session closed for user root Nov 04 12:15:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-71c4422e-02d4-4c00-9a97-ae4c2315111e tempest-GroupsTest-1749445549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-da194500-a506-40ba-ac7c-525d90baba9e" returned: 0 in 0.449s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:15:07 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-71c4422e-02d4-4c00-9a97-ae4c2315111e tempest-GroupsTest-1749445549 None] Lock "cinder-quobyte-da194500-a506-40ba-ac7c-525d90baba9e" released by "delete_volume" :: held 1.103s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:15:07 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=162,cinder:UPDATE=130,cinder:DELETE=10,cinder:INSERT=37 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 12:15:07 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=146,cinder:UPDATE=135,cinder:INSERT=34,cinder:DELETE=8 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 12:15:08 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-71c4422e-02d4-4c00-9a97-ae4c2315111e tempest-GroupsTest-1749445549 None] Created reservations ['c46039ad-80e0-4e8b-8789-11b4f0be61ef'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:15:08 devstack cinder-volume[87095]: WARNING cinder.quota [None req-71c4422e-02d4-4c00-9a97-ae4c2315111e tempest-GroupsTest-1749445549 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-845044179 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-845044179, it is now deprecated. Please use the default quota class for default quota. Nov 04 12:15:08 devstack cinder-volume[87095]: WARNING cinder.quota [None req-71c4422e-02d4-4c00-9a97-ae4c2315111e tempest-GroupsTest-1749445549 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-845044179 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-845044179, it is now deprecated. Please use the default quota class for default quota. Nov 04 12:15:08 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-26fa6230-fc22-4a55-ae56-149f21befe2e tempest-SnapshotsActionsTest-1983587027 None] Acquiring lock "cinder-18ddc5e3-c5b2-4dc1-9836-90658e310a86-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:15:08 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-71c4422e-02d4-4c00-9a97-ae4c2315111e tempest-GroupsTest-1749445549 None] Created reservations ['d1f0463e-3145-4b0e-87a4-9445d30dca70', '63792979-4392-40b1-8aef-41a9d99f10c9', '816ed0be-8c7f-43e2-bb1c-4ee60e5cb287', '45bedf90-a0c7-4bac-b320-5f9121e950a1'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:15:08 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-26fa6230-fc22-4a55-ae56-149f21befe2e tempest-SnapshotsActionsTest-1983587027 None] Lock "cinder-18ddc5e3-c5b2-4dc1-9836-90658e310a86-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:15:08 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-26fa6230-fc22-4a55-ae56-149f21befe2e tempest-SnapshotsActionsTest-1983587027 None] Acquiring lock "cinder-quobyte-ee4e9386-0b3c-4207-8b14-32b073ed06da" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:15:08 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-26fa6230-fc22-4a55-ae56-149f21befe2e tempest-SnapshotsActionsTest-1983587027 None] Lock "cinder-quobyte-ee4e9386-0b3c-4207-8b14-32b073ed06da" acquired by "delete_snapshot" :: waited 0.062s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:15:08 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-26fa6230-fc22-4a55-ae56-149f21befe2e tempest-SnapshotsActionsTest-1983587027 None] Acquiring lock "cinder-quobyte-18ddc5e3-c5b2-4dc1-9836-90658e310a86" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:15:08 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-26fa6230-fc22-4a55-ae56-149f21befe2e tempest-SnapshotsActionsTest-1983587027 None] Lock "cinder-quobyte-18ddc5e3-c5b2-4dc1-9836-90658e310a86" acquired by "_delete_snapshot" :: waited 0.063s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:15:08 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-26fa6230-fc22-4a55-ae56-149f21befe2e tempest-SnapshotsActionsTest-1983587027 None] Deleting offline snapshot 18ddc5e3-c5b2-4dc1-9836-90658e310a86 of volume ee4e9386-0b3c-4207-8b14-32b073ed06da {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 12:15:08 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-26fa6230-fc22-4a55-ae56-149f21befe2e tempest-SnapshotsActionsTest-1983587027 None] snapshot_file for this snap is: volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.18ddc5e3-c5b2-4dc1-9836-90658e310a86 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 12:15:08 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fee7556-d535-41ff-99c1-e55a587dde65]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:15:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-26fa6230-fc22-4a55-ae56-149f21befe2e tempest-SnapshotsActionsTest-1983587027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.18ddc5e3-c5b2-4dc1-9836-90658e310a86 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:15:08 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-71c4422e-02d4-4c00-9a97-ae4c2315111e tempest-GroupsTest-1749445549 None] Created reservations ['58d70212-cecf-4747-ad17-e396ba9739ff', '560d608d-4b7e-4629-b501-c0e15b4448bc', '1f0e17f2-e494-4ecd-9934-3b0b7be765eb', '6137f68e-99b5-45ae-8439-2b027aa44d4f'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:15:08 devstack sudo[93462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.18ddc5e3-c5b2-4dc1-9836-90658e310a86 Nov 04 12:15:08 devstack sudo[93462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:15:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-71c4422e-02d4-4c00-9a97-ae4c2315111e tempest-GroupsTest-1749445549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:15:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-71c4422e-02d4-4c00-9a97-ae4c2315111e tempest-GroupsTest-1749445549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:15:09 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-71c4422e-02d4-4c00-9a97-ae4c2315111e tempest-GroupsTest-1749445549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:15:09 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-71c4422e-02d4-4c00-9a97-ae4c2315111e tempest-GroupsTest-1749445549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:15:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-71c4422e-02d4-4c00-9a97-ae4c2315111e tempest-GroupsTest-1749445549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:15:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-71c4422e-02d4-4c00-9a97-ae4c2315111e tempest-GroupsTest-1749445549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:15:09 devstack sudo[93474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:15:09 devstack sudo[93474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:15:09 devstack sudo[93462]: pam_unix(sudo:session): session closed for user root Nov 04 12:15:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-26fa6230-fc22-4a55-ae56-149f21befe2e tempest-SnapshotsActionsTest-1983587027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.18ddc5e3-c5b2-4dc1-9836-90658e310a86" returned: 0 in 0.950s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:15:09 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-26fa6230-fc22-4a55-ae56-149f21befe2e tempest-SnapshotsActionsTest-1983587027 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee4e9386-0b3c-4207-8b14-32b073ed06da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 12:15:09 devstack sudo[93474]: pam_unix(sudo:session): session closed for user root Nov 04 12:15:09 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b14541-ecb8-4879-a163-a14841c9cbc1]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:15:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-26fa6230-fc22-4a55-ae56-149f21befe2e tempest-SnapshotsActionsTest-1983587027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:15:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-71c4422e-02d4-4c00-9a97-ae4c2315111e tempest-GroupsTest-1749445549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.570s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:15:09 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-71c4422e-02d4-4c00-9a97-ae4c2315111e tempest-GroupsTest-1749445549 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:15:09 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-71c4422e-02d4-4c00-9a97-ae4c2315111e tempest-GroupsTest-1749445549 None] Delete group completed successfully. Nov 04 12:15:09 devstack sudo[93486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da Nov 04 12:15:09 devstack sudo[93486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:15:09 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e14e70b1-0d58-46b9-adaf-02f71ed3961f tempest-VolumesActionsTest-77504308 None] Acquiring lock "cinder-63ea78bf-277d-4ebd-833d-39b9f3f67bd8" by "attach_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:15:09 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e14e70b1-0d58-46b9-adaf-02f71ed3961f tempest-VolumesActionsTest-77504308 None] Lock "cinder-63ea78bf-277d-4ebd-833d-39b9f3f67bd8" acquired by "attach_volume" :: waited 0.034s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:15:10 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-e14e70b1-0d58-46b9-adaf-02f71ed3961f tempest-VolumesActionsTest-77504308 None] Attaching volume 63ea78bf-277d-4ebd-833d-39b9f3f67bd8 to instance 67885cfc-0061-4bf5-b42e-6c32a1a2a9c6 at mountpoint /dev/vdb on host None. Nov 04 12:15:10 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-e14e70b1-0d58-46b9-adaf-02f71ed3961f tempest-VolumesActionsTest-77504308 None] Attach volume completed successfully. Nov 04 12:15:10 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e14e70b1-0d58-46b9-adaf-02f71ed3961f tempest-VolumesActionsTest-77504308 None] Lock "cinder-63ea78bf-277d-4ebd-833d-39b9f3f67bd8" released by "attach_volume" :: held 0.290s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:15:10 devstack sudo[93486]: pam_unix(sudo:session): session closed for user root Nov 04 12:15:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-26fa6230-fc22-4a55-ae56-149f21befe2e tempest-SnapshotsActionsTest-1983587027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da" returned: 0 in 0.752s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:15:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-26fa6230-fc22-4a55-ae56-149f21befe2e tempest-SnapshotsActionsTest-1983587027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.18ddc5e3-c5b2-4dc1-9836-90658e310a86 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:15:10 devstack sudo[93492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.18ddc5e3-c5b2-4dc1-9836-90658e310a86 Nov 04 12:15:10 devstack sudo[93492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:15:11 devstack sudo[93492]: pam_unix(sudo:session): session closed for user root Nov 04 12:15:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-26fa6230-fc22-4a55-ae56-149f21befe2e tempest-SnapshotsActionsTest-1983587027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.18ddc5e3-c5b2-4dc1-9836-90658e310a86" returned: 0 in 0.760s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:15:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-26fa6230-fc22-4a55-ae56-149f21befe2e tempest-SnapshotsActionsTest-1983587027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.18ddc5e3-c5b2-4dc1-9836-90658e310a86 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:15:11 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-829a5f24-3c1a-4fb3-b21e-97428347eeb1 tempest-VolumesActionsTest-77504308 None] Acquiring lock "cinder-63ea78bf-277d-4ebd-833d-39b9f3f67bd8-detach_volume" by "detach_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:15:11 devstack sudo[93499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.18ddc5e3-c5b2-4dc1-9836-90658e310a86 Nov 04 12:15:11 devstack sudo[93499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:15:11 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-829a5f24-3c1a-4fb3-b21e-97428347eeb1 tempest-VolumesActionsTest-77504308 None] Lock "cinder-63ea78bf-277d-4ebd-833d-39b9f3f67bd8-detach_volume" acquired by "detach_volume" :: waited 0.068s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:15:11 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-829a5f24-3c1a-4fb3-b21e-97428347eeb1 tempest-VolumesActionsTest-77504308 None] Detaching volume 63ea78bf-277d-4ebd-833d-39b9f3f67bd8 from instance 67885cfc-0061-4bf5-b42e-6c32a1a2a9c6. Nov 04 12:15:11 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-829a5f24-3c1a-4fb3-b21e-97428347eeb1 tempest-VolumesActionsTest-77504308 None] Detach volume completed successfully. Nov 04 12:15:11 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-829a5f24-3c1a-4fb3-b21e-97428347eeb1 tempest-VolumesActionsTest-77504308 None] Lock "cinder-63ea78bf-277d-4ebd-833d-39b9f3f67bd8-detach_volume" released by "detach_volume" :: held 0.211s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:15:11 devstack sudo[93499]: pam_unix(sudo:session): session closed for user root Nov 04 12:15:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-26fa6230-fc22-4a55-ae56-149f21befe2e tempest-SnapshotsActionsTest-1983587027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da.18ddc5e3-c5b2-4dc1-9836-90658e310a86" returned: 0 in 0.679s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:15:11 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-26fa6230-fc22-4a55-ae56-149f21befe2e tempest-SnapshotsActionsTest-1983587027 None] Lock "cinder-quobyte-18ddc5e3-c5b2-4dc1-9836-90658e310a86" released by "_delete_snapshot" :: held 3.482s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:15:11 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-26fa6230-fc22-4a55-ae56-149f21befe2e tempest-SnapshotsActionsTest-1983587027 None] Lock "cinder-quobyte-ee4e9386-0b3c-4207-8b14-32b073ed06da" released by "delete_snapshot" :: held 3.582s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:15:12 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-26fa6230-fc22-4a55-ae56-149f21befe2e tempest-SnapshotsActionsTest-1983587027 None] Created reservations ['92fa5d6c-e0f6-45f0-b97b-83fdec417160', '0f3a1b18-34d7-477b-831e-e65b981dbb36', '5493d501-d71d-41e0-ad44-e5e67065e152', '96915c47-1738-4d15-ae4c-9909fe58f2e4'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:15:12 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-26fa6230-fc22-4a55-ae56-149f21befe2e tempest-SnapshotsActionsTest-1983587027 None] Delete snapshot completed successfully. Nov 04 12:15:12 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-26fa6230-fc22-4a55-ae56-149f21befe2e tempest-SnapshotsActionsTest-1983587027 None] Lock "cinder-18ddc5e3-c5b2-4dc1-9836-90658e310a86-delete_snapshot" released by "delete_snapshot" :: held 4.132s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:15:12 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-254a947f-3c31-460f-8173-3ea729d19539 tempest-SnapshotsActionsTest-1983587027 None] Acquiring lock "cinder-ee4e9386-0b3c-4207-8b14-32b073ed06da-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:15:13 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-254a947f-3c31-460f-8173-3ea729d19539 tempest-SnapshotsActionsTest-1983587027 None] Lock "cinder-ee4e9386-0b3c-4207-8b14-32b073ed06da-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:15:13 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-254a947f-3c31-460f-8173-3ea729d19539 tempest-SnapshotsActionsTest-1983587027 None] Acquiring lock "cinder-quobyte-ee4e9386-0b3c-4207-8b14-32b073ed06da" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:15:13 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-254a947f-3c31-460f-8173-3ea729d19539 tempest-SnapshotsActionsTest-1983587027 None] Lock "cinder-quobyte-ee4e9386-0b3c-4207-8b14-32b073ed06da" acquired by "delete_volume" :: waited 0.029s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:15:13 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eee61ff-d33f-480c-9328-c36e3ffd6aa5]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:15:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-254a947f-3c31-460f-8173-3ea729d19539 tempest-SnapshotsActionsTest-1983587027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:15:13 devstack sudo[93524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da Nov 04 12:15:13 devstack sudo[93524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:15:13 devstack sudo[93524]: pam_unix(sudo:session): session closed for user root Nov 04 12:15:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-254a947f-3c31-460f-8173-3ea729d19539 tempest-SnapshotsActionsTest-1983587027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da" returned: 0 in 0.669s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:15:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-254a947f-3c31-460f-8173-3ea729d19539 tempest-SnapshotsActionsTest-1983587027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:15:14 devstack sudo[93531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da Nov 04 12:15:14 devstack sudo[93531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:15:14 devstack sudo[93531]: pam_unix(sudo:session): session closed for user root Nov 04 12:15:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-254a947f-3c31-460f-8173-3ea729d19539 tempest-SnapshotsActionsTest-1983587027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee4e9386-0b3c-4207-8b14-32b073ed06da" returned: 0 in 0.517s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:15:14 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-254a947f-3c31-460f-8173-3ea729d19539 tempest-SnapshotsActionsTest-1983587027 None] Lock "cinder-quobyte-ee4e9386-0b3c-4207-8b14-32b073ed06da" released by "delete_volume" :: held 1.320s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:15:14 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-254a947f-3c31-460f-8173-3ea729d19539 tempest-SnapshotsActionsTest-1983587027 None] Created reservations ['2548c63d-f674-4e9b-b32f-95ac4c1e4514', 'a97ca3c7-57b8-4681-bb8e-894619077247', '0a7d1fee-69f6-4367-bace-add64812795a', 'e462c9e8-d867-474c-8e83-e3ffcac48054'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:15:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-254a947f-3c31-460f-8173-3ea729d19539 tempest-SnapshotsActionsTest-1983587027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:15:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-254a947f-3c31-460f-8173-3ea729d19539 tempest-SnapshotsActionsTest-1983587027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:15:14 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-254a947f-3c31-460f-8173-3ea729d19539 tempest-SnapshotsActionsTest-1983587027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:15:14 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-254a947f-3c31-460f-8173-3ea729d19539 tempest-SnapshotsActionsTest-1983587027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:15:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-254a947f-3c31-460f-8173-3ea729d19539 tempest-SnapshotsActionsTest-1983587027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:15:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-254a947f-3c31-460f-8173-3ea729d19539 tempest-SnapshotsActionsTest-1983587027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:15:14 devstack sudo[93536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:15:14 devstack sudo[93536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:15:15 devstack sudo[93536]: pam_unix(sudo:session): session closed for user root Nov 04 12:15:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-254a947f-3c31-460f-8173-3ea729d19539 tempest-SnapshotsActionsTest-1983587027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.430s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:15:15 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-254a947f-3c31-460f-8173-3ea729d19539 tempest-SnapshotsActionsTest-1983587027 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:15:15 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-254a947f-3c31-460f-8173-3ea729d19539 tempest-SnapshotsActionsTest-1983587027 None] Deleted volume successfully. Nov 04 12:15:15 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-254a947f-3c31-460f-8173-3ea729d19539 tempest-SnapshotsActionsTest-1983587027 None] Lock "cinder-ee4e9386-0b3c-4207-8b14-32b073ed06da-delete_volume" released by "delete_volume" :: held 2.343s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:15:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2b57ac95-4961-4f7e-911d-315a631d6330 tempest-VolumesActionsTest-77504308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:15:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2b57ac95-4961-4f7e-911d-315a631d6330 tempest-VolumesActionsTest-77504308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:15:20 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c941ab6-4896-4ca0-81fb-3bf81a1ec011]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:15:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2b57ac95-4961-4f7e-911d-315a631d6330 tempest-VolumesActionsTest-77504308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-63ea78bf-277d-4ebd-833d-39b9f3f67bd8 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:15:20 devstack sudo[93583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-63ea78bf-277d-4ebd-833d-39b9f3f67bd8 Nov 04 12:15:20 devstack sudo[93583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:15:21 devstack sudo[93583]: pam_unix(sudo:session): session closed for user root Nov 04 12:15:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2b57ac95-4961-4f7e-911d-315a631d6330 tempest-VolumesActionsTest-77504308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-63ea78bf-277d-4ebd-833d-39b9f3f67bd8" returned: 0 in 0.895s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:15:21 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[30499462-9f54-49a4-948d-d7acb9d982f5]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:15:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2b57ac95-4961-4f7e-911d-315a631d6330 tempest-VolumesActionsTest-77504308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-63ea78bf-277d-4ebd-833d-39b9f3f67bd8 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:15:21 devstack sudo[93588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-63ea78bf-277d-4ebd-833d-39b9f3f67bd8 Nov 04 12:15:21 devstack sudo[93588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:15:22 devstack sudo[93588]: pam_unix(sudo:session): session closed for user root Nov 04 12:15:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2b57ac95-4961-4f7e-911d-315a631d6330 tempest-VolumesActionsTest-77504308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-63ea78bf-277d-4ebd-833d-39b9f3f67bd8" returned: 0 in 0.672s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:15:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2b57ac95-4961-4f7e-911d-315a631d6330 tempest-VolumesActionsTest-77504308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-63ea78bf-277d-4ebd-833d-39b9f3f67bd8 /opt/stack/data/cinder/conversion/63ea78bf-277d-4ebd-833d-39b9f3f67bd8.temp_image.c0694e9d-44fe-40e4-b7aa-76c4537141d9bolk5p5f.img {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:15:22 devstack sudo[93595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-63ea78bf-277d-4ebd-833d-39b9f3f67bd8 /opt/stack/data/cinder/conversion/63ea78bf-277d-4ebd-833d-39b9f3f67bd8.temp_image.c0694e9d-44fe-40e4-b7aa-76c4537141d9bolk5p5f.img Nov 04 12:15:22 devstack sudo[93595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:15:25 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:INSERT=10,cinder:SELECT=27,cinder:UPDATE=33,cinder:DELETE=1 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 12:15:31 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-b5558edb-cf2f-4375-a170-92909b3a24c4 req-ebfc89fb-95a9-4dfc-8c4d-51db894dd52c tempest-ServerActionsTestOtherA-1526177158 None] Terminate volume connection completed successfully. Nov 04 12:15:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-b5558edb-cf2f-4375-a170-92909b3a24c4 req-ebfc89fb-95a9-4dfc-8c4d-51db894dd52c tempest-ServerActionsTestOtherA-1526177158 None] Deleting attachment c86f412e-9388-4d51-94e3-eb11f4d43458. {{(pid=87095) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 12:15:33 devstack sudo[93595]: pam_unix(sudo:session): session closed for user root Nov 04 12:15:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2b57ac95-4961-4f7e-911d-315a631d6330 tempest-VolumesActionsTest-77504308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-63ea78bf-277d-4ebd-833d-39b9f3f67bd8 /opt/stack/data/cinder/conversion/63ea78bf-277d-4ebd-833d-39b9f3f67bd8.temp_image.c0694e9d-44fe-40e4-b7aa-76c4537141d9bolk5p5f.img" returned: 0 in 11.546s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:15:33 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f69eb1-7a7f-49a4-ad57-357bc6e712cc]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:15:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2b57ac95-4961-4f7e-911d-315a631d6330 tempest-VolumesActionsTest-77504308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-63ea78bf-277d-4ebd-833d-39b9f3f67bd8 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:15:33 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-83ac5fd4-ad93-408a-8cfb-cc7d08065159 tempest-VolumeRetypeWithoutMigrationTest-77639893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:15:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-83ac5fd4-ad93-408a-8cfb-cc7d08065159 tempest-VolumeRetypeWithoutMigrationTest-77639893 None] Flow 'volume_create_manager' (1cd69a6a-9298-4858-8a53-a18c34f9a334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:15:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-83ac5fd4-ad93-408a-8cfb-cc7d08065159 tempest-VolumeRetypeWithoutMigrationTest-77639893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5b97ec3-bf17-4c47-9eda-c71b58253260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:15:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-83ac5fd4-ad93-408a-8cfb-cc7d08065159 tempest-VolumeRetypeWithoutMigrationTest-77639893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5b97ec3-bf17-4c47-9eda-c71b58253260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:15:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-175517648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ff52e8a-bb46-4312-b469-ff14f0b5a706,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e596b737aa5a48159d9c34121eabe75d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:15:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:15:34Z,use_quota=True,user_id='270accb717ce4b068540d1daa0b7ccc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7843fd9-6a9f-4b9c-9c45-93bd10cf4e88),volume_type_id=f7843fd9-6a9f-4b9c-9c45-93bd10cf4e88)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:15:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-83ac5fd4-ad93-408a-8cfb-cc7d08065159 tempest-VolumeRetypeWithoutMigrationTest-77639893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d36dcf2-b7d4-4eed-8081-26b35d65529f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:15:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-83ac5fd4-ad93-408a-8cfb-cc7d08065159 tempest-VolumeRetypeWithoutMigrationTest-77639893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d36dcf2-b7d4-4eed-8081-26b35d65529f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:15:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-83ac5fd4-ad93-408a-8cfb-cc7d08065159 tempest-VolumeRetypeWithoutMigrationTest-77639893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (182a16e4-7431-4e59-b0dd-cca16185acaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:15:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-83ac5fd4-ad93-408a-8cfb-cc7d08065159 tempest-VolumeRetypeWithoutMigrationTest-77639893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (182a16e4-7431-4e59-b0dd-cca16185acaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ff52e8a-bb46-4312-b469-ff14f0b5a706', 'volume_name': 'volume-0ff52e8a-bb46-4312-b469-ff14f0b5a706', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:15:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-83ac5fd4-ad93-408a-8cfb-cc7d08065159 tempest-VolumeRetypeWithoutMigrationTest-77639893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0298befb-ac34-4ffb-8d61-fcdc32efc955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:15:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-83ac5fd4-ad93-408a-8cfb-cc7d08065159 tempest-VolumeRetypeWithoutMigrationTest-77639893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0298befb-ac34-4ffb-8d61-fcdc32efc955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:15:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-83ac5fd4-ad93-408a-8cfb-cc7d08065159 tempest-VolumeRetypeWithoutMigrationTest-77639893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35f58cb3-aa54-432b-829d-4cd73d27147e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:15:33 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-83ac5fd4-ad93-408a-8cfb-cc7d08065159 tempest-VolumeRetypeWithoutMigrationTest-77639893 None] Volume 0ff52e8a-bb46-4312-b469-ff14f0b5a706: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ff52e8a-bb46-4312-b469-ff14f0b5a706', 'volume_size': 1} Nov 04 12:15:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-83ac5fd4-ad93-408a-8cfb-cc7d08065159 tempest-VolumeRetypeWithoutMigrationTest-77639893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:15:33 devstack sudo[93691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-63ea78bf-277d-4ebd-833d-39b9f3f67bd8 Nov 04 12:15:33 devstack sudo[93691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:15:34 devstack sudo[93691]: pam_unix(sudo:session): session closed for user root Nov 04 12:15:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2b57ac95-4961-4f7e-911d-315a631d6330 tempest-VolumesActionsTest-77504308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-63ea78bf-277d-4ebd-833d-39b9f3f67bd8" returned: 0 in 0.678s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:15:34 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-2b57ac95-4961-4f7e-911d-315a631d6330 tempest-VolumesActionsTest-77504308 None] Image conversion details: src /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-63ea78bf-277d-4ebd-833d-39b9f3f67bd8, size 1024.00 MB, duration 11.55 sec, destination /opt/stack/data/cinder/conversion/63ea78bf-277d-4ebd-833d-39b9f3f67bd8.temp_image.c0694e9d-44fe-40e4-b7aa-76c4537141d9bolk5p5f.img {{(pid=87095) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 12:15:34 devstack cinder-volume[87095]: INFO cinder.image.image_utils [None req-2b57ac95-4961-4f7e-911d-315a631d6330 tempest-VolumesActionsTest-77504308 None] Converted 1024.00 MB image at 88.67 MB/s Nov 04 12:15:34 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-2b57ac95-4961-4f7e-911d-315a631d6330 tempest-VolumesActionsTest-77504308 None] c0694e9d-44fe-40e4-b7aa-76c4537141d9 was raw, no need to convert to raw {{(pid=87095) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 04 12:15:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-b5558edb-cf2f-4375-a170-92909b3a24c4 req-650cf5ae-9e25-403f-8066-6607d1ca6b72 tempest-ServerActionsTestOtherA-1526177158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:15:44 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=37,cinder:UPDATE=36,cinder:INSERT=9 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 12:15:44 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:UPDATE=2,cinder:SELECT=3 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 12:15:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2b57ac95-4961-4f7e-911d-315a631d6330 tempest-VolumesActionsTest-77504308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 34.749s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:15:55 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2b57ac95-4961-4f7e-911d-315a631d6330 tempest-VolumesActionsTest-77504308 None] Uploaded volume to glance image-id: c0694e9d-44fe-40e4-b7aa-76c4537141d9. {{(pid=87095) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 04 12:15:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-83ac5fd4-ad93-408a-8cfb-cc7d08065159 tempest-VolumeRetypeWithoutMigrationTest-77639893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 21.404s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:15:55 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-83ac5fd4-ad93-408a-8cfb-cc7d08065159 tempest-VolumeRetypeWithoutMigrationTest-77639893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:15:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-175517648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ff52e8a-bb46-4312-b469-ff14f0b5a706,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e596b737aa5a48159d9c34121eabe75d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:15:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:15:34Z,use_quota=True,user_id='270accb717ce4b068540d1daa0b7ccc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7843fd9-6a9f-4b9c-9c45-93bd10cf4e88),volume_type_id=f7843fd9-6a9f-4b9c-9c45-93bd10cf4e88)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:15:55 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-83ac5fd4-ad93-408a-8cfb-cc7d08065159 tempest-VolumeRetypeWithoutMigrationTest-77639893 None] Creating volume 0ff52e8a-bb46-4312-b469-ff14f0b5a706 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:15:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-83ac5fd4-ad93-408a-8cfb-cc7d08065159 tempest-VolumeRetypeWithoutMigrationTest-77639893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:15:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-83ac5fd4-ad93-408a-8cfb-cc7d08065159 tempest-VolumeRetypeWithoutMigrationTest-77639893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:15:55 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-83ac5fd4-ad93-408a-8cfb-cc7d08065159 tempest-VolumeRetypeWithoutMigrationTest-77639893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:15:55 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-83ac5fd4-ad93-408a-8cfb-cc7d08065159 tempest-VolumeRetypeWithoutMigrationTest-77639893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:15:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-83ac5fd4-ad93-408a-8cfb-cc7d08065159 tempest-VolumeRetypeWithoutMigrationTest-77639893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:15:55 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-83ac5fd4-ad93-408a-8cfb-cc7d08065159 tempest-VolumeRetypeWithoutMigrationTest-77639893 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:15:55 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-83ac5fd4-ad93-408a-8cfb-cc7d08065159 tempest-VolumeRetypeWithoutMigrationTest-77639893 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:15:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-83ac5fd4-ad93-408a-8cfb-cc7d08065159 tempest-VolumeRetypeWithoutMigrationTest-77639893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0ff52e8a-bb46-4312-b469-ff14f0b5a706 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:15:55 devstack sudo[93709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0ff52e8a-bb46-4312-b469-ff14f0b5a706 1073741824 Nov 04 12:15:55 devstack sudo[93709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:15:55 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-2b57ac95-4961-4f7e-911d-315a631d6330 tempest-VolumesActionsTest-77504308 None] Copy volume to image completed successfully. Nov 04 12:15:55 devstack sudo[93709]: pam_unix(sudo:session): session closed for user root Nov 04 12:15:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-83ac5fd4-ad93-408a-8cfb-cc7d08065159 tempest-VolumeRetypeWithoutMigrationTest-77639893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0ff52e8a-bb46-4312-b469-ff14f0b5a706 1073741824" returned: 0 in 0.497s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:15:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-83ac5fd4-ad93-408a-8cfb-cc7d08065159 tempest-VolumeRetypeWithoutMigrationTest-77639893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0ff52e8a-bb46-4312-b469-ff14f0b5a706 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:15:55 devstack sudo[93715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0ff52e8a-bb46-4312-b469-ff14f0b5a706 Nov 04 12:15:55 devstack sudo[93715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:15:56 devstack sudo[93715]: pam_unix(sudo:session): session closed for user root Nov 04 12:15:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-83ac5fd4-ad93-408a-8cfb-cc7d08065159 tempest-VolumeRetypeWithoutMigrationTest-77639893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0ff52e8a-bb46-4312-b469-ff14f0b5a706" returned: 0 in 0.255s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:15:56 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-83ac5fd4-ad93-408a-8cfb-cc7d08065159 tempest-VolumeRetypeWithoutMigrationTest-77639893 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:15:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-83ac5fd4-ad93-408a-8cfb-cc7d08065159 tempest-VolumeRetypeWithoutMigrationTest-77639893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:15:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-b5558edb-cf2f-4375-a170-92909b3a24c4 req-650cf5ae-9e25-403f-8066-6607d1ca6b72 tempest-ServerActionsTestOtherA-1526177158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 21.191s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:15:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-b5558edb-cf2f-4375-a170-92909b3a24c4 req-650cf5ae-9e25-403f-8066-6607d1ca6b72 tempest-ServerActionsTestOtherA-1526177158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:15:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-83ac5fd4-ad93-408a-8cfb-cc7d08065159 tempest-VolumeRetypeWithoutMigrationTest-77639893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35f58cb3-aa54-432b-829d-4cd73d27147e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ff52e8a-bb46-4312-b469-ff14f0b5a706', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:15:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-83ac5fd4-ad93-408a-8cfb-cc7d08065159 tempest-VolumeRetypeWithoutMigrationTest-77639893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18820757-cbf4-4dc1-a382-cf57e155ce5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:15:56 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-83ac5fd4-ad93-408a-8cfb-cc7d08065159 tempest-VolumeRetypeWithoutMigrationTest-77639893 None] Volume volume-0ff52e8a-bb46-4312-b469-ff14f0b5a706 (0ff52e8a-bb46-4312-b469-ff14f0b5a706): created successfully Nov 04 12:15:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-83ac5fd4-ad93-408a-8cfb-cc7d08065159 tempest-VolumeRetypeWithoutMigrationTest-77639893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18820757-cbf4-4dc1-a382-cf57e155ce5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:15:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-83ac5fd4-ad93-408a-8cfb-cc7d08065159 tempest-VolumeRetypeWithoutMigrationTest-77639893 None] Flow 'volume_create_manager' (1cd69a6a-9298-4858-8a53-a18c34f9a334) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:15:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-b5558edb-cf2f-4375-a170-92909b3a24c4 req-650cf5ae-9e25-403f-8066-6607d1ca6b72 tempest-ServerActionsTestOtherA-1526177158 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784', 'name': 'volume-4f5306af-c4b6-474c-93fa-aa3638b46630', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c2995eb5-bdd3-4bb6-913e-e5986126a0d8', 'enforce_multipath': True} {{(pid=87095) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 12:15:56 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-83ac5fd4-ad93-408a-8cfb-cc7d08065159 tempest-VolumeRetypeWithoutMigrationTest-77639893 None] Created volume successfully. Nov 04 12:15:56 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e051a06-9363-48a6-94d3-88629786d9cc tempest-VolumeQuotasNegativeTestJSON-596826746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:15:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7e051a06-9363-48a6-94d3-88629786d9cc tempest-VolumeQuotasNegativeTestJSON-596826746 None] Flow 'volume_create_manager' (06842a8a-41c8-4ad5-868b-e251cf091940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:15:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7e051a06-9363-48a6-94d3-88629786d9cc tempest-VolumeQuotasNegativeTestJSON-596826746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (149b4d75-e401-4fa9-bf37-c7f2ca597d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:15:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7e051a06-9363-48a6-94d3-88629786d9cc tempest-VolumeQuotasNegativeTestJSON-596826746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (149b4d75-e401-4fa9-bf37-c7f2ca597d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1573686871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5862649a-be6a-4453-8684-6a0b6b5a8c11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32ac1f61bca04dd4ab5e832a60da01a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:15:56Z,use_quota=True,user_id='0182b394f228459ba0a2c3a899b93ddc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:15:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7e051a06-9363-48a6-94d3-88629786d9cc tempest-VolumeQuotasNegativeTestJSON-596826746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d074b99b-a4ee-472c-aec7-f4bf14b91726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:15:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7e051a06-9363-48a6-94d3-88629786d9cc tempest-VolumeQuotasNegativeTestJSON-596826746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d074b99b-a4ee-472c-aec7-f4bf14b91726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:15:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7e051a06-9363-48a6-94d3-88629786d9cc tempest-VolumeQuotasNegativeTestJSON-596826746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39977cec-bc65-48cf-b23d-d104cdc105af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:15:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7e051a06-9363-48a6-94d3-88629786d9cc tempest-VolumeQuotasNegativeTestJSON-596826746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39977cec-bc65-48cf-b23d-d104cdc105af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5862649a-be6a-4453-8684-6a0b6b5a8c11', 'volume_name': 'volume-5862649a-be6a-4453-8684-6a0b6b5a8c11', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:15:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7e051a06-9363-48a6-94d3-88629786d9cc tempest-VolumeQuotasNegativeTestJSON-596826746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12a30115-1c67-4667-8d5a-c6bc5f208a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:15:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7e051a06-9363-48a6-94d3-88629786d9cc tempest-VolumeQuotasNegativeTestJSON-596826746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12a30115-1c67-4667-8d5a-c6bc5f208a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:15:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7e051a06-9363-48a6-94d3-88629786d9cc tempest-VolumeQuotasNegativeTestJSON-596826746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75aa34a2-e78f-4b8c-b60f-93109a595fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:15:56 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-7e051a06-9363-48a6-94d3-88629786d9cc tempest-VolumeQuotasNegativeTestJSON-596826746 None] Volume 5862649a-be6a-4453-8684-6a0b6b5a8c11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5862649a-be6a-4453-8684-6a0b6b5a8c11', 'volume_size': 1} Nov 04 12:15:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7e051a06-9363-48a6-94d3-88629786d9cc tempest-VolumeQuotasNegativeTestJSON-596826746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:15:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7e051a06-9363-48a6-94d3-88629786d9cc tempest-VolumeQuotasNegativeTestJSON-596826746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:15:56 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7e051a06-9363-48a6-94d3-88629786d9cc tempest-VolumeQuotasNegativeTestJSON-596826746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1573686871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5862649a-be6a-4453-8684-6a0b6b5a8c11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32ac1f61bca04dd4ab5e832a60da01a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:15:56Z,use_quota=True,user_id='0182b394f228459ba0a2c3a899b93ddc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:15:56 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-7e051a06-9363-48a6-94d3-88629786d9cc tempest-VolumeQuotasNegativeTestJSON-596826746 None] Creating volume 5862649a-be6a-4453-8684-6a0b6b5a8c11 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:15:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7e051a06-9363-48a6-94d3-88629786d9cc tempest-VolumeQuotasNegativeTestJSON-596826746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:15:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7e051a06-9363-48a6-94d3-88629786d9cc tempest-VolumeQuotasNegativeTestJSON-596826746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:15:56 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7e051a06-9363-48a6-94d3-88629786d9cc tempest-VolumeQuotasNegativeTestJSON-596826746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:15:56 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7e051a06-9363-48a6-94d3-88629786d9cc tempest-VolumeQuotasNegativeTestJSON-596826746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:15:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7e051a06-9363-48a6-94d3-88629786d9cc tempest-VolumeQuotasNegativeTestJSON-596826746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:15:56 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7e051a06-9363-48a6-94d3-88629786d9cc tempest-VolumeQuotasNegativeTestJSON-596826746 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:15:56 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-7e051a06-9363-48a6-94d3-88629786d9cc tempest-VolumeQuotasNegativeTestJSON-596826746 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:15:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7e051a06-9363-48a6-94d3-88629786d9cc tempest-VolumeQuotasNegativeTestJSON-596826746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-5862649a-be6a-4453-8684-6a0b6b5a8c11 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:15:56 devstack sudo[93718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-5862649a-be6a-4453-8684-6a0b6b5a8c11 1073741824 Nov 04 12:15:56 devstack sudo[93718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:15:56 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-b5558edb-cf2f-4375-a170-92909b3a24c4 req-650cf5ae-9e25-403f-8066-6607d1ca6b72 tempest-ServerActionsTestOtherA-1526177158 None] attachment_update completed successfully. Nov 04 12:15:56 devstack sudo[93718]: pam_unix(sudo:session): session closed for user root Nov 04 12:15:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7e051a06-9363-48a6-94d3-88629786d9cc tempest-VolumeQuotasNegativeTestJSON-596826746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-5862649a-be6a-4453-8684-6a0b6b5a8c11 1073741824" returned: 0 in 0.653s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:15:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7e051a06-9363-48a6-94d3-88629786d9cc tempest-VolumeQuotasNegativeTestJSON-596826746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-5862649a-be6a-4453-8684-6a0b6b5a8c11 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:15:57 devstack sudo[93821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-5862649a-be6a-4453-8684-6a0b6b5a8c11 Nov 04 12:15:57 devstack sudo[93821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:15:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0f90f158-0b97-4507-ad2b-6873316ab597 tempest-VolumeRetypeWithoutMigrationTest-77639893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:15:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0f90f158-0b97-4507-ad2b-6873316ab597 tempest-VolumeRetypeWithoutMigrationTest-77639893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:15:57 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0f90f158-0b97-4507-ad2b-6873316ab597 tempest-VolumeRetypeWithoutMigrationTest-77639893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:15:57 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0f90f158-0b97-4507-ad2b-6873316ab597 tempest-VolumeRetypeWithoutMigrationTest-77639893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:15:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0f90f158-0b97-4507-ad2b-6873316ab597 tempest-VolumeRetypeWithoutMigrationTest-77639893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:15:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0f90f158-0b97-4507-ad2b-6873316ab597 tempest-VolumeRetypeWithoutMigrationTest-77639893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:15:57 devstack sudo[93835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:15:57 devstack sudo[93835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:15:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9afdd09e-a2aa-46a1-99e4-1825d988442c tempest-VolumesActionsTest-77504308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:15:57 devstack sudo[93821]: pam_unix(sudo:session): session closed for user root Nov 04 12:15:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7e051a06-9363-48a6-94d3-88629786d9cc tempest-VolumeQuotasNegativeTestJSON-596826746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-5862649a-be6a-4453-8684-6a0b6b5a8c11" returned: 0 in 0.561s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:15:57 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7e051a06-9363-48a6-94d3-88629786d9cc tempest-VolumeQuotasNegativeTestJSON-596826746 None] <== create_volume: return (1334ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:15:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7e051a06-9363-48a6-94d3-88629786d9cc tempest-VolumeQuotasNegativeTestJSON-596826746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.338s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:15:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9afdd09e-a2aa-46a1-99e4-1825d988442c tempest-VolumesActionsTest-77504308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.033s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:15:57 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f1e24a6-818e-447d-8411-4ebdd4a11259]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:15:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9afdd09e-a2aa-46a1-99e4-1825d988442c tempest-VolumesActionsTest-77504308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-63ea78bf-277d-4ebd-833d-39b9f3f67bd8 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:15:57 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7e051a06-9363-48a6-94d3-88629786d9cc tempest-VolumeQuotasNegativeTestJSON-596826746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75aa34a2-e78f-4b8c-b60f-93109a595fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5862649a-be6a-4453-8684-6a0b6b5a8c11', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:15:57 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7e051a06-9363-48a6-94d3-88629786d9cc tempest-VolumeQuotasNegativeTestJSON-596826746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (537dfc06-aa09-4dce-8b89-b3bc562c708b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:15:57 devstack sudo[93835]: pam_unix(sudo:session): session closed for user root Nov 04 12:15:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0f90f158-0b97-4507-ad2b-6873316ab597 tempest-VolumeRetypeWithoutMigrationTest-77639893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.568s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:15:57 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-0f90f158-0b97-4507-ad2b-6873316ab597 tempest-VolumeRetypeWithoutMigrationTest-77639893 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:15:57 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-0f90f158-0b97-4507-ad2b-6873316ab597 tempest-VolumeRetypeWithoutMigrationTest-77639893 None] Retype volume completed successfully. Nov 04 12:15:57 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-7e051a06-9363-48a6-94d3-88629786d9cc tempest-VolumeQuotasNegativeTestJSON-596826746 None] Volume volume-5862649a-be6a-4453-8684-6a0b6b5a8c11 (5862649a-be6a-4453-8684-6a0b6b5a8c11): created successfully Nov 04 12:15:57 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7e051a06-9363-48a6-94d3-88629786d9cc tempest-VolumeQuotasNegativeTestJSON-596826746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (537dfc06-aa09-4dce-8b89-b3bc562c708b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:15:57 devstack sudo[94164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-63ea78bf-277d-4ebd-833d-39b9f3f67bd8 Nov 04 12:15:57 devstack sudo[94164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:15:57 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7e051a06-9363-48a6-94d3-88629786d9cc tempest-VolumeQuotasNegativeTestJSON-596826746 None] Flow 'volume_create_manager' (06842a8a-41c8-4ad5-868b-e251cf091940) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:15:57 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-7e051a06-9363-48a6-94d3-88629786d9cc tempest-VolumeQuotasNegativeTestJSON-596826746 None] Created volume successfully. Nov 04 12:15:58 devstack sudo[94164]: pam_unix(sudo:session): session closed for user root Nov 04 12:15:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9afdd09e-a2aa-46a1-99e4-1825d988442c tempest-VolumesActionsTest-77504308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-63ea78bf-277d-4ebd-833d-39b9f3f67bd8" returned: 0 in 0.625s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:15:58 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89c90d8-1d89-4f01-babb-2bbadb5e38a5]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:15:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9afdd09e-a2aa-46a1-99e4-1825d988442c tempest-VolumesActionsTest-77504308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-63ea78bf-277d-4ebd-833d-39b9f3f67bd8 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:15:58 devstack sudo[94187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-63ea78bf-277d-4ebd-833d-39b9f3f67bd8 Nov 04 12:15:58 devstack sudo[94187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:15:58 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f63eb708-1b49-44dd-a9ad-b3f6854148a8 tempest-VolumeRetypeWithoutMigrationTest-77639893 None] Acquiring lock "cinder-0ff52e8a-bb46-4312-b469-ff14f0b5a706-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:15:58 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f63eb708-1b49-44dd-a9ad-b3f6854148a8 tempest-VolumeRetypeWithoutMigrationTest-77639893 None] Lock "cinder-0ff52e8a-bb46-4312-b469-ff14f0b5a706-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:15:58 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f63eb708-1b49-44dd-a9ad-b3f6854148a8 tempest-VolumeRetypeWithoutMigrationTest-77639893 None] Acquiring lock "cinder-quobyte-0ff52e8a-bb46-4312-b469-ff14f0b5a706" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:15:58 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f63eb708-1b49-44dd-a9ad-b3f6854148a8 tempest-VolumeRetypeWithoutMigrationTest-77639893 None] Lock "cinder-quobyte-0ff52e8a-bb46-4312-b469-ff14f0b5a706" acquired by "delete_volume" :: waited 0.018s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:15:58 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[91839377-1751-4863-9b36-3c4720b51c04]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:15:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f63eb708-1b49-44dd-a9ad-b3f6854148a8 tempest-VolumeRetypeWithoutMigrationTest-77639893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0ff52e8a-bb46-4312-b469-ff14f0b5a706 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:15:58 devstack sudo[94187]: pam_unix(sudo:session): session closed for user root Nov 04 12:15:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9afdd09e-a2aa-46a1-99e4-1825d988442c tempest-VolumesActionsTest-77504308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-63ea78bf-277d-4ebd-833d-39b9f3f67bd8" returned: 0 in 0.498s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:15:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9afdd09e-a2aa-46a1-99e4-1825d988442c tempest-VolumesActionsTest-77504308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-63ea78bf-277d-4ebd-833d-39b9f3f67bd8 /opt/stack/data/cinder/conversion/63ea78bf-277d-4ebd-833d-39b9f3f67bd8.temp_image.89c727b0-5304-43c7-8556-34e0f8403984_waw5nwy.img {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:15:58 devstack sudo[94193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-63ea78bf-277d-4ebd-833d-39b9f3f67bd8 /opt/stack/data/cinder/conversion/63ea78bf-277d-4ebd-833d-39b9f3f67bd8.temp_image.89c727b0-5304-43c7-8556-34e0f8403984_waw5nwy.img Nov 04 12:15:58 devstack sudo[94193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:15:58 devstack sudo[94192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0ff52e8a-bb46-4312-b469-ff14f0b5a706 Nov 04 12:15:58 devstack sudo[94192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:15:59 devstack sudo[94192]: pam_unix(sudo:session): session closed for user root Nov 04 12:15:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f63eb708-1b49-44dd-a9ad-b3f6854148a8 tempest-VolumeRetypeWithoutMigrationTest-77639893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0ff52e8a-bb46-4312-b469-ff14f0b5a706" returned: 0 in 0.691s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:15:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f63eb708-1b49-44dd-a9ad-b3f6854148a8 tempest-VolumeRetypeWithoutMigrationTest-77639893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0ff52e8a-bb46-4312-b469-ff14f0b5a706 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:15:59 devstack sudo[94211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0ff52e8a-bb46-4312-b469-ff14f0b5a706 Nov 04 12:15:59 devstack sudo[94211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:16:00 devstack sudo[94211]: pam_unix(sudo:session): session closed for user root Nov 04 12:16:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f63eb708-1b49-44dd-a9ad-b3f6854148a8 tempest-VolumeRetypeWithoutMigrationTest-77639893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0ff52e8a-bb46-4312-b469-ff14f0b5a706" returned: 0 in 1.071s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:16:00 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f63eb708-1b49-44dd-a9ad-b3f6854148a8 tempest-VolumeRetypeWithoutMigrationTest-77639893 None] Lock "cinder-quobyte-0ff52e8a-bb46-4312-b469-ff14f0b5a706" released by "delete_volume" :: held 1.850s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:16:00 devstack cinder-volume[87095]: WARNING cinder.quota [None req-f63eb708-1b49-44dd-a9ad-b3f6854148a8 tempest-VolumeRetypeWithoutMigrationTest-77639893 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 04 12:16:00 devstack cinder-volume[87095]: WARNING cinder.quota [None req-f63eb708-1b49-44dd-a9ad-b3f6854148a8 tempest-VolumeRetypeWithoutMigrationTest-77639893 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 04 12:16:00 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-f63eb708-1b49-44dd-a9ad-b3f6854148a8 tempest-VolumeRetypeWithoutMigrationTest-77639893 None] Created reservations ['c2f4892f-b5bf-455b-bded-ed5adacb66cd', '01695ce3-4ccb-4faa-82ef-b97cb41132f7', 'c0e7fdda-a6d5-4658-85c8-a39d56e18f64', '45d4e676-1cb1-48c8-95db-4b3636e7eee0'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:16:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f63eb708-1b49-44dd-a9ad-b3f6854148a8 tempest-VolumeRetypeWithoutMigrationTest-77639893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:16:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f63eb708-1b49-44dd-a9ad-b3f6854148a8 tempest-VolumeRetypeWithoutMigrationTest-77639893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:16:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f63eb708-1b49-44dd-a9ad-b3f6854148a8 tempest-VolumeRetypeWithoutMigrationTest-77639893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:16:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f63eb708-1b49-44dd-a9ad-b3f6854148a8 tempest-VolumeRetypeWithoutMigrationTest-77639893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:16:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f63eb708-1b49-44dd-a9ad-b3f6854148a8 tempest-VolumeRetypeWithoutMigrationTest-77639893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:16:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f63eb708-1b49-44dd-a9ad-b3f6854148a8 tempest-VolumeRetypeWithoutMigrationTest-77639893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:16:01 devstack sudo[94215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:16:01 devstack sudo[94215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:16:01 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 12:16:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:16:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:16:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:16:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:16:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:16:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:16:01 devstack sudo[94218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:16:01 devstack sudo[94218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:16:02 devstack sudo[94215]: pam_unix(sudo:session): session closed for user root Nov 04 12:16:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f63eb708-1b49-44dd-a9ad-b3f6854148a8 tempest-VolumeRetypeWithoutMigrationTest-77639893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.991s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:16:02 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-f63eb708-1b49-44dd-a9ad-b3f6854148a8 tempest-VolumeRetypeWithoutMigrationTest-77639893 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:16:02 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-f63eb708-1b49-44dd-a9ad-b3f6854148a8 tempest-VolumeRetypeWithoutMigrationTest-77639893 None] Deleted volume successfully. Nov 04 12:16:02 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f63eb708-1b49-44dd-a9ad-b3f6854148a8 tempest-VolumeRetypeWithoutMigrationTest-77639893 None] Lock "cinder-0ff52e8a-bb46-4312-b469-ff14f0b5a706-delete_volume" released by "delete_volume" :: held 3.606s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:16:02 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c78861f3-0cb3-4b2a-ada7-e7345ae8c2dc tempest-VolumeQuotasNegativeTestJSON-596826746 None] Acquiring lock "cinder-5862649a-be6a-4453-8684-6a0b6b5a8c11-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:16:02 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c78861f3-0cb3-4b2a-ada7-e7345ae8c2dc tempest-VolumeQuotasNegativeTestJSON-596826746 None] Lock "cinder-5862649a-be6a-4453-8684-6a0b6b5a8c11-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:16:02 devstack sudo[94218]: pam_unix(sudo:session): session closed for user root Nov 04 12:16:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 1.170s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:16:02 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:16:03 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Running periodic task VolumeManager._thread_info {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 12:16:03 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] thread count: 28 {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 12:16:03 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] thread info: [<_MainThread(MainThread, started 140610387472512)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 12:16:03 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c78861f3-0cb3-4b2a-ada7-e7345ae8c2dc tempest-VolumeQuotasNegativeTestJSON-596826746 None] Acquiring lock "cinder-quobyte-5862649a-be6a-4453-8684-6a0b6b5a8c11" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:16:03 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c78861f3-0cb3-4b2a-ada7-e7345ae8c2dc tempest-VolumeQuotasNegativeTestJSON-596826746 None] Lock "cinder-quobyte-5862649a-be6a-4453-8684-6a0b6b5a8c11" acquired by "delete_volume" :: waited 0.051s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:16:03 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9086ccb4-87cf-4cc4-ade9-ac8d76d332aa]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:16:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c78861f3-0cb3-4b2a-ada7-e7345ae8c2dc tempest-VolumeQuotasNegativeTestJSON-596826746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-5862649a-be6a-4453-8684-6a0b6b5a8c11 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:16:04 devstack sudo[94222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-5862649a-be6a-4453-8684-6a0b6b5a8c11 Nov 04 12:16:04 devstack sudo[94222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:16:04 devstack sudo[94222]: pam_unix(sudo:session): session closed for user root Nov 04 12:16:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c78861f3-0cb3-4b2a-ada7-e7345ae8c2dc tempest-VolumeQuotasNegativeTestJSON-596826746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-5862649a-be6a-4453-8684-6a0b6b5a8c11" returned: 0 in 1.026s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:16:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c78861f3-0cb3-4b2a-ada7-e7345ae8c2dc tempest-VolumeQuotasNegativeTestJSON-596826746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-5862649a-be6a-4453-8684-6a0b6b5a8c11 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:16:04 devstack sudo[94228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-5862649a-be6a-4453-8684-6a0b6b5a8c11 Nov 04 12:16:04 devstack sudo[94228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:16:05 devstack sudo[94228]: pam_unix(sudo:session): session closed for user root Nov 04 12:16:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c78861f3-0cb3-4b2a-ada7-e7345ae8c2dc tempest-VolumeQuotasNegativeTestJSON-596826746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-5862649a-be6a-4453-8684-6a0b6b5a8c11" returned: 0 in 0.648s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:16:05 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c78861f3-0cb3-4b2a-ada7-e7345ae8c2dc tempest-VolumeQuotasNegativeTestJSON-596826746 None] Lock "cinder-quobyte-5862649a-be6a-4453-8684-6a0b6b5a8c11" released by "delete_volume" :: held 1.793s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:16:06 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-c78861f3-0cb3-4b2a-ada7-e7345ae8c2dc tempest-VolumeQuotasNegativeTestJSON-596826746 None] Created reservations ['f12f93a3-126f-42bf-9ebd-2183d665e9bb', '15829fcf-e9d4-4c1d-8779-dc8fb58fca77', 'cde6570e-0b4a-4084-b114-c53b7e7d20f2', '6cfd4271-9895-47d5-a488-e26bbba659c9'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:16:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c78861f3-0cb3-4b2a-ada7-e7345ae8c2dc tempest-VolumeQuotasNegativeTestJSON-596826746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:16:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c78861f3-0cb3-4b2a-ada7-e7345ae8c2dc tempest-VolumeQuotasNegativeTestJSON-596826746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:16:06 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c78861f3-0cb3-4b2a-ada7-e7345ae8c2dc tempest-VolumeQuotasNegativeTestJSON-596826746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:16:06 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c78861f3-0cb3-4b2a-ada7-e7345ae8c2dc tempest-VolumeQuotasNegativeTestJSON-596826746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:16:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c78861f3-0cb3-4b2a-ada7-e7345ae8c2dc tempest-VolumeQuotasNegativeTestJSON-596826746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:16:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c78861f3-0cb3-4b2a-ada7-e7345ae8c2dc tempest-VolumeQuotasNegativeTestJSON-596826746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:16:07 devstack sudo[94232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:16:07 devstack sudo[94232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:16:07 devstack sudo[94232]: pam_unix(sudo:session): session closed for user root Nov 04 12:16:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c78861f3-0cb3-4b2a-ada7-e7345ae8c2dc tempest-VolumeQuotasNegativeTestJSON-596826746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.884s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:16:07 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-c78861f3-0cb3-4b2a-ada7-e7345ae8c2dc tempest-VolumeQuotasNegativeTestJSON-596826746 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:16:07 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-c78861f3-0cb3-4b2a-ada7-e7345ae8c2dc tempest-VolumeQuotasNegativeTestJSON-596826746 None] Deleted volume successfully. Nov 04 12:16:07 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c78861f3-0cb3-4b2a-ada7-e7345ae8c2dc tempest-VolumeQuotasNegativeTestJSON-596826746 None] Lock "cinder-5862649a-be6a-4453-8684-6a0b6b5a8c11-delete_volume" released by "delete_volume" :: held 5.422s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:16:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9afdd09e-a2aa-46a1-99e4-1825d988442c tempest-VolumesActionsTest-77504308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-63ea78bf-277d-4ebd-833d-39b9f3f67bd8 /opt/stack/data/cinder/conversion/63ea78bf-277d-4ebd-833d-39b9f3f67bd8.temp_image.89c727b0-5304-43c7-8556-34e0f8403984_waw5nwy.img" returned: 0 in 11.772s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:16:10 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26fd9cc-b211-4f64-ad9e-0266c285abe8]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:16:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9afdd09e-a2aa-46a1-99e4-1825d988442c tempest-VolumesActionsTest-77504308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-63ea78bf-277d-4ebd-833d-39b9f3f67bd8 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:16:10 devstack sudo[94235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-63ea78bf-277d-4ebd-833d-39b9f3f67bd8 Nov 04 12:16:10 devstack sudo[94235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:16:11 devstack sudo[94235]: pam_unix(sudo:session): session closed for user root Nov 04 12:16:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9afdd09e-a2aa-46a1-99e4-1825d988442c tempest-VolumesActionsTest-77504308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-63ea78bf-277d-4ebd-833d-39b9f3f67bd8" returned: 0 in 0.750s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:16:11 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-9afdd09e-a2aa-46a1-99e4-1825d988442c tempest-VolumesActionsTest-77504308 None] Image conversion details: src /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-63ea78bf-277d-4ebd-833d-39b9f3f67bd8, size 1024.00 MB, duration 11.78 sec, destination /opt/stack/data/cinder/conversion/63ea78bf-277d-4ebd-833d-39b9f3f67bd8.temp_image.89c727b0-5304-43c7-8556-34e0f8403984_waw5nwy.img {{(pid=87095) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 12:16:11 devstack cinder-volume[87095]: INFO cinder.image.image_utils [None req-9afdd09e-a2aa-46a1-99e4-1825d988442c tempest-VolumesActionsTest-77504308 None] Converted 1024.00 MB image at 86.94 MB/s Nov 04 12:16:11 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-9afdd09e-a2aa-46a1-99e4-1825d988442c tempest-VolumesActionsTest-77504308 None] 89c727b0-5304-43c7-8556-34e0f8403984 was raw, converting to qcow2 {{(pid=87095) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Nov 04 12:16:11 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab1b8179-93f8-4bbb-a914-130e85d8836f]: (4, 'raw') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:16:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9afdd09e-a2aa-46a1-99e4-1825d988442c tempest-VolumesActionsTest-77504308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/63ea78bf-277d-4ebd-833d-39b9f3f67bd8.temp_image.89c727b0-5304-43c7-8556-34e0f8403984_waw5nwy.img {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:16:11 devstack sudo[94243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/63ea78bf-277d-4ebd-833d-39b9f3f67bd8.temp_image.89c727b0-5304-43c7-8556-34e0f8403984_waw5nwy.img Nov 04 12:16:11 devstack sudo[94243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:16:11 devstack sudo[94243]: pam_unix(sudo:session): session closed for user root Nov 04 12:16:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9afdd09e-a2aa-46a1-99e4-1825d988442c tempest-VolumesActionsTest-77504308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/63ea78bf-277d-4ebd-833d-39b9f3f67bd8.temp_image.89c727b0-5304-43c7-8556-34e0f8403984_waw5nwy.img" returned: 0 in 0.421s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:16:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9afdd09e-a2aa-46a1-99e4-1825d988442c tempest-VolumesActionsTest-77504308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/63ea78bf-277d-4ebd-833d-39b9f3f67bd8.temp_image.89c727b0-5304-43c7-8556-34e0f8403984_waw5nwy.img {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:16:12 devstack sudo[94247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/63ea78bf-277d-4ebd-833d-39b9f3f67bd8.temp_image.89c727b0-5304-43c7-8556-34e0f8403984_waw5nwy.img Nov 04 12:16:12 devstack sudo[94247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:16:12 devstack sudo[94247]: pam_unix(sudo:session): session closed for user root Nov 04 12:16:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9afdd09e-a2aa-46a1-99e4-1825d988442c tempest-VolumesActionsTest-77504308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/63ea78bf-277d-4ebd-833d-39b9f3f67bd8.temp_image.89c727b0-5304-43c7-8556-34e0f8403984_waw5nwy.img" returned: 1 in 0.520s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:16:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9afdd09e-a2aa-46a1-99e4-1825d988442c tempest-VolumesActionsTest-77504308 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/63ea78bf-277d-4ebd-833d-39b9f3f67bd8.temp_image.89c727b0-5304-43c7-8556-34e0f8403984_waw5nwy.img' failed. Not Retrying. {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 12:16:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9afdd09e-a2aa-46a1-99e4-1825d988442c tempest-VolumesActionsTest-77504308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/63ea78bf-277d-4ebd-833d-39b9f3f67bd8.temp_image.89c727b0-5304-43c7-8556-34e0f8403984_waw5nwy.img /opt/stack/data/cinder/conversion/vol_upload_m19u4wz9 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:16:12 devstack sudo[94252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/63ea78bf-277d-4ebd-833d-39b9f3f67bd8.temp_image.89c727b0-5304-43c7-8556-34e0f8403984_waw5nwy.img /opt/stack/data/cinder/conversion/vol_upload_m19u4wz9 Nov 04 12:16:12 devstack sudo[94252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:16:12 devstack sudo[94252]: pam_unix(sudo:session): session closed for user root Nov 04 12:16:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9afdd09e-a2aa-46a1-99e4-1825d988442c tempest-VolumesActionsTest-77504308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/63ea78bf-277d-4ebd-833d-39b9f3f67bd8.temp_image.89c727b0-5304-43c7-8556-34e0f8403984_waw5nwy.img /opt/stack/data/cinder/conversion/vol_upload_m19u4wz9" returned: 0 in 0.334s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:16:12 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-9afdd09e-a2aa-46a1-99e4-1825d988442c tempest-VolumesActionsTest-77504308 None] Image conversion details: src /opt/stack/data/cinder/conversion/63ea78bf-277d-4ebd-833d-39b9f3f67bd8.temp_image.89c727b0-5304-43c7-8556-34e0f8403984_waw5nwy.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_m19u4wz9 {{(pid=87095) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 12:16:12 devstack cinder-volume[87095]: INFO cinder.image.image_utils [None req-9afdd09e-a2aa-46a1-99e4-1825d988442c tempest-VolumesActionsTest-77504308 None] Converted 1024.00 MB image at 1024.00 MB/s Nov 04 12:16:12 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[102cdf32-77be-41ca-8d78-d47b8fff39da]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:16:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9afdd09e-a2aa-46a1-99e4-1825d988442c tempest-VolumesActionsTest-77504308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_m19u4wz9 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:16:12 devstack sudo[94259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_m19u4wz9 Nov 04 12:16:12 devstack sudo[94259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:16:13 devstack sudo[94259]: pam_unix(sudo:session): session closed for user root Nov 04 12:16:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9afdd09e-a2aa-46a1-99e4-1825d988442c tempest-VolumesActionsTest-77504308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_m19u4wz9" returned: 0 in 0.554s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:16:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9afdd09e-a2aa-46a1-99e4-1825d988442c tempest-VolumesActionsTest-77504308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 17.805s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:16:15 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9afdd09e-a2aa-46a1-99e4-1825d988442c tempest-VolumesActionsTest-77504308 None] Uploaded volume to glance image-id: 89c727b0-5304-43c7-8556-34e0f8403984. {{(pid=87095) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 04 12:16:15 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-9afdd09e-a2aa-46a1-99e4-1825d988442c tempest-VolumesActionsTest-77504308 None] Copy volume to image completed successfully. Nov 04 12:16:17 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6c3d7414-45ca-4191-bea8-6200b2be0c62 tempest-VolumesActionsTest-77504308 None] Acquiring lock "cinder-63ea78bf-277d-4ebd-833d-39b9f3f67bd8-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:16:17 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6c3d7414-45ca-4191-bea8-6200b2be0c62 tempest-VolumesActionsTest-77504308 None] Lock "cinder-63ea78bf-277d-4ebd-833d-39b9f3f67bd8-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:16:17 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6c3d7414-45ca-4191-bea8-6200b2be0c62 tempest-VolumesActionsTest-77504308 None] Acquiring lock "cinder-quobyte-63ea78bf-277d-4ebd-833d-39b9f3f67bd8" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:16:17 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6c3d7414-45ca-4191-bea8-6200b2be0c62 tempest-VolumesActionsTest-77504308 None] Lock "cinder-quobyte-63ea78bf-277d-4ebd-833d-39b9f3f67bd8" acquired by "delete_volume" :: waited 0.025s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:16:17 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6abb996-0265-4380-846c-2defc1bb60bd]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:16:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6c3d7414-45ca-4191-bea8-6200b2be0c62 tempest-VolumesActionsTest-77504308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-63ea78bf-277d-4ebd-833d-39b9f3f67bd8 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:16:17 devstack sudo[94290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-63ea78bf-277d-4ebd-833d-39b9f3f67bd8 Nov 04 12:16:17 devstack sudo[94290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:16:17 devstack sudo[94290]: pam_unix(sudo:session): session closed for user root Nov 04 12:16:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6c3d7414-45ca-4191-bea8-6200b2be0c62 tempest-VolumesActionsTest-77504308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-63ea78bf-277d-4ebd-833d-39b9f3f67bd8" returned: 0 in 0.546s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:16:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6c3d7414-45ca-4191-bea8-6200b2be0c62 tempest-VolumesActionsTest-77504308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-63ea78bf-277d-4ebd-833d-39b9f3f67bd8 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:16:17 devstack sudo[94295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-63ea78bf-277d-4ebd-833d-39b9f3f67bd8 Nov 04 12:16:17 devstack sudo[94295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:16:18 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d3c6708-13e0-46c6-a28a-25934d271bf4 tempest-VolumesServicesTestJSON-1377113646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:16:18 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4d3c6708-13e0-46c6-a28a-25934d271bf4 tempest-VolumesServicesTestJSON-1377113646 None] Flow 'volume_create_manager' (5d6cf05c-0aca-4b9f-871f-9766481be371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:16:18 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4d3c6708-13e0-46c6-a28a-25934d271bf4 tempest-VolumesServicesTestJSON-1377113646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69372d8e-726c-430e-9471-08218cf8becd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:16:18 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4d3c6708-13e0-46c6-a28a-25934d271bf4 tempest-VolumesServicesTestJSON-1377113646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69372d8e-726c-430e-9471-08218cf8becd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1591400171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d96d942d-933e-49b7-865c-96a073f35ad9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='287b5a3800b644c694a0d1c4276f0b2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:16:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:16:18Z,use_quota=True,user_id='0ca7b7affca444f8b0bddd5be3fb0553',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:16:18 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4d3c6708-13e0-46c6-a28a-25934d271bf4 tempest-VolumesServicesTestJSON-1377113646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eca28a4-fe8c-4642-bdb5-b5a99351e36b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:16:18 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4d3c6708-13e0-46c6-a28a-25934d271bf4 tempest-VolumesServicesTestJSON-1377113646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eca28a4-fe8c-4642-bdb5-b5a99351e36b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:16:18 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4d3c6708-13e0-46c6-a28a-25934d271bf4 tempest-VolumesServicesTestJSON-1377113646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cb0d193-46c6-4037-b94f-973456d405fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:16:18 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4d3c6708-13e0-46c6-a28a-25934d271bf4 tempest-VolumesServicesTestJSON-1377113646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cb0d193-46c6-4037-b94f-973456d405fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd96d942d-933e-49b7-865c-96a073f35ad9', 'volume_name': 'volume-d96d942d-933e-49b7-865c-96a073f35ad9', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:16:18 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4d3c6708-13e0-46c6-a28a-25934d271bf4 tempest-VolumesServicesTestJSON-1377113646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (775f67dc-1a9b-493a-b788-ba5e4ad6e711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:16:18 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4d3c6708-13e0-46c6-a28a-25934d271bf4 tempest-VolumesServicesTestJSON-1377113646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (775f67dc-1a9b-493a-b788-ba5e4ad6e711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:16:18 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4d3c6708-13e0-46c6-a28a-25934d271bf4 tempest-VolumesServicesTestJSON-1377113646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c2fe39d-9588-4b99-a720-f7370348975f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:16:18 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-4d3c6708-13e0-46c6-a28a-25934d271bf4 tempest-VolumesServicesTestJSON-1377113646 None] Volume d96d942d-933e-49b7-865c-96a073f35ad9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d96d942d-933e-49b7-865c-96a073f35ad9', 'volume_size': 1} Nov 04 12:16:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4d3c6708-13e0-46c6-a28a-25934d271bf4 tempest-VolumesServicesTestJSON-1377113646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:16:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4d3c6708-13e0-46c6-a28a-25934d271bf4 tempest-VolumesServicesTestJSON-1377113646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:16:18 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4d3c6708-13e0-46c6-a28a-25934d271bf4 tempest-VolumesServicesTestJSON-1377113646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1591400171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d96d942d-933e-49b7-865c-96a073f35ad9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='287b5a3800b644c694a0d1c4276f0b2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:16:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:16:18Z,use_quota=True,user_id='0ca7b7affca444f8b0bddd5be3fb0553',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:16:18 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-4d3c6708-13e0-46c6-a28a-25934d271bf4 tempest-VolumesServicesTestJSON-1377113646 None] Creating volume d96d942d-933e-49b7-865c-96a073f35ad9 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:16:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4d3c6708-13e0-46c6-a28a-25934d271bf4 tempest-VolumesServicesTestJSON-1377113646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:16:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4d3c6708-13e0-46c6-a28a-25934d271bf4 tempest-VolumesServicesTestJSON-1377113646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:16:18 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4d3c6708-13e0-46c6-a28a-25934d271bf4 tempest-VolumesServicesTestJSON-1377113646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:16:18 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4d3c6708-13e0-46c6-a28a-25934d271bf4 tempest-VolumesServicesTestJSON-1377113646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:16:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4d3c6708-13e0-46c6-a28a-25934d271bf4 tempest-VolumesServicesTestJSON-1377113646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:16:18 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4d3c6708-13e0-46c6-a28a-25934d271bf4 tempest-VolumesServicesTestJSON-1377113646 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:16:18 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-4d3c6708-13e0-46c6-a28a-25934d271bf4 tempest-VolumesServicesTestJSON-1377113646 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:16:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4d3c6708-13e0-46c6-a28a-25934d271bf4 tempest-VolumesServicesTestJSON-1377113646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d96d942d-933e-49b7-865c-96a073f35ad9 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:16:18 devstack sudo[94295]: pam_unix(sudo:session): session closed for user root Nov 04 12:16:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6c3d7414-45ca-4191-bea8-6200b2be0c62 tempest-VolumesActionsTest-77504308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-63ea78bf-277d-4ebd-833d-39b9f3f67bd8" returned: 0 in 0.398s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:16:18 devstack sudo[94298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d96d942d-933e-49b7-865c-96a073f35ad9 1073741824 Nov 04 12:16:18 devstack sudo[94298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:16:18 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6c3d7414-45ca-4191-bea8-6200b2be0c62 tempest-VolumesActionsTest-77504308 None] Lock "cinder-quobyte-63ea78bf-277d-4ebd-833d-39b9f3f67bd8" released by "delete_volume" :: held 1.013s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:16:18 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-6c3d7414-45ca-4191-bea8-6200b2be0c62 tempest-VolumesActionsTest-77504308 None] Created reservations ['30cb762c-195e-4008-8d25-f6d1ad46860a', 'ce2dc360-389d-429a-ad62-b98bda6b8ddc', '1064be3e-d7ed-4a8c-afb9-2890248e6d2d', '30429f88-c9be-4d25-8dae-66e042c78e71'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:16:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6c3d7414-45ca-4191-bea8-6200b2be0c62 tempest-VolumesActionsTest-77504308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:16:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6c3d7414-45ca-4191-bea8-6200b2be0c62 tempest-VolumesActionsTest-77504308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:16:18 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6c3d7414-45ca-4191-bea8-6200b2be0c62 tempest-VolumesActionsTest-77504308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:16:18 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6c3d7414-45ca-4191-bea8-6200b2be0c62 tempest-VolumesActionsTest-77504308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:16:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6c3d7414-45ca-4191-bea8-6200b2be0c62 tempest-VolumesActionsTest-77504308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:16:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6c3d7414-45ca-4191-bea8-6200b2be0c62 tempest-VolumesActionsTest-77504308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:16:18 devstack sudo[94303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:16:18 devstack sudo[94303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:16:18 devstack sudo[94303]: pam_unix(sudo:session): session closed for user root Nov 04 12:16:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6c3d7414-45ca-4191-bea8-6200b2be0c62 tempest-VolumesActionsTest-77504308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.499s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:16:18 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-6c3d7414-45ca-4191-bea8-6200b2be0c62 tempest-VolumesActionsTest-77504308 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:16:18 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-6c3d7414-45ca-4191-bea8-6200b2be0c62 tempest-VolumesActionsTest-77504308 None] Deleted volume successfully. Nov 04 12:16:18 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6c3d7414-45ca-4191-bea8-6200b2be0c62 tempest-VolumesActionsTest-77504308 None] Lock "cinder-63ea78bf-277d-4ebd-833d-39b9f3f67bd8-delete_volume" released by "delete_volume" :: held 1.818s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:16:18 devstack sudo[94298]: pam_unix(sudo:session): session closed for user root Nov 04 12:16:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4d3c6708-13e0-46c6-a28a-25934d271bf4 tempest-VolumesServicesTestJSON-1377113646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d96d942d-933e-49b7-865c-96a073f35ad9 1073741824" returned: 0 in 0.805s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:16:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4d3c6708-13e0-46c6-a28a-25934d271bf4 tempest-VolumesServicesTestJSON-1377113646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d96d942d-933e-49b7-865c-96a073f35ad9 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:16:19 devstack sudo[94393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d96d942d-933e-49b7-865c-96a073f35ad9 Nov 04 12:16:19 devstack sudo[94393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:16:19 devstack sudo[94393]: pam_unix(sudo:session): session closed for user root Nov 04 12:16:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4d3c6708-13e0-46c6-a28a-25934d271bf4 tempest-VolumesServicesTestJSON-1377113646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d96d942d-933e-49b7-865c-96a073f35ad9" returned: 0 in 0.365s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:16:19 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4d3c6708-13e0-46c6-a28a-25934d271bf4 tempest-VolumesServicesTestJSON-1377113646 None] <== create_volume: return (1228ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:16:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4d3c6708-13e0-46c6-a28a-25934d271bf4 tempest-VolumesServicesTestJSON-1377113646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.231s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:16:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4d3c6708-13e0-46c6-a28a-25934d271bf4 tempest-VolumesServicesTestJSON-1377113646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c2fe39d-9588-4b99-a720-f7370348975f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d96d942d-933e-49b7-865c-96a073f35ad9', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:16:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4d3c6708-13e0-46c6-a28a-25934d271bf4 tempest-VolumesServicesTestJSON-1377113646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dbfac7e-4240-4e0b-b46b-05111f309a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:16:19 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-4d3c6708-13e0-46c6-a28a-25934d271bf4 tempest-VolumesServicesTestJSON-1377113646 None] Volume volume-d96d942d-933e-49b7-865c-96a073f35ad9 (d96d942d-933e-49b7-865c-96a073f35ad9): created successfully Nov 04 12:16:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4d3c6708-13e0-46c6-a28a-25934d271bf4 tempest-VolumesServicesTestJSON-1377113646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dbfac7e-4240-4e0b-b46b-05111f309a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:16:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4d3c6708-13e0-46c6-a28a-25934d271bf4 tempest-VolumesServicesTestJSON-1377113646 None] Flow 'volume_create_manager' (5d6cf05c-0aca-4b9f-871f-9766481be371) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:16:19 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-4d3c6708-13e0-46c6-a28a-25934d271bf4 tempest-VolumesServicesTestJSON-1377113646 None] Created volume successfully. Nov 04 12:16:20 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6b9910b1-4e90-48a4-b06d-029fe5555305 tempest-VolumesServicesTestJSON-1377113646 None] Acquiring lock "cinder-d96d942d-933e-49b7-865c-96a073f35ad9-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:16:20 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6b9910b1-4e90-48a4-b06d-029fe5555305 tempest-VolumesServicesTestJSON-1377113646 None] Lock "cinder-d96d942d-933e-49b7-865c-96a073f35ad9-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:16:20 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6b9910b1-4e90-48a4-b06d-029fe5555305 tempest-VolumesServicesTestJSON-1377113646 None] Acquiring lock "cinder-quobyte-d96d942d-933e-49b7-865c-96a073f35ad9" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:16:20 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6b9910b1-4e90-48a4-b06d-029fe5555305 tempest-VolumesServicesTestJSON-1377113646 None] Lock "cinder-quobyte-d96d942d-933e-49b7-865c-96a073f35ad9" acquired by "delete_volume" :: waited 0.027s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:16:20 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d67f9be-b16e-4b17-ad5b-76763c1a05bc]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:16:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6b9910b1-4e90-48a4-b06d-029fe5555305 tempest-VolumesServicesTestJSON-1377113646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d96d942d-933e-49b7-865c-96a073f35ad9 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:16:20 devstack sudo[94399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d96d942d-933e-49b7-865c-96a073f35ad9 Nov 04 12:16:20 devstack sudo[94399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:16:21 devstack sudo[94399]: pam_unix(sudo:session): session closed for user root Nov 04 12:16:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6b9910b1-4e90-48a4-b06d-029fe5555305 tempest-VolumesServicesTestJSON-1377113646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d96d942d-933e-49b7-865c-96a073f35ad9" returned: 0 in 0.495s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:16:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6b9910b1-4e90-48a4-b06d-029fe5555305 tempest-VolumesServicesTestJSON-1377113646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d96d942d-933e-49b7-865c-96a073f35ad9 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:16:21 devstack sudo[94405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d96d942d-933e-49b7-865c-96a073f35ad9 Nov 04 12:16:21 devstack sudo[94405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:16:21 devstack sudo[94405]: pam_unix(sudo:session): session closed for user root Nov 04 12:16:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6b9910b1-4e90-48a4-b06d-029fe5555305 tempest-VolumesServicesTestJSON-1377113646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d96d942d-933e-49b7-865c-96a073f35ad9" returned: 0 in 0.275s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:16:21 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6b9910b1-4e90-48a4-b06d-029fe5555305 tempest-VolumesServicesTestJSON-1377113646 None] Lock "cinder-quobyte-d96d942d-933e-49b7-865c-96a073f35ad9" released by "delete_volume" :: held 0.817s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:16:21 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-6b9910b1-4e90-48a4-b06d-029fe5555305 tempest-VolumesServicesTestJSON-1377113646 None] Created reservations ['994c39b3-d8fb-48df-827f-e26cb3233299', '8e46ff73-5da3-4ac8-b808-28cfa4cb92fa', 'a93fef76-4c17-428b-8208-9adcaf7336b7', 'f06ed63a-9a93-436f-a70b-d5f72e216dcd'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:16:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6b9910b1-4e90-48a4-b06d-029fe5555305 tempest-VolumesServicesTestJSON-1377113646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:16:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6b9910b1-4e90-48a4-b06d-029fe5555305 tempest-VolumesServicesTestJSON-1377113646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:16:21 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6b9910b1-4e90-48a4-b06d-029fe5555305 tempest-VolumesServicesTestJSON-1377113646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:16:21 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6b9910b1-4e90-48a4-b06d-029fe5555305 tempest-VolumesServicesTestJSON-1377113646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:16:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6b9910b1-4e90-48a4-b06d-029fe5555305 tempest-VolumesServicesTestJSON-1377113646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:16:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6b9910b1-4e90-48a4-b06d-029fe5555305 tempest-VolumesServicesTestJSON-1377113646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:16:21 devstack sudo[94408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:16:21 devstack sudo[94408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:16:21 devstack sudo[94408]: pam_unix(sudo:session): session closed for user root Nov 04 12:16:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6b9910b1-4e90-48a4-b06d-029fe5555305 tempest-VolumesServicesTestJSON-1377113646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.317s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:16:21 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-6b9910b1-4e90-48a4-b06d-029fe5555305 tempest-VolumesServicesTestJSON-1377113646 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:16:21 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-6b9910b1-4e90-48a4-b06d-029fe5555305 tempest-VolumesServicesTestJSON-1377113646 None] Deleted volume successfully. Nov 04 12:16:21 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6b9910b1-4e90-48a4-b06d-029fe5555305 tempest-VolumesServicesTestJSON-1377113646 None] Lock "cinder-d96d942d-933e-49b7-865c-96a073f35ad9-delete_volume" released by "delete_volume" :: held 1.398s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:16:29 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0a739ca-2414-49f8-b7c7-87918581bef6 tempest-VolumesImageMetadata-1791814533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:16:29 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a0a739ca-2414-49f8-b7c7-87918581bef6 tempest-VolumesImageMetadata-1791814533 None] Flow 'volume_create_manager' (8aeb35a2-72e4-4115-98f4-f46bc346c1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:16:29 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a0a739ca-2414-49f8-b7c7-87918581bef6 tempest-VolumesImageMetadata-1791814533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13f405a2-dd17-4509-b512-2d4ec6a6592a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:16:29 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a0a739ca-2414-49f8-b7c7-87918581bef6 tempest-VolumesImageMetadata-1791814533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13f405a2-dd17-4509-b512-2d4ec6a6592a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:16:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-860842398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ff408a5-4d1e-40fe-9c85-2fbc3ec03a90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17c2bb4b98b34f98be89dc0245c0f458',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:16:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:16:30Z,use_quota=True,user_id='d0ed489bf5da476a8564690142bf6caa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:16:29 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a0a739ca-2414-49f8-b7c7-87918581bef6 tempest-VolumesImageMetadata-1791814533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6464d28f-50cb-4568-91c7-3ecc8fc982e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:16:29 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a0a739ca-2414-49f8-b7c7-87918581bef6 tempest-VolumesImageMetadata-1791814533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6464d28f-50cb-4568-91c7-3ecc8fc982e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:16:29 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a0a739ca-2414-49f8-b7c7-87918581bef6 tempest-VolumesImageMetadata-1791814533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (664a7c14-d3c7-4aaf-be38-5f5d6e27a380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:16:29 devstack cinder-volume[87095]: DEBUG cinder.image.glance [None req-a0a739ca-2414-49f8-b7c7-87918581bef6 tempest-VolumesImageMetadata-1791814533 None] Creating Keystone auth plugin from conf {{(pid=87095) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 04 12:16:30 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a0a739ca-2414-49f8-b7c7-87918581bef6 tempest-VolumesImageMetadata-1791814533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (664a7c14-d3c7-4aaf-be38-5f5d6e27a380) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9ff408a5-4d1e-40fe-9c85-2fbc3ec03a90', 'volume_name': 'volume-9ff408a5-4d1e-40fe-9c85-2fbc3ec03a90', 'volume_size': 1, 'image_id': 'b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '021c36f8b23249aabf2d5e363bccb8bc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af', 'created_at': datetime.datetime(2026, 11, 4, 11, 4, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 11, 4, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:16:30 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a0a739ca-2414-49f8-b7c7-87918581bef6 tempest-VolumesImageMetadata-1791814533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab0e2215-8568-42af-a956-e0f6f7e9a095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:16:30 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a0a739ca-2414-49f8-b7c7-87918581bef6 tempest-VolumesImageMetadata-1791814533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab0e2215-8568-42af-a956-e0f6f7e9a095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:16:30 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a0a739ca-2414-49f8-b7c7-87918581bef6 tempest-VolumesImageMetadata-1791814533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1a0f08c-6b1c-4b2a-a97e-fad3c2343951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:16:30 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-a0a739ca-2414-49f8-b7c7-87918581bef6 tempest-VolumesImageMetadata-1791814533 None] Volume 9ff408a5-4d1e-40fe-9c85-2fbc3ec03a90: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9ff408a5-4d1e-40fe-9c85-2fbc3ec03a90', 'volume_size': 1, 'image_id': 'b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '021c36f8b23249aabf2d5e363bccb8bc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af', 'created_at': datetime.datetime(2026, 11, 4, 11, 4, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 11, 4, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 04 12:16:30 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0a739ca-2414-49f8-b7c7-87918581bef6 tempest-VolumesImageMetadata-1791814533 None] Trying to clone 9ff408a5-4d1e-40fe-9c85-2fbc3ec03a90 from image b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af at location (None, [{'url': 'file:///opt/stack/data/glance/images/b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af', 'metadata': {}}]). {{(pid=87095) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 04 12:16:30 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-850f7321-6464-4fa1-be25-610670eed9e8 tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:16:30 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-850f7321-6464-4fa1-be25-610670eed9e8 tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] Flow 'volume_create_manager' (e3fd3175-5ec4-4a00-b8ed-5624722ce7bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:16:30 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-850f7321-6464-4fa1-be25-610670eed9e8 tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9113125-fa21-423f-aa33-b36bfb549630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:16:30 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-850f7321-6464-4fa1-be25-610670eed9e8 tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9113125-fa21-423f-aa33-b36bfb549630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:16:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1260357166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a016f94-3371-461b-91e3-b23ffd1ccaae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2fee668415a4abebe3e03a155d94324',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:16:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:16:31Z,use_quota=True,user_id='17c65a3fd1f04ec697d5fd94f67eb521',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:16:30 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-850f7321-6464-4fa1-be25-610670eed9e8 tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fb53fa5-1571-40a6-b7ab-9b91389ae440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:16:30 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-850f7321-6464-4fa1-be25-610670eed9e8 tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fb53fa5-1571-40a6-b7ab-9b91389ae440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:16:30 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-850f7321-6464-4fa1-be25-610670eed9e8 tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f3d0c9e-ae41-4a83-a21b-07569f6111ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:16:30 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-850f7321-6464-4fa1-be25-610670eed9e8 tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f3d0c9e-ae41-4a83-a21b-07569f6111ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a016f94-3371-461b-91e3-b23ffd1ccaae', 'volume_name': 'volume-8a016f94-3371-461b-91e3-b23ffd1ccaae', 'volume_size': 2}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:16:30 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-850f7321-6464-4fa1-be25-610670eed9e8 tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b7d53c5-59bc-41b1-ac95-c1922cd7ee45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:16:30 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-850f7321-6464-4fa1-be25-610670eed9e8 tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b7d53c5-59bc-41b1-ac95-c1922cd7ee45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:16:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-850f7321-6464-4fa1-be25-610670eed9e8 tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30d15a16-a54c-45d3-955d-6b7a8d78ddd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:16:31 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-850f7321-6464-4fa1-be25-610670eed9e8 tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] Volume 8a016f94-3371-461b-91e3-b23ffd1ccaae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a016f94-3371-461b-91e3-b23ffd1ccaae', 'volume_size': 2} Nov 04 12:16:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-850f7321-6464-4fa1-be25-610670eed9e8 tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:16:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-850f7321-6464-4fa1-be25-610670eed9e8 tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:16:31 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-850f7321-6464-4fa1-be25-610670eed9e8 tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:16:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1260357166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a016f94-3371-461b-91e3-b23ffd1ccaae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2fee668415a4abebe3e03a155d94324',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:16:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:16:31Z,use_quota=True,user_id='17c65a3fd1f04ec697d5fd94f67eb521',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:16:31 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-850f7321-6464-4fa1-be25-610670eed9e8 tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] Creating volume 8a016f94-3371-461b-91e3-b23ffd1ccaae {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:16:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-850f7321-6464-4fa1-be25-610670eed9e8 tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:16:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-850f7321-6464-4fa1-be25-610670eed9e8 tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:16:31 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-850f7321-6464-4fa1-be25-610670eed9e8 tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:16:31 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-850f7321-6464-4fa1-be25-610670eed9e8 tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:16:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-850f7321-6464-4fa1-be25-610670eed9e8 tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:16:31 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-850f7321-6464-4fa1-be25-610670eed9e8 tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:16:31 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-850f7321-6464-4fa1-be25-610670eed9e8 tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:16:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-850f7321-6464-4fa1-be25-610670eed9e8 tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8a016f94-3371-461b-91e3-b23ffd1ccaae 2147483648 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:16:31 devstack sudo[94430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8a016f94-3371-461b-91e3-b23ffd1ccaae 2147483648 Nov 04 12:16:31 devstack sudo[94430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:16:31 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-a0a739ca-2414-49f8-b7c7-87918581bef6 tempest-VolumesImageMetadata-1791814533 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_nlo_3ooqdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87095) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 04 12:16:31 devstack cinder-volume[87095]: INFO cinder.image.image_utils [None req-a0a739ca-2414-49f8-b7c7-87918581bef6 tempest-VolumesImageMetadata-1791814533 None] Image download 20.69 MB at 20.69 MB/s Nov 04 12:16:31 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5182870-f031-440f-a144-116868c77f11]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:16:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a0a739ca-2414-49f8-b7c7-87918581bef6 tempest-VolumesImageMetadata-1791814533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_nlo_3ooqdevstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:16:31 devstack sudo[94433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_nlo_3ooqdevstack@QuobyteHD Nov 04 12:16:31 devstack sudo[94433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:16:31 devstack sudo[94433]: pam_unix(sudo:session): session closed for user root Nov 04 12:16:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a0a739ca-2414-49f8-b7c7-87918581bef6 tempest-VolumesImageMetadata-1791814533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_nlo_3ooqdevstack@QuobyteHD" returned: 0 in 0.516s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:16:31 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-a0a739ca-2414-49f8-b7c7-87918581bef6 tempest-VolumesImageMetadata-1791814533 None] Temporary image b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af is fetched for user d0ed489bf5da476a8564690142bf6caa. {{(pid=87095) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 04 12:16:31 devstack sudo[94430]: pam_unix(sudo:session): session closed for user root Nov 04 12:16:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-850f7321-6464-4fa1-be25-610670eed9e8 tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8a016f94-3371-461b-91e3-b23ffd1ccaae 2147483648" returned: 0 in 0.785s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:16:31 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2cdd9a6-b93f-46d3-9cda-7779be80eb19]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:16:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a0a739ca-2414-49f8-b7c7-87918581bef6 tempest-VolumesImageMetadata-1791814533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_nlo_3ooqdevstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:16:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-850f7321-6464-4fa1-be25-610670eed9e8 tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8a016f94-3371-461b-91e3-b23ffd1ccaae {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:16:31 devstack sudo[94448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8a016f94-3371-461b-91e3-b23ffd1ccaae Nov 04 12:16:31 devstack sudo[94448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:16:32 devstack sudo[94447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_nlo_3ooqdevstack@QuobyteHD Nov 04 12:16:32 devstack sudo[94447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:16:32 devstack sudo[94448]: pam_unix(sudo:session): session closed for user root Nov 04 12:16:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-850f7321-6464-4fa1-be25-610670eed9e8 tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8a016f94-3371-461b-91e3-b23ffd1ccaae" returned: 0 in 0.509s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:16:32 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-850f7321-6464-4fa1-be25-610670eed9e8 tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] <== create_volume: return (1370ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:16:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-850f7321-6464-4fa1-be25-610670eed9e8 tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.373s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:16:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-850f7321-6464-4fa1-be25-610670eed9e8 tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30d15a16-a54c-45d3-955d-6b7a8d78ddd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a016f94-3371-461b-91e3-b23ffd1ccaae', 'volume_size': 2}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:16:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-850f7321-6464-4fa1-be25-610670eed9e8 tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b047de8c-9e34-408a-93a0-b64b89bb48c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:16:32 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-850f7321-6464-4fa1-be25-610670eed9e8 tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] Volume volume-8a016f94-3371-461b-91e3-b23ffd1ccaae (8a016f94-3371-461b-91e3-b23ffd1ccaae): created successfully Nov 04 12:16:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-850f7321-6464-4fa1-be25-610670eed9e8 tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b047de8c-9e34-408a-93a0-b64b89bb48c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:16:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-850f7321-6464-4fa1-be25-610670eed9e8 tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] Flow 'volume_create_manager' (e3fd3175-5ec4-4a00-b8ed-5624722ce7bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:16:32 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-850f7321-6464-4fa1-be25-610670eed9e8 tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] Created volume successfully. Nov 04 12:16:32 devstack sudo[94447]: pam_unix(sudo:session): session closed for user root Nov 04 12:16:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a0a739ca-2414-49f8-b7c7-87918581bef6 tempest-VolumesImageMetadata-1791814533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_nlo_3ooqdevstack@QuobyteHD" returned: 0 in 0.741s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:16:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a0a739ca-2414-49f8-b7c7-87918581bef6 tempest-VolumesImageMetadata-1791814533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:16:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a0a739ca-2414-49f8-b7c7-87918581bef6 tempest-VolumesImageMetadata-1791814533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:16:32 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a0a739ca-2414-49f8-b7c7-87918581bef6 tempest-VolumesImageMetadata-1791814533 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:16:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-860842398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ff408a5-4d1e-40fe-9c85-2fbc3ec03a90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17c2bb4b98b34f98be89dc0245c0f458',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:16:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:16:30Z,use_quota=True,user_id='d0ed489bf5da476a8564690142bf6caa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:16:32 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-a0a739ca-2414-49f8-b7c7-87918581bef6 tempest-VolumesImageMetadata-1791814533 None] Creating volume 9ff408a5-4d1e-40fe-9c85-2fbc3ec03a90 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:16:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a0a739ca-2414-49f8-b7c7-87918581bef6 tempest-VolumesImageMetadata-1791814533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:16:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a0a739ca-2414-49f8-b7c7-87918581bef6 tempest-VolumesImageMetadata-1791814533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:16:32 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a0a739ca-2414-49f8-b7c7-87918581bef6 tempest-VolumesImageMetadata-1791814533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:16:32 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a0a739ca-2414-49f8-b7c7-87918581bef6 tempest-VolumesImageMetadata-1791814533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:16:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a0a739ca-2414-49f8-b7c7-87918581bef6 tempest-VolumesImageMetadata-1791814533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:16:32 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a0a739ca-2414-49f8-b7c7-87918581bef6 tempest-VolumesImageMetadata-1791814533 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:16:32 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-a0a739ca-2414-49f8-b7c7-87918581bef6 tempest-VolumesImageMetadata-1791814533 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:16:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a0a739ca-2414-49f8-b7c7-87918581bef6 tempest-VolumesImageMetadata-1791814533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9ff408a5-4d1e-40fe-9c85-2fbc3ec03a90 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:16:32 devstack sudo[94478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9ff408a5-4d1e-40fe-9c85-2fbc3ec03a90 1073741824 Nov 04 12:16:32 devstack sudo[94478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:16:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-517830df-f945-46fb-a420-5cfc918940cb tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:16:33 devstack sudo[94478]: pam_unix(sudo:session): session closed for user root Nov 04 12:16:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a0a739ca-2414-49f8-b7c7-87918581bef6 tempest-VolumesImageMetadata-1791814533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9ff408a5-4d1e-40fe-9c85-2fbc3ec03a90 1073741824" returned: 0 in 0.697s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:16:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a0a739ca-2414-49f8-b7c7-87918581bef6 tempest-VolumesImageMetadata-1791814533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9ff408a5-4d1e-40fe-9c85-2fbc3ec03a90 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:16:33 devstack sudo[94483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9ff408a5-4d1e-40fe-9c85-2fbc3ec03a90 Nov 04 12:16:33 devstack sudo[94483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:16:33 devstack sudo[94483]: pam_unix(sudo:session): session closed for user root Nov 04 12:16:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a0a739ca-2414-49f8-b7c7-87918581bef6 tempest-VolumesImageMetadata-1791814533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9ff408a5-4d1e-40fe-9c85-2fbc3ec03a90" returned: 0 in 0.336s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:16:33 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a0a739ca-2414-49f8-b7c7-87918581bef6 tempest-VolumesImageMetadata-1791814533 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:16:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a0a739ca-2414-49f8-b7c7-87918581bef6 tempest-VolumesImageMetadata-1791814533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:16:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-517830df-f945-46fb-a420-5cfc918940cb tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.537s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:16:33 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-517830df-f945-46fb-a420-5cfc918940cb tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] Creating offline snapshot be2a29fb-8082-4298-a828-b545d31df3a7 of volume 8a016f94-3371-461b-91e3-b23ffd1ccaae {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 12:16:33 devstack cinder-volume[87095]: DEBUG cinder.volume.volume_utils [None req-a0a739ca-2414-49f8-b7c7-87918581bef6 tempest-VolumesImageMetadata-1791814533 None] Attempting download of b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af ((None, [{'url': 'file:///opt/stack/data/glance/images/b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af', 'metadata': {}}])) to volume 9ff408a5-4d1e-40fe-9c85-2fbc3ec03a90. {{(pid=87095) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 04 12:16:33 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c1dbdc-b3c3-4deb-a6ce-c388c3c3bda9]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:16:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-517830df-f945-46fb-a420-5cfc918940cb tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8a016f94-3371-461b-91e3-b23ffd1ccaae {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:16:33 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[cccf024e-9c71-4c9b-9868-cc29e390ab1e]: (4, 'raw') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:16:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a0a739ca-2414-49f8-b7c7-87918581bef6 tempest-VolumesImageMetadata-1791814533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_c7ye3t4w {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:16:33 devstack sudo[94488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8a016f94-3371-461b-91e3-b23ffd1ccaae Nov 04 12:16:33 devstack sudo[94488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:16:33 devstack sudo[94489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_c7ye3t4w Nov 04 12:16:33 devstack sudo[94489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:16:34 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-72b49398-d6a8-4c39-9dc4-cb5434a35fe5 req-1524f0e7-a0ff-42e1-b5e6-6c4c743040e9 tempest-ServerActionsTestOtherA-1526177158 None] Terminate volume connection completed successfully. Nov 04 12:16:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-72b49398-d6a8-4c39-9dc4-cb5434a35fe5 req-1524f0e7-a0ff-42e1-b5e6-6c4c743040e9 tempest-ServerActionsTestOtherA-1526177158 None] Deleting attachment c2995eb5-bdd3-4bb6-913e-e5986126a0d8. {{(pid=87095) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 12:16:34 devstack sudo[94489]: pam_unix(sudo:session): session closed for user root Nov 04 12:16:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a0a739ca-2414-49f8-b7c7-87918581bef6 tempest-VolumesImageMetadata-1791814533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_c7ye3t4w" returned: 0 in 0.436s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:16:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a0a739ca-2414-49f8-b7c7-87918581bef6 tempest-VolumesImageMetadata-1791814533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_c7ye3t4w {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:16:34 devstack cinder-volume[87095]: DEBUG cinder.coordination [req-72b49398-d6a8-4c39-9dc4-cb5434a35fe5 req-c12543d8-ce25-4dcf-a70c-553d32eaab13 tempest-ServerActionsTestOtherA-1526177158 None] Acquiring lock "cinder-4f5306af-c4b6-474c-93fa-aa3638b46630-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:16:34 devstack sudo[94488]: pam_unix(sudo:session): session closed for user root Nov 04 12:16:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-517830df-f945-46fb-a420-5cfc918940cb tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8a016f94-3371-461b-91e3-b23ffd1ccaae" returned: 0 in 0.659s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:16:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-517830df-f945-46fb-a420-5cfc918940cb tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8a016f94-3371-461b-91e3-b23ffd1ccaae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8a016f94-3371-461b-91e3-b23ffd1ccaae.be2a29fb-8082-4298-a828-b545d31df3a7 2G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:16:34 devstack cinder-volume[87095]: DEBUG cinder.coordination [req-72b49398-d6a8-4c39-9dc4-cb5434a35fe5 req-c12543d8-ce25-4dcf-a70c-553d32eaab13 tempest-ServerActionsTestOtherA-1526177158 None] Lock "cinder-4f5306af-c4b6-474c-93fa-aa3638b46630-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:16:34 devstack sudo[94499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8a016f94-3371-461b-91e3-b23ffd1ccaae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8a016f94-3371-461b-91e3-b23ffd1ccaae.be2a29fb-8082-4298-a828-b545d31df3a7 2G Nov 04 12:16:34 devstack sudo[94499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:16:34 devstack sudo[94497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_c7ye3t4w Nov 04 12:16:34 devstack sudo[94497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:16:34 devstack cinder-volume[87095]: DEBUG cinder.coordination [req-72b49398-d6a8-4c39-9dc4-cb5434a35fe5 req-c12543d8-ce25-4dcf-a70c-553d32eaab13 tempest-ServerActionsTestOtherA-1526177158 None] Acquiring lock "cinder-quobyte-4f5306af-c4b6-474c-93fa-aa3638b46630" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:16:34 devstack cinder-volume[87095]: DEBUG cinder.coordination [req-72b49398-d6a8-4c39-9dc4-cb5434a35fe5 req-c12543d8-ce25-4dcf-a70c-553d32eaab13 tempest-ServerActionsTestOtherA-1526177158 None] Lock "cinder-quobyte-4f5306af-c4b6-474c-93fa-aa3638b46630" acquired by "delete_volume" :: waited 0.043s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:16:34 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[538dde00-adbe-4395-a662-687e1b70b26c]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:16:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-72b49398-d6a8-4c39-9dc4-cb5434a35fe5 req-c12543d8-ce25-4dcf-a70c-553d32eaab13 tempest-ServerActionsTestOtherA-1526177158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4f5306af-c4b6-474c-93fa-aa3638b46630 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:16:34 devstack sudo[94497]: pam_unix(sudo:session): session closed for user root Nov 04 12:16:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a0a739ca-2414-49f8-b7c7-87918581bef6 tempest-VolumesImageMetadata-1791814533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_c7ye3t4w" returned: 1 in 0.537s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:16:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a0a739ca-2414-49f8-b7c7-87918581bef6 tempest-VolumesImageMetadata-1791814533 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_c7ye3t4w' failed. Not Retrying. {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 12:16:34 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02cfcda-96da-4708-94a2-182b7ec98eb7]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:16:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a0a739ca-2414-49f8-b7c7-87918581bef6 tempest-VolumesImageMetadata-1791814533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_nlo_3ooqdevstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:16:34 devstack sudo[94502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4f5306af-c4b6-474c-93fa-aa3638b46630 Nov 04 12:16:34 devstack sudo[94502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:16:35 devstack sudo[94505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_nlo_3ooqdevstack@QuobyteHD Nov 04 12:16:35 devstack sudo[94505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:16:35 devstack sudo[94499]: pam_unix(sudo:session): session closed for user root Nov 04 12:16:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-517830df-f945-46fb-a420-5cfc918940cb tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8a016f94-3371-461b-91e3-b23ffd1ccaae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8a016f94-3371-461b-91e3-b23ffd1ccaae.be2a29fb-8082-4298-a828-b545d31df3a7 2G" returned: 0 in 0.803s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:16:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-517830df-f945-46fb-a420-5cfc918940cb tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a016f94-3371-461b-91e3-b23ffd1ccaae -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8a016f94-3371-461b-91e3-b23ffd1ccaae.be2a29fb-8082-4298-a828-b545d31df3a7 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:16:35 devstack sudo[94502]: pam_unix(sudo:session): session closed for user root Nov 04 12:16:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-72b49398-d6a8-4c39-9dc4-cb5434a35fe5 req-c12543d8-ce25-4dcf-a70c-553d32eaab13 tempest-ServerActionsTestOtherA-1526177158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4f5306af-c4b6-474c-93fa-aa3638b46630" returned: 0 in 0.621s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:16:35 devstack sudo[94514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a016f94-3371-461b-91e3-b23ffd1ccaae -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8a016f94-3371-461b-91e3-b23ffd1ccaae.be2a29fb-8082-4298-a828-b545d31df3a7 Nov 04 12:16:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-72b49398-d6a8-4c39-9dc4-cb5434a35fe5 req-c12543d8-ce25-4dcf-a70c-553d32eaab13 tempest-ServerActionsTestOtherA-1526177158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4f5306af-c4b6-474c-93fa-aa3638b46630 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:16:35 devstack sudo[94514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:16:35 devstack sudo[94516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4f5306af-c4b6-474c-93fa-aa3638b46630 Nov 04 12:16:35 devstack sudo[94516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:16:35 devstack sudo[94505]: pam_unix(sudo:session): session closed for user root Nov 04 12:16:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a0a739ca-2414-49f8-b7c7-87918581bef6 tempest-VolumesImageMetadata-1791814533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_nlo_3ooqdevstack@QuobyteHD" returned: 0 in 0.579s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:16:35 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-a0a739ca-2414-49f8-b7c7-87918581bef6 tempest-VolumesImageMetadata-1791814533 None] b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af was qcow2, converting to qcow2 {{(pid=87095) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 04 12:16:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a0a739ca-2414-49f8-b7c7-87918581bef6 tempest-VolumesImageMetadata-1791814533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_nlo_3ooqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9ff408a5-4d1e-40fe-9c85-2fbc3ec03a90 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:16:35 devstack sudo[94522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_nlo_3ooqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9ff408a5-4d1e-40fe-9c85-2fbc3ec03a90 Nov 04 12:16:35 devstack sudo[94522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:16:35 devstack sudo[94516]: pam_unix(sudo:session): session closed for user root Nov 04 12:16:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-72b49398-d6a8-4c39-9dc4-cb5434a35fe5 req-c12543d8-ce25-4dcf-a70c-553d32eaab13 tempest-ServerActionsTestOtherA-1526177158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4f5306af-c4b6-474c-93fa-aa3638b46630" returned: 0 in 0.301s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:16:35 devstack cinder-volume[87095]: DEBUG cinder.coordination [req-72b49398-d6a8-4c39-9dc4-cb5434a35fe5 req-c12543d8-ce25-4dcf-a70c-553d32eaab13 tempest-ServerActionsTestOtherA-1526177158 None] Lock "cinder-quobyte-4f5306af-c4b6-474c-93fa-aa3638b46630" released by "delete_volume" :: held 1.023s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:16:35 devstack sudo[94514]: pam_unix(sudo:session): session closed for user root Nov 04 12:16:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-517830df-f945-46fb-a420-5cfc918940cb tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a016f94-3371-461b-91e3-b23ffd1ccaae -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8a016f94-3371-461b-91e3-b23ffd1ccaae.be2a29fb-8082-4298-a828-b545d31df3a7" returned: 0 in 0.400s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:16:35 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-517830df-f945-46fb-a420-5cfc918940cb tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8a016f94-3371-461b-91e3-b23ffd1ccaae.be2a29fb-8082-4298-a828-b545d31df3a7 is being set with open permissions: ugo+rw Nov 04 12:16:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-517830df-f945-46fb-a420-5cfc918940cb tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8a016f94-3371-461b-91e3-b23ffd1ccaae.be2a29fb-8082-4298-a828-b545d31df3a7 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:16:35 devstack sudo[94529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8a016f94-3371-461b-91e3-b23ffd1ccaae.be2a29fb-8082-4298-a828-b545d31df3a7 Nov 04 12:16:35 devstack sudo[94529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:16:35 devstack cinder-volume[87095]: DEBUG cinder.quota [req-72b49398-d6a8-4c39-9dc4-cb5434a35fe5 req-c12543d8-ce25-4dcf-a70c-553d32eaab13 tempest-ServerActionsTestOtherA-1526177158 None] Created reservations ['34e91399-4221-4847-b272-9f5aff1e42aa', '278731d8-374e-4ca7-8845-1662708bef2a', '8a7a6a0a-1576-42e4-9be0-eab2f1d2e378', '56743088-c95c-4cc4-8900-b1178f70ed36'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:16:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-72b49398-d6a8-4c39-9dc4-cb5434a35fe5 req-c12543d8-ce25-4dcf-a70c-553d32eaab13 tempest-ServerActionsTestOtherA-1526177158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:16:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-72b49398-d6a8-4c39-9dc4-cb5434a35fe5 req-c12543d8-ce25-4dcf-a70c-553d32eaab13 tempest-ServerActionsTestOtherA-1526177158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:16:35 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [req-72b49398-d6a8-4c39-9dc4-cb5434a35fe5 req-c12543d8-ce25-4dcf-a70c-553d32eaab13 tempest-ServerActionsTestOtherA-1526177158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:16:35 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [req-72b49398-d6a8-4c39-9dc4-cb5434a35fe5 req-c12543d8-ce25-4dcf-a70c-553d32eaab13 tempest-ServerActionsTestOtherA-1526177158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:16:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-72b49398-d6a8-4c39-9dc4-cb5434a35fe5 req-c12543d8-ce25-4dcf-a70c-553d32eaab13 tempest-ServerActionsTestOtherA-1526177158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:16:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-72b49398-d6a8-4c39-9dc4-cb5434a35fe5 req-c12543d8-ce25-4dcf-a70c-553d32eaab13 tempest-ServerActionsTestOtherA-1526177158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:16:35 devstack sudo[94535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:16:35 devstack sudo[94535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:16:36 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b9ff026d-9340-47ff-8784-72c3522f4784 tempest-ServerActionsTestOtherA-1526177158 None] Acquiring lock "cinder-6e3403eb-f6e0-483a-9467-55820ca11ec9-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:16:36 devstack sudo[94529]: pam_unix(sudo:session): session closed for user root Nov 04 12:16:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-517830df-f945-46fb-a420-5cfc918940cb tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8a016f94-3371-461b-91e3-b23ffd1ccaae.be2a29fb-8082-4298-a828-b545d31df3a7" returned: 0 in 0.449s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:16:36 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b9ff026d-9340-47ff-8784-72c3522f4784 tempest-ServerActionsTestOtherA-1526177158 None] Lock "cinder-6e3403eb-f6e0-483a-9467-55820ca11ec9-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:16:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-517830df-f945-46fb-a420-5cfc918940cb tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8a016f94-3371-461b-91e3-b23ffd1ccaae.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:16:36 devstack sudo[94539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8a016f94-3371-461b-91e3-b23ffd1ccaae.info Nov 04 12:16:36 devstack sudo[94539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:16:36 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b9ff026d-9340-47ff-8784-72c3522f4784 tempest-ServerActionsTestOtherA-1526177158 None] Acquiring lock "cinder-quobyte-6e3403eb-f6e0-483a-9467-55820ca11ec9" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:16:36 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b9ff026d-9340-47ff-8784-72c3522f4784 tempest-ServerActionsTestOtherA-1526177158 None] Lock "cinder-quobyte-6e3403eb-f6e0-483a-9467-55820ca11ec9" acquired by "delete_volume" :: waited 0.025s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:16:36 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1373a6b6-3593-4027-9338-ae9d373bd79d]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:16:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b9ff026d-9340-47ff-8784-72c3522f4784 tempest-ServerActionsTestOtherA-1526177158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6e3403eb-f6e0-483a-9467-55820ca11ec9 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:16:36 devstack sudo[94535]: pam_unix(sudo:session): session closed for user root Nov 04 12:16:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-72b49398-d6a8-4c39-9dc4-cb5434a35fe5 req-c12543d8-ce25-4dcf-a70c-553d32eaab13 tempest-ServerActionsTestOtherA-1526177158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.433s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:16:36 devstack cinder-volume[87095]: DEBUG cinder.manager [req-72b49398-d6a8-4c39-9dc4-cb5434a35fe5 req-c12543d8-ce25-4dcf-a70c-553d32eaab13 tempest-ServerActionsTestOtherA-1526177158 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:16:36 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-72b49398-d6a8-4c39-9dc4-cb5434a35fe5 req-c12543d8-ce25-4dcf-a70c-553d32eaab13 tempest-ServerActionsTestOtherA-1526177158 None] Deleted volume successfully. Nov 04 12:16:36 devstack cinder-volume[87095]: DEBUG cinder.coordination [req-72b49398-d6a8-4c39-9dc4-cb5434a35fe5 req-c12543d8-ce25-4dcf-a70c-553d32eaab13 tempest-ServerActionsTestOtherA-1526177158 None] Lock "cinder-4f5306af-c4b6-474c-93fa-aa3638b46630-delete_volume" released by "delete_volume" :: held 1.901s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:16:36 devstack sudo[94542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6e3403eb-f6e0-483a-9467-55820ca11ec9 Nov 04 12:16:36 devstack sudo[94542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:16:36 devstack sudo[94539]: pam_unix(sudo:session): session closed for user root Nov 04 12:16:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-517830df-f945-46fb-a420-5cfc918940cb tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8a016f94-3371-461b-91e3-b23ffd1ccaae.info" returned: 0 in 0.502s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:16:36 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-517830df-f945-46fb-a420-5cfc918940cb tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8a016f94-3371-461b-91e3-b23ffd1ccaae.info is being set with open permissions: ugo+rw Nov 04 12:16:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-517830df-f945-46fb-a420-5cfc918940cb tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8a016f94-3371-461b-91e3-b23ffd1ccaae.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:16:36 devstack sudo[94546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8a016f94-3371-461b-91e3-b23ffd1ccaae.info Nov 04 12:16:36 devstack sudo[94546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:16:36 devstack sudo[94542]: pam_unix(sudo:session): session closed for user root Nov 04 12:16:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b9ff026d-9340-47ff-8784-72c3522f4784 tempest-ServerActionsTestOtherA-1526177158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6e3403eb-f6e0-483a-9467-55820ca11ec9" returned: 0 in 0.579s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:16:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b9ff026d-9340-47ff-8784-72c3522f4784 tempest-ServerActionsTestOtherA-1526177158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6e3403eb-f6e0-483a-9467-55820ca11ec9 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:16:36 devstack sudo[94551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6e3403eb-f6e0-483a-9467-55820ca11ec9 Nov 04 12:16:36 devstack sudo[94551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:16:36 devstack sudo[94546]: pam_unix(sudo:session): session closed for user root Nov 04 12:16:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-517830df-f945-46fb-a420-5cfc918940cb tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8a016f94-3371-461b-91e3-b23ffd1ccaae.info" returned: 0 in 0.350s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:16:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-517830df-f945-46fb-a420-5cfc918940cb tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.311s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:16:37 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-517830df-f945-46fb-a420-5cfc918940cb tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] Create snapshot completed successfully Nov 04 12:16:37 devstack sudo[94551]: pam_unix(sudo:session): session closed for user root Nov 04 12:16:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b9ff026d-9340-47ff-8784-72c3522f4784 tempest-ServerActionsTestOtherA-1526177158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6e3403eb-f6e0-483a-9467-55820ca11ec9" returned: 0 in 0.287s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:16:37 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b9ff026d-9340-47ff-8784-72c3522f4784 tempest-ServerActionsTestOtherA-1526177158 None] Lock "cinder-quobyte-6e3403eb-f6e0-483a-9467-55820ca11ec9" released by "delete_volume" :: held 0.932s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:16:37 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-b9ff026d-9340-47ff-8784-72c3522f4784 tempest-ServerActionsTestOtherA-1526177158 None] Created reservations ['c720f3cc-234d-4e59-875a-fe10f0712e0a', '5bb54203-fdf7-4772-9138-5f9eed0675e7', '94c93930-65ea-47ea-ac01-fcccbd72d7c6', 'c6d05c63-c47b-49e7-bfd2-865c151350d9'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:16:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b9ff026d-9340-47ff-8784-72c3522f4784 tempest-ServerActionsTestOtherA-1526177158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:16:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b9ff026d-9340-47ff-8784-72c3522f4784 tempest-ServerActionsTestOtherA-1526177158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:16:37 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b9ff026d-9340-47ff-8784-72c3522f4784 tempest-ServerActionsTestOtherA-1526177158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:16:37 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b9ff026d-9340-47ff-8784-72c3522f4784 tempest-ServerActionsTestOtherA-1526177158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:16:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b9ff026d-9340-47ff-8784-72c3522f4784 tempest-ServerActionsTestOtherA-1526177158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:16:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b9ff026d-9340-47ff-8784-72c3522f4784 tempest-ServerActionsTestOtherA-1526177158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:16:37 devstack sudo[94555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:16:37 devstack sudo[94555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:16:37 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a437497e-d3f3-4509-8505-45eae43da67c tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] Acquiring lock "cinder-be2a29fb-8082-4298-a828-b545d31df3a7-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:16:37 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a437497e-d3f3-4509-8505-45eae43da67c tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] Lock "cinder-be2a29fb-8082-4298-a828-b545d31df3a7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.058s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:16:37 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a437497e-d3f3-4509-8505-45eae43da67c tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] Acquiring lock "cinder-quobyte-8a016f94-3371-461b-91e3-b23ffd1ccaae" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:16:37 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a437497e-d3f3-4509-8505-45eae43da67c tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] Lock "cinder-quobyte-8a016f94-3371-461b-91e3-b23ffd1ccaae" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:16:37 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a437497e-d3f3-4509-8505-45eae43da67c tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] Acquiring lock "cinder-quobyte-be2a29fb-8082-4298-a828-b545d31df3a7" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:16:37 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a437497e-d3f3-4509-8505-45eae43da67c tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] Lock "cinder-quobyte-be2a29fb-8082-4298-a828-b545d31df3a7" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:16:37 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-a437497e-d3f3-4509-8505-45eae43da67c tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] Deleting offline snapshot be2a29fb-8082-4298-a828-b545d31df3a7 of volume 8a016f94-3371-461b-91e3-b23ffd1ccaae {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 12:16:37 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-a437497e-d3f3-4509-8505-45eae43da67c tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] snapshot_file for this snap is: volume-8a016f94-3371-461b-91e3-b23ffd1ccaae.be2a29fb-8082-4298-a828-b545d31df3a7 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 12:16:37 devstack sudo[94555]: pam_unix(sudo:session): session closed for user root Nov 04 12:16:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b9ff026d-9340-47ff-8784-72c3522f4784 tempest-ServerActionsTestOtherA-1526177158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.517s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:16:37 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-b9ff026d-9340-47ff-8784-72c3522f4784 tempest-ServerActionsTestOtherA-1526177158 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:16:37 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5806e6d6-46ea-455e-a64c-fcce8e6394d3]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:16:37 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-b9ff026d-9340-47ff-8784-72c3522f4784 tempest-ServerActionsTestOtherA-1526177158 None] Deleted volume successfully. Nov 04 12:16:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a437497e-d3f3-4509-8505-45eae43da67c tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8a016f94-3371-461b-91e3-b23ffd1ccaae.be2a29fb-8082-4298-a828-b545d31df3a7 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:16:37 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b9ff026d-9340-47ff-8784-72c3522f4784 tempest-ServerActionsTestOtherA-1526177158 None] Lock "cinder-6e3403eb-f6e0-483a-9467-55820ca11ec9-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:16:38 devstack sudo[94562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8a016f94-3371-461b-91e3-b23ffd1ccaae.be2a29fb-8082-4298-a828-b545d31df3a7 Nov 04 12:16:38 devstack sudo[94562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:16:38 devstack sudo[94522]: pam_unix(sudo:session): session closed for user root Nov 04 12:16:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a0a739ca-2414-49f8-b7c7-87918581bef6 tempest-VolumesImageMetadata-1791814533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_nlo_3ooqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9ff408a5-4d1e-40fe-9c85-2fbc3ec03a90" returned: 0 in 3.002s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:16:38 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-a0a739ca-2414-49f8-b7c7-87918581bef6 tempest-VolumesImageMetadata-1791814533 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_nlo_3ooqdevstack@QuobyteHD, size 112.00 MB, duration 3.00 sec, destination /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9ff408a5-4d1e-40fe-9c85-2fbc3ec03a90 {{(pid=87095) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 12:16:38 devstack cinder-volume[87095]: INFO cinder.image.image_utils [None req-a0a739ca-2414-49f8-b7c7-87918581bef6 tempest-VolumesImageMetadata-1791814533 None] Converted 112.00 MB image at 37.30 MB/s Nov 04 12:16:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a0a739ca-2414-49f8-b7c7-87918581bef6 tempest-VolumesImageMetadata-1791814533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9ff408a5-4d1e-40fe-9c85-2fbc3ec03a90 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:16:38 devstack sudo[94582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9ff408a5-4d1e-40fe-9c85-2fbc3ec03a90 1G Nov 04 12:16:38 devstack sudo[94582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:16:38 devstack sudo[94562]: pam_unix(sudo:session): session closed for user root Nov 04 12:16:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a437497e-d3f3-4509-8505-45eae43da67c tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8a016f94-3371-461b-91e3-b23ffd1ccaae.be2a29fb-8082-4298-a828-b545d31df3a7" returned: 0 in 0.815s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:16:38 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-a437497e-d3f3-4509-8505-45eae43da67c tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a016f94-3371-461b-91e3-b23ffd1ccaae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 12:16:38 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab2e639e-c4e1-433f-a45d-198b7a65e7c1]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:16:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a437497e-d3f3-4509-8505-45eae43da67c tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8a016f94-3371-461b-91e3-b23ffd1ccaae {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:16:38 devstack sudo[94593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8a016f94-3371-461b-91e3-b23ffd1ccaae Nov 04 12:16:38 devstack sudo[94593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:16:38 devstack sudo[94582]: pam_unix(sudo:session): session closed for user root Nov 04 12:16:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a0a739ca-2414-49f8-b7c7-87918581bef6 tempest-VolumesImageMetadata-1791814533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9ff408a5-4d1e-40fe-9c85-2fbc3ec03a90 1G" returned: 0 in 0.466s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:16:38 devstack cinder-volume[87095]: DEBUG cinder.volume.volume_utils [None req-a0a739ca-2414-49f8-b7c7-87918581bef6 tempest-VolumesImageMetadata-1791814533 None] Downloaded image b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af ((None, [{'url': 'file:///opt/stack/data/glance/images/b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af', 'metadata': {}}])) to volume 9ff408a5-4d1e-40fe-9c85-2fbc3ec03a90 successfully. {{(pid=87095) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 04 12:16:38 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-a0a739ca-2414-49f8-b7c7-87918581bef6 tempest-VolumesImageMetadata-1791814533 None] Temporary image b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af for user d0ed489bf5da476a8564690142bf6caa is deleted. {{(pid=87095) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 04 12:16:38 devstack cinder-volume[87095]: DEBUG cinder.volume.volume_utils [None req-a0a739ca-2414-49f8-b7c7-87918581bef6 tempest-VolumesImageMetadata-1791814533 None] Marking volume 9ff408a5-4d1e-40fe-9c85-2fbc3ec03a90 as bootable. {{(pid=87095) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 04 12:16:38 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0a739ca-2414-49f8-b7c7-87918581bef6 tempest-VolumesImageMetadata-1791814533 None] Copying metadata from image b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af to 9ff408a5-4d1e-40fe-9c85-2fbc3ec03a90. {{(pid=87095) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 04 12:16:38 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0a739ca-2414-49f8-b7c7-87918581bef6 tempest-VolumesImageMetadata-1791814533 None] Creating volume glance metadata for volume 9ff408a5-4d1e-40fe-9c85-2fbc3ec03a90 backed by image b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87095) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 04 12:16:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a0a739ca-2414-49f8-b7c7-87918581bef6 tempest-VolumesImageMetadata-1791814533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1a0f08c-6b1c-4b2a-a97e-fad3c2343951) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ff408a5-4d1e-40fe-9c85-2fbc3ec03a90', 'volume_size': 1, 'image_id': 'b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '021c36f8b23249aabf2d5e363bccb8bc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af', 'created_at': datetime.datetime(2026, 11, 4, 11, 4, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 11, 4, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:16:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a0a739ca-2414-49f8-b7c7-87918581bef6 tempest-VolumesImageMetadata-1791814533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fe1a7cc-a4fe-433a-8e09-7947c1b1742d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:16:39 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-a0a739ca-2414-49f8-b7c7-87918581bef6 tempest-VolumesImageMetadata-1791814533 None] Volume volume-9ff408a5-4d1e-40fe-9c85-2fbc3ec03a90 (9ff408a5-4d1e-40fe-9c85-2fbc3ec03a90): created successfully Nov 04 12:16:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a0a739ca-2414-49f8-b7c7-87918581bef6 tempest-VolumesImageMetadata-1791814533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fe1a7cc-a4fe-433a-8e09-7947c1b1742d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:16:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a0a739ca-2414-49f8-b7c7-87918581bef6 tempest-VolumesImageMetadata-1791814533 None] Flow 'volume_create_manager' (8aeb35a2-72e4-4115-98f4-f46bc346c1b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:16:39 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-a0a739ca-2414-49f8-b7c7-87918581bef6 tempest-VolumesImageMetadata-1791814533 None] Created volume successfully. Nov 04 12:16:39 devstack sudo[94593]: pam_unix(sudo:session): session closed for user root Nov 04 12:16:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a437497e-d3f3-4509-8505-45eae43da67c tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8a016f94-3371-461b-91e3-b23ffd1ccaae" returned: 0 in 0.632s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:16:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a437497e-d3f3-4509-8505-45eae43da67c tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8a016f94-3371-461b-91e3-b23ffd1ccaae.be2a29fb-8082-4298-a828-b545d31df3a7 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:16:39 devstack sudo[94601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8a016f94-3371-461b-91e3-b23ffd1ccaae.be2a29fb-8082-4298-a828-b545d31df3a7 Nov 04 12:16:39 devstack sudo[94601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:16:39 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b747329-9326-4418-8185-08de4074f5cc tempest-VolumesMetadataTest-991668983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:16:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6b747329-9326-4418-8185-08de4074f5cc tempest-VolumesMetadataTest-991668983 None] Flow 'volume_create_manager' (5f58e76a-33b9-4134-83d5-e4e4caeb4af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:16:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6b747329-9326-4418-8185-08de4074f5cc tempest-VolumesMetadataTest-991668983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8469dfce-5da1-451d-95ea-56b50d1abb6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:16:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6b747329-9326-4418-8185-08de4074f5cc tempest-VolumesMetadataTest-991668983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8469dfce-5da1-451d-95ea-56b50d1abb6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:16:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-972586138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26693166-f5f8-4689-9a64-e8a6d8a8f72e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd7111944b424afd92bc4cacde3ce9a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:16:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:16:39Z,use_quota=True,user_id='1620751380cd4f97bd2ee86a70a0fa8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:16:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6b747329-9326-4418-8185-08de4074f5cc tempest-VolumesMetadataTest-991668983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bde8b082-a2e1-44e5-87fc-7e2d47ec415c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:16:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6b747329-9326-4418-8185-08de4074f5cc tempest-VolumesMetadataTest-991668983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bde8b082-a2e1-44e5-87fc-7e2d47ec415c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:16:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6b747329-9326-4418-8185-08de4074f5cc tempest-VolumesMetadataTest-991668983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ac05a70-bee5-4cd3-a283-a4feccfc77a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:16:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6b747329-9326-4418-8185-08de4074f5cc tempest-VolumesMetadataTest-991668983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ac05a70-bee5-4cd3-a283-a4feccfc77a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26693166-f5f8-4689-9a64-e8a6d8a8f72e', 'volume_name': 'volume-26693166-f5f8-4689-9a64-e8a6d8a8f72e', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:16:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6b747329-9326-4418-8185-08de4074f5cc tempest-VolumesMetadataTest-991668983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba7f7397-1136-4e6f-a8b7-a59f314a35f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:16:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6b747329-9326-4418-8185-08de4074f5cc tempest-VolumesMetadataTest-991668983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba7f7397-1136-4e6f-a8b7-a59f314a35f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:16:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6b747329-9326-4418-8185-08de4074f5cc tempest-VolumesMetadataTest-991668983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02b69de5-9a46-4d93-8e21-8540b8a831e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:16:39 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-6b747329-9326-4418-8185-08de4074f5cc tempest-VolumesMetadataTest-991668983 None] Volume 26693166-f5f8-4689-9a64-e8a6d8a8f72e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26693166-f5f8-4689-9a64-e8a6d8a8f72e', 'volume_size': 1} Nov 04 12:16:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6b747329-9326-4418-8185-08de4074f5cc tempest-VolumesMetadataTest-991668983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:16:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6b747329-9326-4418-8185-08de4074f5cc tempest-VolumesMetadataTest-991668983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:16:39 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6b747329-9326-4418-8185-08de4074f5cc tempest-VolumesMetadataTest-991668983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:16:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-972586138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26693166-f5f8-4689-9a64-e8a6d8a8f72e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd7111944b424afd92bc4cacde3ce9a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:16:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:16:39Z,use_quota=True,user_id='1620751380cd4f97bd2ee86a70a0fa8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:16:39 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-6b747329-9326-4418-8185-08de4074f5cc tempest-VolumesMetadataTest-991668983 None] Creating volume 26693166-f5f8-4689-9a64-e8a6d8a8f72e {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:16:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6b747329-9326-4418-8185-08de4074f5cc tempest-VolumesMetadataTest-991668983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:16:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6b747329-9326-4418-8185-08de4074f5cc tempest-VolumesMetadataTest-991668983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:16:39 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6b747329-9326-4418-8185-08de4074f5cc tempest-VolumesMetadataTest-991668983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:16:39 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6b747329-9326-4418-8185-08de4074f5cc tempest-VolumesMetadataTest-991668983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:16:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6b747329-9326-4418-8185-08de4074f5cc tempest-VolumesMetadataTest-991668983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:16:39 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6b747329-9326-4418-8185-08de4074f5cc tempest-VolumesMetadataTest-991668983 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:16:39 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-6b747329-9326-4418-8185-08de4074f5cc tempest-VolumesMetadataTest-991668983 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:16:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6b747329-9326-4418-8185-08de4074f5cc tempest-VolumesMetadataTest-991668983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-26693166-f5f8-4689-9a64-e8a6d8a8f72e 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:16:39 devstack sudo[94607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-26693166-f5f8-4689-9a64-e8a6d8a8f72e 1073741824 Nov 04 12:16:39 devstack sudo[94607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:16:39 devstack sudo[94601]: pam_unix(sudo:session): session closed for user root Nov 04 12:16:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a437497e-d3f3-4509-8505-45eae43da67c tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8a016f94-3371-461b-91e3-b23ffd1ccaae.be2a29fb-8082-4298-a828-b545d31df3a7" returned: 0 in 0.542s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:16:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a437497e-d3f3-4509-8505-45eae43da67c tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8a016f94-3371-461b-91e3-b23ffd1ccaae.be2a29fb-8082-4298-a828-b545d31df3a7 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:16:39 devstack sudo[94609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8a016f94-3371-461b-91e3-b23ffd1ccaae.be2a29fb-8082-4298-a828-b545d31df3a7 Nov 04 12:16:39 devstack sudo[94609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:16:40 devstack sudo[94609]: pam_unix(sudo:session): session closed for user root Nov 04 12:16:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a437497e-d3f3-4509-8505-45eae43da67c tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8a016f94-3371-461b-91e3-b23ffd1ccaae.be2a29fb-8082-4298-a828-b545d31df3a7" returned: 0 in 0.314s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:16:40 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a437497e-d3f3-4509-8505-45eae43da67c tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] Lock "cinder-quobyte-be2a29fb-8082-4298-a828-b545d31df3a7" released by "_delete_snapshot" :: held 2.501s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:16:40 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a437497e-d3f3-4509-8505-45eae43da67c tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] Lock "cinder-quobyte-8a016f94-3371-461b-91e3-b23ffd1ccaae" released by "delete_snapshot" :: held 2.538s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:16:40 devstack sudo[94607]: pam_unix(sudo:session): session closed for user root Nov 04 12:16:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6b747329-9326-4418-8185-08de4074f5cc tempest-VolumesMetadataTest-991668983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-26693166-f5f8-4689-9a64-e8a6d8a8f72e 1073741824" returned: 0 in 0.606s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:16:40 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-a437497e-d3f3-4509-8505-45eae43da67c tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] Created reservations ['9cc3853f-4f74-4df0-8c5d-e6078bd9c0cf', '01203aa8-8242-4ce2-a40e-0dd5f3dfc404', '91bfcb70-d112-4458-821b-2bbae0ba19dc', '2e7bf26f-635a-4738-bd2a-1346be21410c'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:16:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6b747329-9326-4418-8185-08de4074f5cc tempest-VolumesMetadataTest-991668983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-26693166-f5f8-4689-9a64-e8a6d8a8f72e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:16:40 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a819fa52-015f-470f-8b1e-27699e556000 tempest-VolumesImageMetadata-1791814533 None] Acquiring lock "cinder-9ff408a5-4d1e-40fe-9c85-2fbc3ec03a90-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:16:40 devstack sudo[94616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-26693166-f5f8-4689-9a64-e8a6d8a8f72e Nov 04 12:16:40 devstack sudo[94616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:16:40 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a819fa52-015f-470f-8b1e-27699e556000 tempest-VolumesImageMetadata-1791814533 None] Lock "cinder-9ff408a5-4d1e-40fe-9c85-2fbc3ec03a90-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:16:40 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-a437497e-d3f3-4509-8505-45eae43da67c tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] Delete snapshot completed successfully. Nov 04 12:16:40 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a437497e-d3f3-4509-8505-45eae43da67c tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] Lock "cinder-be2a29fb-8082-4298-a828-b545d31df3a7-delete_snapshot" released by "delete_snapshot" :: held 2.777s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:16:40 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a819fa52-015f-470f-8b1e-27699e556000 tempest-VolumesImageMetadata-1791814533 None] Acquiring lock "cinder-quobyte-9ff408a5-4d1e-40fe-9c85-2fbc3ec03a90" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:16:40 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a819fa52-015f-470f-8b1e-27699e556000 tempest-VolumesImageMetadata-1791814533 None] Lock "cinder-quobyte-9ff408a5-4d1e-40fe-9c85-2fbc3ec03a90" acquired by "delete_volume" :: waited 0.020s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:16:40 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1e77e3-b868-4f1c-81e0-061629e1b0e5]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:16:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a819fa52-015f-470f-8b1e-27699e556000 tempest-VolumesImageMetadata-1791814533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9ff408a5-4d1e-40fe-9c85-2fbc3ec03a90 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:16:40 devstack sudo[94616]: pam_unix(sudo:session): session closed for user root Nov 04 12:16:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6b747329-9326-4418-8185-08de4074f5cc tempest-VolumesMetadataTest-991668983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-26693166-f5f8-4689-9a64-e8a6d8a8f72e" returned: 0 in 0.324s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:16:40 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6b747329-9326-4418-8185-08de4074f5cc tempest-VolumesMetadataTest-991668983 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:16:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6b747329-9326-4418-8185-08de4074f5cc tempest-VolumesMetadataTest-991668983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:16:40 devstack sudo[94618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9ff408a5-4d1e-40fe-9c85-2fbc3ec03a90 Nov 04 12:16:40 devstack sudo[94618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:16:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6b747329-9326-4418-8185-08de4074f5cc tempest-VolumesMetadataTest-991668983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02b69de5-9a46-4d93-8e21-8540b8a831e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26693166-f5f8-4689-9a64-e8a6d8a8f72e', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:16:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6b747329-9326-4418-8185-08de4074f5cc tempest-VolumesMetadataTest-991668983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (848d28b3-a002-4203-bda7-9e997edae81e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:16:40 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-6b747329-9326-4418-8185-08de4074f5cc tempest-VolumesMetadataTest-991668983 None] Volume volume-26693166-f5f8-4689-9a64-e8a6d8a8f72e (26693166-f5f8-4689-9a64-e8a6d8a8f72e): created successfully Nov 04 12:16:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6b747329-9326-4418-8185-08de4074f5cc tempest-VolumesMetadataTest-991668983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (848d28b3-a002-4203-bda7-9e997edae81e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:16:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6b747329-9326-4418-8185-08de4074f5cc tempest-VolumesMetadataTest-991668983 None] Flow 'volume_create_manager' (5f58e76a-33b9-4134-83d5-e4e4caeb4af4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:16:40 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-6b747329-9326-4418-8185-08de4074f5cc tempest-VolumesMetadataTest-991668983 None] Created volume successfully. Nov 04 12:16:40 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6702a6bf-06cd-4f76-9ed5-c18e805e14c4 tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] Acquiring lock "cinder-8a016f94-3371-461b-91e3-b23ffd1ccaae-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:16:40 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6702a6bf-06cd-4f76-9ed5-c18e805e14c4 tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] Lock "cinder-8a016f94-3371-461b-91e3-b23ffd1ccaae-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:16:40 devstack sudo[94618]: pam_unix(sudo:session): session closed for user root Nov 04 12:16:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a819fa52-015f-470f-8b1e-27699e556000 tempest-VolumesImageMetadata-1791814533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9ff408a5-4d1e-40fe-9c85-2fbc3ec03a90" returned: 0 in 0.458s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:16:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a819fa52-015f-470f-8b1e-27699e556000 tempest-VolumesImageMetadata-1791814533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9ff408a5-4d1e-40fe-9c85-2fbc3ec03a90 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:16:41 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6702a6bf-06cd-4f76-9ed5-c18e805e14c4 tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] Acquiring lock "cinder-quobyte-8a016f94-3371-461b-91e3-b23ffd1ccaae" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:16:41 devstack sudo[94624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9ff408a5-4d1e-40fe-9c85-2fbc3ec03a90 Nov 04 12:16:41 devstack sudo[94624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:16:41 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6702a6bf-06cd-4f76-9ed5-c18e805e14c4 tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] Lock "cinder-quobyte-8a016f94-3371-461b-91e3-b23ffd1ccaae" acquired by "delete_volume" :: waited 0.032s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:16:41 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[943e9da4-82cb-405d-9a83-372144784aa7]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:16:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6702a6bf-06cd-4f76-9ed5-c18e805e14c4 tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8a016f94-3371-461b-91e3-b23ffd1ccaae {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:16:41 devstack sudo[94626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8a016f94-3371-461b-91e3-b23ffd1ccaae Nov 04 12:16:41 devstack sudo[94626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:16:41 devstack sudo[94624]: pam_unix(sudo:session): session closed for user root Nov 04 12:16:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a819fa52-015f-470f-8b1e-27699e556000 tempest-VolumesImageMetadata-1791814533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9ff408a5-4d1e-40fe-9c85-2fbc3ec03a90" returned: 0 in 0.309s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:16:41 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a819fa52-015f-470f-8b1e-27699e556000 tempest-VolumesImageMetadata-1791814533 None] Lock "cinder-quobyte-9ff408a5-4d1e-40fe-9c85-2fbc3ec03a90" released by "delete_volume" :: held 0.821s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:16:41 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-a819fa52-015f-470f-8b1e-27699e556000 tempest-VolumesImageMetadata-1791814533 None] Created reservations ['42801b8d-f3f3-42e8-9694-9844013f4a72', 'e5d43b5f-74a9-4313-ab4a-ac0bc5d0adf1', '77901e54-7c7f-45d8-a282-69f93f2abfed', 'cd1a82a3-d81c-4ce6-b8cb-4b40f4237fd8'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:16:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a819fa52-015f-470f-8b1e-27699e556000 tempest-VolumesImageMetadata-1791814533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:16:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a819fa52-015f-470f-8b1e-27699e556000 tempest-VolumesImageMetadata-1791814533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:16:41 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a819fa52-015f-470f-8b1e-27699e556000 tempest-VolumesImageMetadata-1791814533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:16:41 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a819fa52-015f-470f-8b1e-27699e556000 tempest-VolumesImageMetadata-1791814533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:16:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a819fa52-015f-470f-8b1e-27699e556000 tempest-VolumesImageMetadata-1791814533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:16:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a819fa52-015f-470f-8b1e-27699e556000 tempest-VolumesImageMetadata-1791814533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:16:41 devstack sudo[94632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:16:41 devstack sudo[94632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:16:41 devstack sudo[94626]: pam_unix(sudo:session): session closed for user root Nov 04 12:16:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6702a6bf-06cd-4f76-9ed5-c18e805e14c4 tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8a016f94-3371-461b-91e3-b23ffd1ccaae" returned: 0 in 0.490s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:16:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6702a6bf-06cd-4f76-9ed5-c18e805e14c4 tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8a016f94-3371-461b-91e3-b23ffd1ccaae {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:16:41 devstack sudo[94634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8a016f94-3371-461b-91e3-b23ffd1ccaae Nov 04 12:16:41 devstack sudo[94634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:16:41 devstack sudo[94632]: pam_unix(sudo:session): session closed for user root Nov 04 12:16:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a819fa52-015f-470f-8b1e-27699e556000 tempest-VolumesImageMetadata-1791814533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.371s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:16:41 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-a819fa52-015f-470f-8b1e-27699e556000 tempest-VolumesImageMetadata-1791814533 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:16:41 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-a819fa52-015f-470f-8b1e-27699e556000 tempest-VolumesImageMetadata-1791814533 None] Deleted volume successfully. Nov 04 12:16:41 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a819fa52-015f-470f-8b1e-27699e556000 tempest-VolumesImageMetadata-1791814533 None] Lock "cinder-9ff408a5-4d1e-40fe-9c85-2fbc3ec03a90-delete_volume" released by "delete_volume" :: held 1.511s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:16:41 devstack sudo[94634]: pam_unix(sudo:session): session closed for user root Nov 04 12:16:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6702a6bf-06cd-4f76-9ed5-c18e805e14c4 tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8a016f94-3371-461b-91e3-b23ffd1ccaae" returned: 0 in 0.395s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:16:42 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6702a6bf-06cd-4f76-9ed5-c18e805e14c4 tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] Lock "cinder-quobyte-8a016f94-3371-461b-91e3-b23ffd1ccaae" released by "delete_volume" :: held 0.968s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:16:42 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-6702a6bf-06cd-4f76-9ed5-c18e805e14c4 tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] Created reservations ['1792d584-df40-4e8e-9d89-5c3a22ee5bab', '8e6d4159-8b41-453a-9b87-764abf15d7ff', 'b1533db8-4f1d-4a08-b312-4226475d94bd', '2ff03ca4-05cc-4763-972c-28262ff64168'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:16:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6702a6bf-06cd-4f76-9ed5-c18e805e14c4 tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:16:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6702a6bf-06cd-4f76-9ed5-c18e805e14c4 tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:16:42 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6702a6bf-06cd-4f76-9ed5-c18e805e14c4 tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:16:42 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6702a6bf-06cd-4f76-9ed5-c18e805e14c4 tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:16:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6702a6bf-06cd-4f76-9ed5-c18e805e14c4 tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:16:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6702a6bf-06cd-4f76-9ed5-c18e805e14c4 tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:16:42 devstack sudo[94638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:16:42 devstack sudo[94638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:16:42 devstack sudo[94638]: pam_unix(sudo:session): session closed for user root Nov 04 12:16:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6702a6bf-06cd-4f76-9ed5-c18e805e14c4 tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.318s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:16:42 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-6702a6bf-06cd-4f76-9ed5-c18e805e14c4 tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:16:42 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-6702a6bf-06cd-4f76-9ed5-c18e805e14c4 tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] Deleted volume successfully. Nov 04 12:16:42 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6702a6bf-06cd-4f76-9ed5-c18e805e14c4 tempest-VolumesSnapshotNegativeTestJSON-1864160219 None] Lock "cinder-8a016f94-3371-461b-91e3-b23ffd1ccaae-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:16:42 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e7b6302c-a6b2-4ce0-bb9f-afafb905518a tempest-VolumesMetadataTest-991668983 None] Acquiring lock "cinder-26693166-f5f8-4689-9a64-e8a6d8a8f72e-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:16:42 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e7b6302c-a6b2-4ce0-bb9f-afafb905518a tempest-VolumesMetadataTest-991668983 None] Lock "cinder-26693166-f5f8-4689-9a64-e8a6d8a8f72e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:16:42 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e7b6302c-a6b2-4ce0-bb9f-afafb905518a tempest-VolumesMetadataTest-991668983 None] Acquiring lock "cinder-quobyte-26693166-f5f8-4689-9a64-e8a6d8a8f72e" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:16:42 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e7b6302c-a6b2-4ce0-bb9f-afafb905518a tempest-VolumesMetadataTest-991668983 None] Lock "cinder-quobyte-26693166-f5f8-4689-9a64-e8a6d8a8f72e" acquired by "delete_volume" :: waited 0.019s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:16:42 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d217a0-3334-4cbb-8d1e-df71b0ea581b]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:16:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e7b6302c-a6b2-4ce0-bb9f-afafb905518a tempest-VolumesMetadataTest-991668983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-26693166-f5f8-4689-9a64-e8a6d8a8f72e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:16:42 devstack sudo[94642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-26693166-f5f8-4689-9a64-e8a6d8a8f72e Nov 04 12:16:42 devstack sudo[94642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:16:43 devstack sudo[94642]: pam_unix(sudo:session): session closed for user root Nov 04 12:16:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e7b6302c-a6b2-4ce0-bb9f-afafb905518a tempest-VolumesMetadataTest-991668983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-26693166-f5f8-4689-9a64-e8a6d8a8f72e" returned: 0 in 0.402s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:16:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e7b6302c-a6b2-4ce0-bb9f-afafb905518a tempest-VolumesMetadataTest-991668983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-26693166-f5f8-4689-9a64-e8a6d8a8f72e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:16:43 devstack sudo[94647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-26693166-f5f8-4689-9a64-e8a6d8a8f72e Nov 04 12:16:43 devstack sudo[94647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:16:43 devstack sudo[94647]: pam_unix(sudo:session): session closed for user root Nov 04 12:16:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e7b6302c-a6b2-4ce0-bb9f-afafb905518a tempest-VolumesMetadataTest-991668983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-26693166-f5f8-4689-9a64-e8a6d8a8f72e" returned: 0 in 0.302s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:16:43 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e7b6302c-a6b2-4ce0-bb9f-afafb905518a tempest-VolumesMetadataTest-991668983 None] Lock "cinder-quobyte-26693166-f5f8-4689-9a64-e8a6d8a8f72e" released by "delete_volume" :: held 0.756s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:16:43 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-e7b6302c-a6b2-4ce0-bb9f-afafb905518a tempest-VolumesMetadataTest-991668983 None] Created reservations ['655d84f1-7e00-4e40-97e2-66aba3f3b20c', '8d14781d-4977-4968-8c62-c8885b676c28', '1af585cd-d01e-46ee-93e3-529564a92e6c', '0d691531-255c-40a4-a01d-013cde9728e1'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:16:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e7b6302c-a6b2-4ce0-bb9f-afafb905518a tempest-VolumesMetadataTest-991668983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:16:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e7b6302c-a6b2-4ce0-bb9f-afafb905518a tempest-VolumesMetadataTest-991668983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:16:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e7b6302c-a6b2-4ce0-bb9f-afafb905518a tempest-VolumesMetadataTest-991668983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:16:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e7b6302c-a6b2-4ce0-bb9f-afafb905518a tempest-VolumesMetadataTest-991668983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:16:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e7b6302c-a6b2-4ce0-bb9f-afafb905518a tempest-VolumesMetadataTest-991668983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:16:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e7b6302c-a6b2-4ce0-bb9f-afafb905518a tempest-VolumesMetadataTest-991668983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:16:43 devstack sudo[94650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:16:43 devstack sudo[94650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:16:43 devstack sudo[94650]: pam_unix(sudo:session): session closed for user root Nov 04 12:16:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e7b6302c-a6b2-4ce0-bb9f-afafb905518a tempest-VolumesMetadataTest-991668983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.334s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:16:43 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-e7b6302c-a6b2-4ce0-bb9f-afafb905518a tempest-VolumesMetadataTest-991668983 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:16:44 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-e7b6302c-a6b2-4ce0-bb9f-afafb905518a tempest-VolumesMetadataTest-991668983 None] Deleted volume successfully. Nov 04 12:16:44 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e7b6302c-a6b2-4ce0-bb9f-afafb905518a tempest-VolumesMetadataTest-991668983 None] Lock "cinder-26693166-f5f8-4689-9a64-e8a6d8a8f72e-delete_volume" released by "delete_volume" :: held 1.401s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:16:48 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0c6ee0d-6290-40a7-84a2-64cb59e73905 tempest-AbsoluteLimitsTests-464059362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:16:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c0c6ee0d-6290-40a7-84a2-64cb59e73905 tempest-AbsoluteLimitsTests-464059362 None] Flow 'volume_create_manager' (00cfc115-cf44-454a-8089-b675988f98d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:16:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c0c6ee0d-6290-40a7-84a2-64cb59e73905 tempest-AbsoluteLimitsTests-464059362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3374c2c2-7a95-41c7-96b1-cbf8ab004aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:16:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c0c6ee0d-6290-40a7-84a2-64cb59e73905 tempest-AbsoluteLimitsTests-464059362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3374c2c2-7a95-41c7-96b1-cbf8ab004aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:16:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1010532621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3697210-d24d-4061-8170-7e66266645d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41b4388e48ba49c19dc0c661e796efb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:16:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:16:49Z,use_quota=True,user_id='74d6ad2768204afb979476ce7918f11f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:16:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c0c6ee0d-6290-40a7-84a2-64cb59e73905 tempest-AbsoluteLimitsTests-464059362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72620c56-e450-4fd0-94a8-09b476cc2160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:16:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c0c6ee0d-6290-40a7-84a2-64cb59e73905 tempest-AbsoluteLimitsTests-464059362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72620c56-e450-4fd0-94a8-09b476cc2160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:16:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c0c6ee0d-6290-40a7-84a2-64cb59e73905 tempest-AbsoluteLimitsTests-464059362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26c6bdfb-1cdd-4821-b6e5-1a5162ecea92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:16:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c0c6ee0d-6290-40a7-84a2-64cb59e73905 tempest-AbsoluteLimitsTests-464059362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26c6bdfb-1cdd-4821-b6e5-1a5162ecea92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3697210-d24d-4061-8170-7e66266645d1', 'volume_name': 'volume-b3697210-d24d-4061-8170-7e66266645d1', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:16:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c0c6ee0d-6290-40a7-84a2-64cb59e73905 tempest-AbsoluteLimitsTests-464059362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a286d45a-488a-41dc-9f1b-31108b63492f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:16:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c0c6ee0d-6290-40a7-84a2-64cb59e73905 tempest-AbsoluteLimitsTests-464059362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a286d45a-488a-41dc-9f1b-31108b63492f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:16:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c0c6ee0d-6290-40a7-84a2-64cb59e73905 tempest-AbsoluteLimitsTests-464059362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fddce0d-756d-43e8-a370-a49e26d6f885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:16:48 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-c0c6ee0d-6290-40a7-84a2-64cb59e73905 tempest-AbsoluteLimitsTests-464059362 None] Volume b3697210-d24d-4061-8170-7e66266645d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3697210-d24d-4061-8170-7e66266645d1', 'volume_size': 1} Nov 04 12:16:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c0c6ee0d-6290-40a7-84a2-64cb59e73905 tempest-AbsoluteLimitsTests-464059362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:16:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c0c6ee0d-6290-40a7-84a2-64cb59e73905 tempest-AbsoluteLimitsTests-464059362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:16:48 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c0c6ee0d-6290-40a7-84a2-64cb59e73905 tempest-AbsoluteLimitsTests-464059362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:16:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1010532621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3697210-d24d-4061-8170-7e66266645d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41b4388e48ba49c19dc0c661e796efb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:16:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:16:49Z,use_quota=True,user_id='74d6ad2768204afb979476ce7918f11f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:16:48 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-c0c6ee0d-6290-40a7-84a2-64cb59e73905 tempest-AbsoluteLimitsTests-464059362 None] Creating volume b3697210-d24d-4061-8170-7e66266645d1 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:16:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c0c6ee0d-6290-40a7-84a2-64cb59e73905 tempest-AbsoluteLimitsTests-464059362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:16:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c0c6ee0d-6290-40a7-84a2-64cb59e73905 tempest-AbsoluteLimitsTests-464059362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:16:48 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c0c6ee0d-6290-40a7-84a2-64cb59e73905 tempest-AbsoluteLimitsTests-464059362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:16:48 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c0c6ee0d-6290-40a7-84a2-64cb59e73905 tempest-AbsoluteLimitsTests-464059362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:16:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c0c6ee0d-6290-40a7-84a2-64cb59e73905 tempest-AbsoluteLimitsTests-464059362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:16:48 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c0c6ee0d-6290-40a7-84a2-64cb59e73905 tempest-AbsoluteLimitsTests-464059362 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:16:48 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-c0c6ee0d-6290-40a7-84a2-64cb59e73905 tempest-AbsoluteLimitsTests-464059362 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:16:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c0c6ee0d-6290-40a7-84a2-64cb59e73905 tempest-AbsoluteLimitsTests-464059362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b3697210-d24d-4061-8170-7e66266645d1 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:16:48 devstack sudo[94657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b3697210-d24d-4061-8170-7e66266645d1 1073741824 Nov 04 12:16:48 devstack sudo[94657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:16:49 devstack sudo[94657]: pam_unix(sudo:session): session closed for user root Nov 04 12:16:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c0c6ee0d-6290-40a7-84a2-64cb59e73905 tempest-AbsoluteLimitsTests-464059362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b3697210-d24d-4061-8170-7e66266645d1 1073741824" returned: 0 in 0.640s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:16:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c0c6ee0d-6290-40a7-84a2-64cb59e73905 tempest-AbsoluteLimitsTests-464059362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b3697210-d24d-4061-8170-7e66266645d1 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:16:49 devstack sudo[94663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b3697210-d24d-4061-8170-7e66266645d1 Nov 04 12:16:49 devstack sudo[94663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:16:49 devstack sudo[94663]: pam_unix(sudo:session): session closed for user root Nov 04 12:16:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c0c6ee0d-6290-40a7-84a2-64cb59e73905 tempest-AbsoluteLimitsTests-464059362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b3697210-d24d-4061-8170-7e66266645d1" returned: 0 in 0.336s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:16:49 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c0c6ee0d-6290-40a7-84a2-64cb59e73905 tempest-AbsoluteLimitsTests-464059362 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:16:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c0c6ee0d-6290-40a7-84a2-64cb59e73905 tempest-AbsoluteLimitsTests-464059362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:16:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c0c6ee0d-6290-40a7-84a2-64cb59e73905 tempest-AbsoluteLimitsTests-464059362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fddce0d-756d-43e8-a370-a49e26d6f885) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3697210-d24d-4061-8170-7e66266645d1', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:16:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c0c6ee0d-6290-40a7-84a2-64cb59e73905 tempest-AbsoluteLimitsTests-464059362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dfab8f6-6af3-4b42-9505-f98990820085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:16:49 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-c0c6ee0d-6290-40a7-84a2-64cb59e73905 tempest-AbsoluteLimitsTests-464059362 None] Volume volume-b3697210-d24d-4061-8170-7e66266645d1 (b3697210-d24d-4061-8170-7e66266645d1): created successfully Nov 04 12:16:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c0c6ee0d-6290-40a7-84a2-64cb59e73905 tempest-AbsoluteLimitsTests-464059362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dfab8f6-6af3-4b42-9505-f98990820085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:16:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c0c6ee0d-6290-40a7-84a2-64cb59e73905 tempest-AbsoluteLimitsTests-464059362 None] Flow 'volume_create_manager' (00cfc115-cf44-454a-8089-b675988f98d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:16:49 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-c0c6ee0d-6290-40a7-84a2-64cb59e73905 tempest-AbsoluteLimitsTests-464059362 None] Created volume successfully. Nov 04 12:16:50 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-74b83c1d-ac6a-43a4-827c-354736849c89 tempest-VolumesCloneTest-1305397264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:16:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-74b83c1d-ac6a-43a4-827c-354736849c89 tempest-VolumesCloneTest-1305397264 None] Flow 'volume_create_manager' (482b52d8-ca34-4fc2-8f5d-c37be0f3cfc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:16:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-74b83c1d-ac6a-43a4-827c-354736849c89 tempest-VolumesCloneTest-1305397264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd70a2c0-0e8e-4541-b66d-5e5658e90101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:16:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-74b83c1d-ac6a-43a4-827c-354736849c89 tempest-VolumesCloneTest-1305397264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd70a2c0-0e8e-4541-b66d-5e5658e90101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:16:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1788192141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da414b4b-eacd-48ad-8c35-5dce9432bb1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aae200742307493eb50bf7854fb86b39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:16:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:16:50Z,use_quota=True,user_id='42d8c14a4fe843f5ac3df745437c1be3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:16:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-74b83c1d-ac6a-43a4-827c-354736849c89 tempest-VolumesCloneTest-1305397264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (633c5cc7-6897-4d31-b9df-7a6364ec1b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:16:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-74b83c1d-ac6a-43a4-827c-354736849c89 tempest-VolumesCloneTest-1305397264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (633c5cc7-6897-4d31-b9df-7a6364ec1b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:16:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-74b83c1d-ac6a-43a4-827c-354736849c89 tempest-VolumesCloneTest-1305397264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1a6c0bb-0479-447e-98ae-a47f61890fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:16:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-74b83c1d-ac6a-43a4-827c-354736849c89 tempest-VolumesCloneTest-1305397264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1a6c0bb-0479-447e-98ae-a47f61890fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da414b4b-eacd-48ad-8c35-5dce9432bb1c', 'volume_name': 'volume-da414b4b-eacd-48ad-8c35-5dce9432bb1c', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:16:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-74b83c1d-ac6a-43a4-827c-354736849c89 tempest-VolumesCloneTest-1305397264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd607ed9-d1e1-44d4-b4f3-ef234baac40a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:16:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-74b83c1d-ac6a-43a4-827c-354736849c89 tempest-VolumesCloneTest-1305397264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd607ed9-d1e1-44d4-b4f3-ef234baac40a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:16:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-74b83c1d-ac6a-43a4-827c-354736849c89 tempest-VolumesCloneTest-1305397264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f85a0e0-238f-415f-aa17-69c03ca3aa55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:16:50 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-74b83c1d-ac6a-43a4-827c-354736849c89 tempest-VolumesCloneTest-1305397264 None] Volume da414b4b-eacd-48ad-8c35-5dce9432bb1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da414b4b-eacd-48ad-8c35-5dce9432bb1c', 'volume_size': 1} Nov 04 12:16:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-74b83c1d-ac6a-43a4-827c-354736849c89 tempest-VolumesCloneTest-1305397264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:16:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-74b83c1d-ac6a-43a4-827c-354736849c89 tempest-VolumesCloneTest-1305397264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:16:50 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-74b83c1d-ac6a-43a4-827c-354736849c89 tempest-VolumesCloneTest-1305397264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:16:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1788192141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da414b4b-eacd-48ad-8c35-5dce9432bb1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aae200742307493eb50bf7854fb86b39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:16:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:16:50Z,use_quota=True,user_id='42d8c14a4fe843f5ac3df745437c1be3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:16:50 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-74b83c1d-ac6a-43a4-827c-354736849c89 tempest-VolumesCloneTest-1305397264 None] Creating volume da414b4b-eacd-48ad-8c35-5dce9432bb1c {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:16:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-74b83c1d-ac6a-43a4-827c-354736849c89 tempest-VolumesCloneTest-1305397264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:16:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-74b83c1d-ac6a-43a4-827c-354736849c89 tempest-VolumesCloneTest-1305397264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:16:50 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-74b83c1d-ac6a-43a4-827c-354736849c89 tempest-VolumesCloneTest-1305397264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:16:50 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-74b83c1d-ac6a-43a4-827c-354736849c89 tempest-VolumesCloneTest-1305397264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:16:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-74b83c1d-ac6a-43a4-827c-354736849c89 tempest-VolumesCloneTest-1305397264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:16:50 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-74b83c1d-ac6a-43a4-827c-354736849c89 tempest-VolumesCloneTest-1305397264 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:16:50 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-74b83c1d-ac6a-43a4-827c-354736849c89 tempest-VolumesCloneTest-1305397264 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:16:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-74b83c1d-ac6a-43a4-827c-354736849c89 tempest-VolumesCloneTest-1305397264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-da414b4b-eacd-48ad-8c35-5dce9432bb1c 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:16:50 devstack sudo[94666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-da414b4b-eacd-48ad-8c35-5dce9432bb1c 1073741824 Nov 04 12:16:50 devstack sudo[94666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:16:51 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ef57af9b-8a6e-4200-8291-38d6d98a793a tempest-AbsoluteLimitsTests-464059362 None] Acquiring lock "cinder-b3697210-d24d-4061-8170-7e66266645d1-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:16:51 devstack sudo[94666]: pam_unix(sudo:session): session closed for user root Nov 04 12:16:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-74b83c1d-ac6a-43a4-827c-354736849c89 tempest-VolumesCloneTest-1305397264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-da414b4b-eacd-48ad-8c35-5dce9432bb1c 1073741824" returned: 0 in 0.691s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:16:51 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ef57af9b-8a6e-4200-8291-38d6d98a793a tempest-AbsoluteLimitsTests-464059362 None] Lock "cinder-b3697210-d24d-4061-8170-7e66266645d1-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:16:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-74b83c1d-ac6a-43a4-827c-354736849c89 tempest-VolumesCloneTest-1305397264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-da414b4b-eacd-48ad-8c35-5dce9432bb1c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:16:51 devstack sudo[94671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-da414b4b-eacd-48ad-8c35-5dce9432bb1c Nov 04 12:16:51 devstack sudo[94671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:16:51 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ef57af9b-8a6e-4200-8291-38d6d98a793a tempest-AbsoluteLimitsTests-464059362 None] Acquiring lock "cinder-quobyte-b3697210-d24d-4061-8170-7e66266645d1" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:16:51 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ef57af9b-8a6e-4200-8291-38d6d98a793a tempest-AbsoluteLimitsTests-464059362 None] Lock "cinder-quobyte-b3697210-d24d-4061-8170-7e66266645d1" acquired by "delete_volume" :: waited 0.026s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:16:51 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad5ea3d-28e2-41af-becb-985fdfddbab9]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:16:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ef57af9b-8a6e-4200-8291-38d6d98a793a tempest-AbsoluteLimitsTests-464059362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b3697210-d24d-4061-8170-7e66266645d1 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:16:51 devstack sudo[94673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b3697210-d24d-4061-8170-7e66266645d1 Nov 04 12:16:51 devstack sudo[94673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:16:51 devstack sudo[94671]: pam_unix(sudo:session): session closed for user root Nov 04 12:16:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-74b83c1d-ac6a-43a4-827c-354736849c89 tempest-VolumesCloneTest-1305397264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-da414b4b-eacd-48ad-8c35-5dce9432bb1c" returned: 0 in 0.330s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:16:51 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-74b83c1d-ac6a-43a4-827c-354736849c89 tempest-VolumesCloneTest-1305397264 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:16:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-74b83c1d-ac6a-43a4-827c-354736849c89 tempest-VolumesCloneTest-1305397264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.126s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:16:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-74b83c1d-ac6a-43a4-827c-354736849c89 tempest-VolumesCloneTest-1305397264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f85a0e0-238f-415f-aa17-69c03ca3aa55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da414b4b-eacd-48ad-8c35-5dce9432bb1c', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:16:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-74b83c1d-ac6a-43a4-827c-354736849c89 tempest-VolumesCloneTest-1305397264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e064125-f3ec-4d40-8da0-e29854a3b63c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:16:51 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-74b83c1d-ac6a-43a4-827c-354736849c89 tempest-VolumesCloneTest-1305397264 None] Volume volume-da414b4b-eacd-48ad-8c35-5dce9432bb1c (da414b4b-eacd-48ad-8c35-5dce9432bb1c): created successfully Nov 04 12:16:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-74b83c1d-ac6a-43a4-827c-354736849c89 tempest-VolumesCloneTest-1305397264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e064125-f3ec-4d40-8da0-e29854a3b63c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:16:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-74b83c1d-ac6a-43a4-827c-354736849c89 tempest-VolumesCloneTest-1305397264 None] Flow 'volume_create_manager' (482b52d8-ca34-4fc2-8f5d-c37be0f3cfc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:16:51 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-74b83c1d-ac6a-43a4-827c-354736849c89 tempest-VolumesCloneTest-1305397264 None] Created volume successfully. Nov 04 12:16:51 devstack sudo[94673]: pam_unix(sudo:session): session closed for user root Nov 04 12:16:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ef57af9b-8a6e-4200-8291-38d6d98a793a tempest-AbsoluteLimitsTests-464059362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b3697210-d24d-4061-8170-7e66266645d1" returned: 0 in 0.483s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:16:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ef57af9b-8a6e-4200-8291-38d6d98a793a tempest-AbsoluteLimitsTests-464059362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b3697210-d24d-4061-8170-7e66266645d1 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:16:52 devstack sudo[94680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b3697210-d24d-4061-8170-7e66266645d1 Nov 04 12:16:52 devstack sudo[94680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:16:52 devstack sudo[94680]: pam_unix(sudo:session): session closed for user root Nov 04 12:16:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ef57af9b-8a6e-4200-8291-38d6d98a793a tempest-AbsoluteLimitsTests-464059362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b3697210-d24d-4061-8170-7e66266645d1" returned: 0 in 0.286s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:16:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ef57af9b-8a6e-4200-8291-38d6d98a793a tempest-AbsoluteLimitsTests-464059362 None] Lock "cinder-quobyte-b3697210-d24d-4061-8170-7e66266645d1" released by "delete_volume" :: held 0.844s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:16:52 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-ef57af9b-8a6e-4200-8291-38d6d98a793a tempest-AbsoluteLimitsTests-464059362 None] Created reservations ['efff572a-d5d3-4c12-80f7-851f0686bb44', '6d6988d6-cc1e-4f55-8376-7289c01afd79', '40913a5e-5869-4b69-ba3a-7955f1a1140f', 'c87f9ba1-6409-4d33-ab1b-ef4c1f554609'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:16:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ef57af9b-8a6e-4200-8291-38d6d98a793a tempest-AbsoluteLimitsTests-464059362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:16:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ef57af9b-8a6e-4200-8291-38d6d98a793a tempest-AbsoluteLimitsTests-464059362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:16:52 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ef57af9b-8a6e-4200-8291-38d6d98a793a tempest-AbsoluteLimitsTests-464059362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:16:52 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ef57af9b-8a6e-4200-8291-38d6d98a793a tempest-AbsoluteLimitsTests-464059362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:16:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ef57af9b-8a6e-4200-8291-38d6d98a793a tempest-AbsoluteLimitsTests-464059362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:16:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ef57af9b-8a6e-4200-8291-38d6d98a793a tempest-AbsoluteLimitsTests-464059362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:16:52 devstack sudo[94683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:16:52 devstack sudo[94683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:16:52 devstack sudo[94683]: pam_unix(sudo:session): session closed for user root Nov 04 12:16:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ef57af9b-8a6e-4200-8291-38d6d98a793a tempest-AbsoluteLimitsTests-464059362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.332s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:16:52 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-ef57af9b-8a6e-4200-8291-38d6d98a793a tempest-AbsoluteLimitsTests-464059362 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:16:52 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-ef57af9b-8a6e-4200-8291-38d6d98a793a tempest-AbsoluteLimitsTests-464059362 None] Deleted volume successfully. Nov 04 12:16:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ef57af9b-8a6e-4200-8291-38d6d98a793a tempest-AbsoluteLimitsTests-464059362 None] Lock "cinder-b3697210-d24d-4061-8170-7e66266645d1-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:16:53 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f70f2e4-10e0-47d1-a3b6-94078e1ac5c6 tempest-VolumesCloneTest-1305397264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:16:53 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9f70f2e4-10e0-47d1-a3b6-94078e1ac5c6 tempest-VolumesCloneTest-1305397264 None] Flow 'volume_create_manager' (3b352298-0c8c-4c1e-bc32-8e9a56d760be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:16:53 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9f70f2e4-10e0-47d1-a3b6-94078e1ac5c6 tempest-VolumesCloneTest-1305397264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a237bcc3-c458-4744-b8a5-0e692d1d4e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:16:53 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9f70f2e4-10e0-47d1-a3b6-94078e1ac5c6 tempest-VolumesCloneTest-1305397264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a237bcc3-c458-4744-b8a5-0e692d1d4e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:16:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-4995044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd770513-76c8-433f-a252-9e6822d91b40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aae200742307493eb50bf7854fb86b39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:16:53Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=da414b4b-eacd-48ad-8c35-5dce9432bb1c,status='creating',terminated_at=None,updated_at=2026-11-04T11:16:53Z,use_quota=True,user_id='42d8c14a4fe843f5ac3df745437c1be3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:16:53 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9f70f2e4-10e0-47d1-a3b6-94078e1ac5c6 tempest-VolumesCloneTest-1305397264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ea739d3-4837-4171-85c9-0aa1612db5ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:16:53 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9f70f2e4-10e0-47d1-a3b6-94078e1ac5c6 tempest-VolumesCloneTest-1305397264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ea739d3-4837-4171-85c9-0aa1612db5ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:16:53 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9f70f2e4-10e0-47d1-a3b6-94078e1ac5c6 tempest-VolumesCloneTest-1305397264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f08fafab-5049-44e0-be59-e1c841f950a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:16:53 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9f70f2e4-10e0-47d1-a3b6-94078e1ac5c6 tempest-VolumesCloneTest-1305397264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f08fafab-5049-44e0-be59-e1c841f950a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'cd770513-76c8-433f-a252-9e6822d91b40', 'volume_name': 'volume-cd770513-76c8-433f-a252-9e6822d91b40', 'volume_size': 2, 'source_volid': 'da414b4b-eacd-48ad-8c35-5dce9432bb1c', 'source_volstatus': 'available'}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:16:53 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9f70f2e4-10e0-47d1-a3b6-94078e1ac5c6 tempest-VolumesCloneTest-1305397264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4741473f-d5c2-4f95-8642-769f4d6882e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:16:53 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9f70f2e4-10e0-47d1-a3b6-94078e1ac5c6 tempest-VolumesCloneTest-1305397264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4741473f-d5c2-4f95-8642-769f4d6882e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:16:53 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9f70f2e4-10e0-47d1-a3b6-94078e1ac5c6 tempest-VolumesCloneTest-1305397264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c195b33-3df1-4043-ad76-b529d9b79af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:16:53 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-9f70f2e4-10e0-47d1-a3b6-94078e1ac5c6 tempest-VolumesCloneTest-1305397264 None] Volume cd770513-76c8-433f-a252-9e6822d91b40: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-cd770513-76c8-433f-a252-9e6822d91b40', 'volume_size': 2, 'source_volid': 'da414b4b-eacd-48ad-8c35-5dce9432bb1c', 'source_volstatus': 'available'} Nov 04 12:16:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9f70f2e4-10e0-47d1-a3b6-94078e1ac5c6 tempest-VolumesCloneTest-1305397264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:16:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9f70f2e4-10e0-47d1-a3b6-94078e1ac5c6 tempest-VolumesCloneTest-1305397264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:16:53 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-9f70f2e4-10e0-47d1-a3b6-94078e1ac5c6 tempest-VolumesCloneTest-1305397264 None] Cloning volume da414b4b-eacd-48ad-8c35-5dce9432bb1c to volume cd770513-76c8-433f-a252-9e6822d91b40 Nov 04 12:16:53 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-9f70f2e4-10e0-47d1-a3b6-94078e1ac5c6 tempest-VolumesCloneTest-1305397264 None] Creating offline snapshot 8cf9b7c7-e486-4812-af9e-9cbbda743a07 of volume da414b4b-eacd-48ad-8c35-5dce9432bb1c {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 12:16:53 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f7c866-3b9e-40b6-9295-03e82ca3bc5b]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:16:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9f70f2e4-10e0-47d1-a3b6-94078e1ac5c6 tempest-VolumesCloneTest-1305397264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-da414b4b-eacd-48ad-8c35-5dce9432bb1c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:16:53 devstack sudo[94687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-da414b4b-eacd-48ad-8c35-5dce9432bb1c Nov 04 12:16:53 devstack sudo[94687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:16:54 devstack sudo[94687]: pam_unix(sudo:session): session closed for user root Nov 04 12:16:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9f70f2e4-10e0-47d1-a3b6-94078e1ac5c6 tempest-VolumesCloneTest-1305397264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-da414b4b-eacd-48ad-8c35-5dce9432bb1c" returned: 0 in 0.407s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:16:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9f70f2e4-10e0-47d1-a3b6-94078e1ac5c6 tempest-VolumesCloneTest-1305397264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-da414b4b-eacd-48ad-8c35-5dce9432bb1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-da414b4b-eacd-48ad-8c35-5dce9432bb1c.8cf9b7c7-e486-4812-af9e-9cbbda743a07 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:16:54 devstack sudo[94693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-da414b4b-eacd-48ad-8c35-5dce9432bb1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-da414b4b-eacd-48ad-8c35-5dce9432bb1c.8cf9b7c7-e486-4812-af9e-9cbbda743a07 1G Nov 04 12:16:54 devstack sudo[94693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:16:54 devstack sudo[94693]: pam_unix(sudo:session): session closed for user root Nov 04 12:16:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9f70f2e4-10e0-47d1-a3b6-94078e1ac5c6 tempest-VolumesCloneTest-1305397264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-da414b4b-eacd-48ad-8c35-5dce9432bb1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-da414b4b-eacd-48ad-8c35-5dce9432bb1c.8cf9b7c7-e486-4812-af9e-9cbbda743a07 1G" returned: 0 in 0.533s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:16:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9f70f2e4-10e0-47d1-a3b6-94078e1ac5c6 tempest-VolumesCloneTest-1305397264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da414b4b-eacd-48ad-8c35-5dce9432bb1c -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-da414b4b-eacd-48ad-8c35-5dce9432bb1c.8cf9b7c7-e486-4812-af9e-9cbbda743a07 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:16:54 devstack sudo[94699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da414b4b-eacd-48ad-8c35-5dce9432bb1c -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-da414b4b-eacd-48ad-8c35-5dce9432bb1c.8cf9b7c7-e486-4812-af9e-9cbbda743a07 Nov 04 12:16:54 devstack sudo[94699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:16:54 devstack sudo[94699]: pam_unix(sudo:session): session closed for user root Nov 04 12:16:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9f70f2e4-10e0-47d1-a3b6-94078e1ac5c6 tempest-VolumesCloneTest-1305397264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da414b4b-eacd-48ad-8c35-5dce9432bb1c -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-da414b4b-eacd-48ad-8c35-5dce9432bb1c.8cf9b7c7-e486-4812-af9e-9cbbda743a07" returned: 0 in 0.375s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:16:54 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-9f70f2e4-10e0-47d1-a3b6-94078e1ac5c6 tempest-VolumesCloneTest-1305397264 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-da414b4b-eacd-48ad-8c35-5dce9432bb1c.8cf9b7c7-e486-4812-af9e-9cbbda743a07 is being set with open permissions: ugo+rw Nov 04 12:16:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9f70f2e4-10e0-47d1-a3b6-94078e1ac5c6 tempest-VolumesCloneTest-1305397264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-da414b4b-eacd-48ad-8c35-5dce9432bb1c.8cf9b7c7-e486-4812-af9e-9cbbda743a07 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:16:55 devstack sudo[94705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-da414b4b-eacd-48ad-8c35-5dce9432bb1c.8cf9b7c7-e486-4812-af9e-9cbbda743a07 Nov 04 12:16:55 devstack sudo[94705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:16:55 devstack sudo[94705]: pam_unix(sudo:session): session closed for user root Nov 04 12:16:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9f70f2e4-10e0-47d1-a3b6-94078e1ac5c6 tempest-VolumesCloneTest-1305397264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-da414b4b-eacd-48ad-8c35-5dce9432bb1c.8cf9b7c7-e486-4812-af9e-9cbbda743a07" returned: 0 in 0.297s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:16:55 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:INSERT=33,cinder:SELECT=103,cinder:UPDATE=117,cinder:DELETE=7 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 12:16:55 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=99,cinder:UPDATE=123,cinder:DELETE=12,cinder:INSERT=34 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 12:16:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9f70f2e4-10e0-47d1-a3b6-94078e1ac5c6 tempest-VolumesCloneTest-1305397264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-da414b4b-eacd-48ad-8c35-5dce9432bb1c.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:16:55 devstack sudo[94708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-da414b4b-eacd-48ad-8c35-5dce9432bb1c.info Nov 04 12:16:55 devstack sudo[94708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:16:55 devstack sudo[94708]: pam_unix(sudo:session): session closed for user root Nov 04 12:16:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9f70f2e4-10e0-47d1-a3b6-94078e1ac5c6 tempest-VolumesCloneTest-1305397264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-da414b4b-eacd-48ad-8c35-5dce9432bb1c.info" returned: 0 in 0.307s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:16:55 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-9f70f2e4-10e0-47d1-a3b6-94078e1ac5c6 tempest-VolumesCloneTest-1305397264 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-da414b4b-eacd-48ad-8c35-5dce9432bb1c.info is being set with open permissions: ugo+rw Nov 04 12:16:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9f70f2e4-10e0-47d1-a3b6-94078e1ac5c6 tempest-VolumesCloneTest-1305397264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-da414b4b-eacd-48ad-8c35-5dce9432bb1c.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:16:55 devstack sudo[94711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-da414b4b-eacd-48ad-8c35-5dce9432bb1c.info Nov 04 12:16:55 devstack sudo[94711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:16:55 devstack sudo[94711]: pam_unix(sudo:session): session closed for user root Nov 04 12:16:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9f70f2e4-10e0-47d1-a3b6-94078e1ac5c6 tempest-VolumesCloneTest-1305397264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-da414b4b-eacd-48ad-8c35-5dce9432bb1c.info" returned: 0 in 0.262s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:16:55 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9f70f2e4-10e0-47d1-a3b6-94078e1ac5c6 tempest-VolumesCloneTest-1305397264 None] Acquiring lock "cinder-quobyte-cd770513-76c8-433f-a252-9e6822d91b40" by "_copy_volume_from_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:16:55 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9f70f2e4-10e0-47d1-a3b6-94078e1ac5c6 tempest-VolumesCloneTest-1305397264 None] Lock "cinder-quobyte-cd770513-76c8-433f-a252-9e6822d91b40" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:16:55 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9f70f2e4-10e0-47d1-a3b6-94078e1ac5c6 tempest-VolumesCloneTest-1305397264 None] snapshot: 8cf9b7c7-e486-4812-af9e-9cbbda743a07, volume: cd770513-76c8-433f-a252-9e6822d91b40, {{(pid=87095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 12:16:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9f70f2e4-10e0-47d1-a3b6-94078e1ac5c6 tempest-VolumesCloneTest-1305397264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:16:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9f70f2e4-10e0-47d1-a3b6-94078e1ac5c6 tempest-VolumesCloneTest-1305397264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:16:55 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9f70f2e4-10e0-47d1-a3b6-94078e1ac5c6 tempest-VolumesCloneTest-1305397264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:16:55 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9f70f2e4-10e0-47d1-a3b6-94078e1ac5c6 tempest-VolumesCloneTest-1305397264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:16:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9f70f2e4-10e0-47d1-a3b6-94078e1ac5c6 tempest-VolumesCloneTest-1305397264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:16:55 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[394fcd9b-d31d-4a92-9042-0d605d23a6f1]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:16:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9f70f2e4-10e0-47d1-a3b6-94078e1ac5c6 tempest-VolumesCloneTest-1305397264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-da414b4b-eacd-48ad-8c35-5dce9432bb1c.8cf9b7c7-e486-4812-af9e-9cbbda743a07 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:16:56 devstack sudo[94714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-da414b4b-eacd-48ad-8c35-5dce9432bb1c.8cf9b7c7-e486-4812-af9e-9cbbda743a07 Nov 04 12:16:56 devstack sudo[94714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:16:56 devstack sudo[94714]: pam_unix(sudo:session): session closed for user root Nov 04 12:16:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9f70f2e4-10e0-47d1-a3b6-94078e1ac5c6 tempest-VolumesCloneTest-1305397264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-da414b4b-eacd-48ad-8c35-5dce9432bb1c.8cf9b7c7-e486-4812-af9e-9cbbda743a07" returned: 0 in 0.452s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:16:56 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-9f70f2e4-10e0-47d1-a3b6-94078e1ac5c6 tempest-VolumesCloneTest-1305397264 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da414b4b-eacd-48ad-8c35-5dce9432bb1c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 12:16:56 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4599b0ca-90d6-4321-9592-55ab08935db4]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:16:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9f70f2e4-10e0-47d1-a3b6-94078e1ac5c6 tempest-VolumesCloneTest-1305397264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-da414b4b-eacd-48ad-8c35-5dce9432bb1c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:16:56 devstack sudo[94719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-da414b4b-eacd-48ad-8c35-5dce9432bb1c Nov 04 12:16:56 devstack sudo[94719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:16:56 devstack sudo[94719]: pam_unix(sudo:session): session closed for user root Nov 04 12:16:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9f70f2e4-10e0-47d1-a3b6-94078e1ac5c6 tempest-VolumesCloneTest-1305397264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-da414b4b-eacd-48ad-8c35-5dce9432bb1c" returned: 0 in 0.403s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:16:56 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9f70f2e4-10e0-47d1-a3b6-94078e1ac5c6 tempest-VolumesCloneTest-1305397264 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-da414b4b-eacd-48ad-8c35-5dce9432bb1c {{(pid=87095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 12:16:56 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9f70f2e4-10e0-47d1-a3b6-94078e1ac5c6 tempest-VolumesCloneTest-1305397264 None] Creating direct copy from snapshot {{(pid=87095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 12:16:56 devstack cinder-volume[87095]: DEBUG cinder.utils [None req-9f70f2e4-10e0-47d1-a3b6-94078e1ac5c6 tempest-VolumesCloneTest-1305397264 None] Path /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cd770513-76c8-433f-a252-9e6822d91b40 not found in is_blk_device check {{(pid=87095) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 04 12:16:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9f70f2e4-10e0-47d1-a3b6-94078e1ac5c6 tempest-VolumesCloneTest-1305397264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-da414b4b-eacd-48ad-8c35-5dce9432bb1c /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cd770513-76c8-433f-a252-9e6822d91b40 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:16:56 devstack sudo[94724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-da414b4b-eacd-48ad-8c35-5dce9432bb1c /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cd770513-76c8-433f-a252-9e6822d91b40 Nov 04 12:16:56 devstack sudo[94724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:01 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 12:17:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:17:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:17:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:17:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:17:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:17:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:01 devstack sudo[94740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:17:01 devstack sudo[94740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:02 devstack sudo[94740]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.533s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:02 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:17:02 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Running periodic task VolumeManager._thread_info {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 12:17:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] thread count: 28 {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 12:17:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] thread info: [<_MainThread(MainThread, started 140610387472512)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 12:17:05 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=1,cinder:INSERT=1 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 12:17:05 devstack sudo[94724]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9f70f2e4-10e0-47d1-a3b6-94078e1ac5c6 tempest-VolumesCloneTest-1305397264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-da414b4b-eacd-48ad-8c35-5dce9432bb1c /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cd770513-76c8-433f-a252-9e6822d91b40" returned: 0 in 8.625s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:05 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-9f70f2e4-10e0-47d1-a3b6-94078e1ac5c6 tempest-VolumesCloneTest-1305397264 None] Image conversion details: src /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-da414b4b-eacd-48ad-8c35-5dce9432bb1c, size 1024.00 MB, duration 8.63 sec, destination /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cd770513-76c8-433f-a252-9e6822d91b40 {{(pid=87095) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 12:17:05 devstack cinder-volume[87095]: INFO cinder.image.image_utils [None req-9f70f2e4-10e0-47d1-a3b6-94078e1ac5c6 tempest-VolumesCloneTest-1305397264 None] Converted 1024.00 MB image at 118.71 MB/s Nov 04 12:17:05 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-9f70f2e4-10e0-47d1-a3b6-94078e1ac5c6 tempest-VolumesCloneTest-1305397264 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cd770513-76c8-433f-a252-9e6822d91b40 is being set with open permissions: ugo+rw Nov 04 12:17:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9f70f2e4-10e0-47d1-a3b6-94078e1ac5c6 tempest-VolumesCloneTest-1305397264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cd770513-76c8-433f-a252-9e6822d91b40 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:05 devstack sudo[94744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cd770513-76c8-433f-a252-9e6822d91b40 Nov 04 12:17:05 devstack sudo[94744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:05 devstack sudo[94744]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9f70f2e4-10e0-47d1-a3b6-94078e1ac5c6 tempest-VolumesCloneTest-1305397264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cd770513-76c8-433f-a252-9e6822d91b40" returned: 0 in 0.376s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:05 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9f70f2e4-10e0-47d1-a3b6-94078e1ac5c6 tempest-VolumesCloneTest-1305397264 None] Lock "cinder-quobyte-cd770513-76c8-433f-a252-9e6822d91b40" released by "_copy_volume_from_snapshot" :: held 9.960s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:17:05 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9f70f2e4-10e0-47d1-a3b6-94078e1ac5c6 tempest-VolumesCloneTest-1305397264 None] Acquiring lock "cinder-quobyte-8cf9b7c7-e486-4812-af9e-9cbbda743a07" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:17:05 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9f70f2e4-10e0-47d1-a3b6-94078e1ac5c6 tempest-VolumesCloneTest-1305397264 None] Lock "cinder-quobyte-8cf9b7c7-e486-4812-af9e-9cbbda743a07" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:17:05 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-9f70f2e4-10e0-47d1-a3b6-94078e1ac5c6 tempest-VolumesCloneTest-1305397264 None] Deleting offline snapshot 8cf9b7c7-e486-4812-af9e-9cbbda743a07 of volume da414b4b-eacd-48ad-8c35-5dce9432bb1c {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 12:17:05 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-9f70f2e4-10e0-47d1-a3b6-94078e1ac5c6 tempest-VolumesCloneTest-1305397264 None] snapshot_file for this snap is: volume-da414b4b-eacd-48ad-8c35-5dce9432bb1c.8cf9b7c7-e486-4812-af9e-9cbbda743a07 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 12:17:06 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9069553a-2f64-44b6-b6d0-820224dcde65]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:17:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9f70f2e4-10e0-47d1-a3b6-94078e1ac5c6 tempest-VolumesCloneTest-1305397264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-da414b4b-eacd-48ad-8c35-5dce9432bb1c.8cf9b7c7-e486-4812-af9e-9cbbda743a07 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:06 devstack sudo[94747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-da414b4b-eacd-48ad-8c35-5dce9432bb1c.8cf9b7c7-e486-4812-af9e-9cbbda743a07 Nov 04 12:17:06 devstack sudo[94747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:06 devstack sudo[94747]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9f70f2e4-10e0-47d1-a3b6-94078e1ac5c6 tempest-VolumesCloneTest-1305397264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-da414b4b-eacd-48ad-8c35-5dce9432bb1c.8cf9b7c7-e486-4812-af9e-9cbbda743a07" returned: 0 in 0.469s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:06 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-9f70f2e4-10e0-47d1-a3b6-94078e1ac5c6 tempest-VolumesCloneTest-1305397264 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da414b4b-eacd-48ad-8c35-5dce9432bb1c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 12:17:06 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c7e7f5-1531-43a4-bcd2-0422359c8276]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:17:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9f70f2e4-10e0-47d1-a3b6-94078e1ac5c6 tempest-VolumesCloneTest-1305397264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-da414b4b-eacd-48ad-8c35-5dce9432bb1c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:06 devstack sudo[94753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-da414b4b-eacd-48ad-8c35-5dce9432bb1c Nov 04 12:17:06 devstack sudo[94753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:07 devstack sudo[94753]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9f70f2e4-10e0-47d1-a3b6-94078e1ac5c6 tempest-VolumesCloneTest-1305397264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-da414b4b-eacd-48ad-8c35-5dce9432bb1c" returned: 0 in 0.839s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9f70f2e4-10e0-47d1-a3b6-94078e1ac5c6 tempest-VolumesCloneTest-1305397264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-da414b4b-eacd-48ad-8c35-5dce9432bb1c.8cf9b7c7-e486-4812-af9e-9cbbda743a07 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:07 devstack sudo[94759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-da414b4b-eacd-48ad-8c35-5dce9432bb1c.8cf9b7c7-e486-4812-af9e-9cbbda743a07 Nov 04 12:17:07 devstack sudo[94759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:07 devstack sudo[94759]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9f70f2e4-10e0-47d1-a3b6-94078e1ac5c6 tempest-VolumesCloneTest-1305397264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-da414b4b-eacd-48ad-8c35-5dce9432bb1c.8cf9b7c7-e486-4812-af9e-9cbbda743a07" returned: 0 in 0.524s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9f70f2e4-10e0-47d1-a3b6-94078e1ac5c6 tempest-VolumesCloneTest-1305397264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-da414b4b-eacd-48ad-8c35-5dce9432bb1c.8cf9b7c7-e486-4812-af9e-9cbbda743a07 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:07 devstack sudo[94764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-da414b4b-eacd-48ad-8c35-5dce9432bb1c.8cf9b7c7-e486-4812-af9e-9cbbda743a07 Nov 04 12:17:07 devstack sudo[94764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:08 devstack sudo[94764]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9f70f2e4-10e0-47d1-a3b6-94078e1ac5c6 tempest-VolumesCloneTest-1305397264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-da414b4b-eacd-48ad-8c35-5dce9432bb1c.8cf9b7c7-e486-4812-af9e-9cbbda743a07" returned: 0 in 0.401s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:08 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9f70f2e4-10e0-47d1-a3b6-94078e1ac5c6 tempest-VolumesCloneTest-1305397264 None] Lock "cinder-quobyte-8cf9b7c7-e486-4812-af9e-9cbbda743a07" released by "_delete_snapshot" :: held 2.413s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:17:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9f70f2e4-10e0-47d1-a3b6-94078e1ac5c6 tempest-VolumesCloneTest-1305397264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.826s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:17:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9f70f2e4-10e0-47d1-a3b6-94078e1ac5c6 tempest-VolumesCloneTest-1305397264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c195b33-3df1-4043-ad76-b529d9b79af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd770513-76c8-433f-a252-9e6822d91b40', 'volume_size': 2, 'source_volid': 'da414b4b-eacd-48ad-8c35-5dce9432bb1c', 'source_volstatus': 'available'}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:17:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9f70f2e4-10e0-47d1-a3b6-94078e1ac5c6 tempest-VolumesCloneTest-1305397264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c05aa90-c9d9-4806-8909-946ac5d73dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:17:08 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-9f70f2e4-10e0-47d1-a3b6-94078e1ac5c6 tempest-VolumesCloneTest-1305397264 None] Volume volume-cd770513-76c8-433f-a252-9e6822d91b40 (cd770513-76c8-433f-a252-9e6822d91b40): created successfully Nov 04 12:17:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9f70f2e4-10e0-47d1-a3b6-94078e1ac5c6 tempest-VolumesCloneTest-1305397264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c05aa90-c9d9-4806-8909-946ac5d73dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:17:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9f70f2e4-10e0-47d1-a3b6-94078e1ac5c6 tempest-VolumesCloneTest-1305397264 None] Flow 'volume_create_manager' (3b352298-0c8c-4c1e-bc32-8e9a56d760be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:17:08 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-9f70f2e4-10e0-47d1-a3b6-94078e1ac5c6 tempest-VolumesCloneTest-1305397264 None] Created volume successfully. Nov 04 12:17:09 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9fc7157c-e017-4eba-aca1-f487e1fccc2f tempest-VolumesCloneTest-1305397264 None] Acquiring lock "cinder-cd770513-76c8-433f-a252-9e6822d91b40-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:17:09 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9fc7157c-e017-4eba-aca1-f487e1fccc2f tempest-VolumesCloneTest-1305397264 None] Lock "cinder-cd770513-76c8-433f-a252-9e6822d91b40-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:17:09 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9fc7157c-e017-4eba-aca1-f487e1fccc2f tempest-VolumesCloneTest-1305397264 None] Acquiring lock "cinder-quobyte-cd770513-76c8-433f-a252-9e6822d91b40" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:17:09 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9fc7157c-e017-4eba-aca1-f487e1fccc2f tempest-VolumesCloneTest-1305397264 None] Lock "cinder-quobyte-cd770513-76c8-433f-a252-9e6822d91b40" acquired by "delete_volume" :: waited 0.024s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:17:09 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c53c10-e480-4222-b1ab-0a73d433a922]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:17:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9fc7157c-e017-4eba-aca1-f487e1fccc2f tempest-VolumesCloneTest-1305397264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cd770513-76c8-433f-a252-9e6822d91b40 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:09 devstack sudo[94767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cd770513-76c8-433f-a252-9e6822d91b40 Nov 04 12:17:09 devstack sudo[94767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:10 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2d9d8e1-78f8-43ef-8276-eae727529062 tempest-VolumesGetTest-543965088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:17:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a2d9d8e1-78f8-43ef-8276-eae727529062 tempest-VolumesGetTest-543965088 None] Flow 'volume_create_manager' (5fd45cca-59ea-4910-ad25-3b1cf4c06a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:17:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a2d9d8e1-78f8-43ef-8276-eae727529062 tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b07c5af-852d-4a42-bba2-e37c8d94d6f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:17:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a2d9d8e1-78f8-43ef-8276-eae727529062 tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b07c5af-852d-4a42-bba2-e37c8d94d6f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:17:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-18221453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38968aed-67bf-43af-b13f-3775c3cb337f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='49933e1eef4b45629df206d9a70d2739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:17:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:17:10Z,use_quota=True,user_id='916d8be431be4dab84c49f86dfb5372e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:17:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a2d9d8e1-78f8-43ef-8276-eae727529062 tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebd01fed-e967-4e49-ad72-a2fd8b2f49b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:17:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a2d9d8e1-78f8-43ef-8276-eae727529062 tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebd01fed-e967-4e49-ad72-a2fd8b2f49b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:17:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a2d9d8e1-78f8-43ef-8276-eae727529062 tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6cbaa95-feae-4bc7-b4f7-2ab98c5ff3e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:17:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a2d9d8e1-78f8-43ef-8276-eae727529062 tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6cbaa95-feae-4bc7-b4f7-2ab98c5ff3e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38968aed-67bf-43af-b13f-3775c3cb337f', 'volume_name': 'volume-38968aed-67bf-43af-b13f-3775c3cb337f', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:17:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a2d9d8e1-78f8-43ef-8276-eae727529062 tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e11bafc8-5bdf-4ae9-944a-757cf174129c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:17:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a2d9d8e1-78f8-43ef-8276-eae727529062 tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e11bafc8-5bdf-4ae9-944a-757cf174129c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:17:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a2d9d8e1-78f8-43ef-8276-eae727529062 tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f9b6395-48f9-4453-a2d2-fb7dcb681131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:17:10 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-a2d9d8e1-78f8-43ef-8276-eae727529062 tempest-VolumesGetTest-543965088 None] Volume 38968aed-67bf-43af-b13f-3775c3cb337f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38968aed-67bf-43af-b13f-3775c3cb337f', 'volume_size': 1} Nov 04 12:17:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a2d9d8e1-78f8-43ef-8276-eae727529062 tempest-VolumesGetTest-543965088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:17:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a2d9d8e1-78f8-43ef-8276-eae727529062 tempest-VolumesGetTest-543965088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:17:10 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a2d9d8e1-78f8-43ef-8276-eae727529062 tempest-VolumesGetTest-543965088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:17:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-18221453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38968aed-67bf-43af-b13f-3775c3cb337f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='49933e1eef4b45629df206d9a70d2739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:17:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:17:10Z,use_quota=True,user_id='916d8be431be4dab84c49f86dfb5372e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:17:10 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-a2d9d8e1-78f8-43ef-8276-eae727529062 tempest-VolumesGetTest-543965088 None] Creating volume 38968aed-67bf-43af-b13f-3775c3cb337f {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:17:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a2d9d8e1-78f8-43ef-8276-eae727529062 tempest-VolumesGetTest-543965088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:17:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a2d9d8e1-78f8-43ef-8276-eae727529062 tempest-VolumesGetTest-543965088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:17:10 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a2d9d8e1-78f8-43ef-8276-eae727529062 tempest-VolumesGetTest-543965088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:17:10 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a2d9d8e1-78f8-43ef-8276-eae727529062 tempest-VolumesGetTest-543965088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:17:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a2d9d8e1-78f8-43ef-8276-eae727529062 tempest-VolumesGetTest-543965088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:17:10 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a2d9d8e1-78f8-43ef-8276-eae727529062 tempest-VolumesGetTest-543965088 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:17:10 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-a2d9d8e1-78f8-43ef-8276-eae727529062 tempest-VolumesGetTest-543965088 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:17:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a2d9d8e1-78f8-43ef-8276-eae727529062 tempest-VolumesGetTest-543965088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-38968aed-67bf-43af-b13f-3775c3cb337f 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:10 devstack sudo[94771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-38968aed-67bf-43af-b13f-3775c3cb337f 1073741824 Nov 04 12:17:10 devstack sudo[94771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:10 devstack sudo[94767]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9fc7157c-e017-4eba-aca1-f487e1fccc2f tempest-VolumesCloneTest-1305397264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cd770513-76c8-433f-a252-9e6822d91b40" returned: 0 in 0.664s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9fc7157c-e017-4eba-aca1-f487e1fccc2f tempest-VolumesCloneTest-1305397264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cd770513-76c8-433f-a252-9e6822d91b40 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:10 devstack sudo[94774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cd770513-76c8-433f-a252-9e6822d91b40 Nov 04 12:17:10 devstack sudo[94774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:10 devstack sudo[94774]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9fc7157c-e017-4eba-aca1-f487e1fccc2f tempest-VolumesCloneTest-1305397264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cd770513-76c8-433f-a252-9e6822d91b40" returned: 0 in 0.364s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:10 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9fc7157c-e017-4eba-aca1-f487e1fccc2f tempest-VolumesCloneTest-1305397264 None] Lock "cinder-quobyte-cd770513-76c8-433f-a252-9e6822d91b40" released by "delete_volume" :: held 1.096s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:17:10 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-9fc7157c-e017-4eba-aca1-f487e1fccc2f tempest-VolumesCloneTest-1305397264 None] Created reservations ['aac2fb39-d346-49d0-a059-bf4f5ebb4ee4', '49a7a12a-3313-4bfa-b433-fd91c999bef5', '62957001-0c49-4dfe-b91e-d9efa650b913', '4f3f18b0-30f0-4ea9-8216-c4cc0a182109'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:17:10 devstack sudo[94771]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a2d9d8e1-78f8-43ef-8276-eae727529062 tempest-VolumesGetTest-543965088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-38968aed-67bf-43af-b13f-3775c3cb337f 1073741824" returned: 0 in 0.617s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9fc7157c-e017-4eba-aca1-f487e1fccc2f tempest-VolumesCloneTest-1305397264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:17:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9fc7157c-e017-4eba-aca1-f487e1fccc2f tempest-VolumesCloneTest-1305397264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:17:10 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9fc7157c-e017-4eba-aca1-f487e1fccc2f tempest-VolumesCloneTest-1305397264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:17:10 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9fc7157c-e017-4eba-aca1-f487e1fccc2f tempest-VolumesCloneTest-1305397264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:17:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9fc7157c-e017-4eba-aca1-f487e1fccc2f tempest-VolumesCloneTest-1305397264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:17:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9fc7157c-e017-4eba-aca1-f487e1fccc2f tempest-VolumesCloneTest-1305397264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a2d9d8e1-78f8-43ef-8276-eae727529062 tempest-VolumesGetTest-543965088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-38968aed-67bf-43af-b13f-3775c3cb337f {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:11 devstack sudo[94781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:17:11 devstack sudo[94781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:11 devstack sudo[94783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-38968aed-67bf-43af-b13f-3775c3cb337f Nov 04 12:17:11 devstack sudo[94783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:11 devstack sudo[94781]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9fc7157c-e017-4eba-aca1-f487e1fccc2f tempest-VolumesCloneTest-1305397264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.296s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:11 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-9fc7157c-e017-4eba-aca1-f487e1fccc2f tempest-VolumesCloneTest-1305397264 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:17:11 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-9fc7157c-e017-4eba-aca1-f487e1fccc2f tempest-VolumesCloneTest-1305397264 None] Deleted volume successfully. Nov 04 12:17:11 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9fc7157c-e017-4eba-aca1-f487e1fccc2f tempest-VolumesCloneTest-1305397264 None] Lock "cinder-cd770513-76c8-433f-a252-9e6822d91b40-delete_volume" released by "delete_volume" :: held 1.710s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:17:11 devstack sudo[94783]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a2d9d8e1-78f8-43ef-8276-eae727529062 tempest-VolumesGetTest-543965088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-38968aed-67bf-43af-b13f-3775c3cb337f" returned: 0 in 0.361s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:11 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a2d9d8e1-78f8-43ef-8276-eae727529062 tempest-VolumesGetTest-543965088 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:17:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a2d9d8e1-78f8-43ef-8276-eae727529062 tempest-VolumesGetTest-543965088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:17:11 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a2d9d8e1-78f8-43ef-8276-eae727529062 tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f9b6395-48f9-4453-a2d2-fb7dcb681131) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38968aed-67bf-43af-b13f-3775c3cb337f', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:17:11 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a2d9d8e1-78f8-43ef-8276-eae727529062 tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9b2b785-6105-4952-b31a-ee452d78e37a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:17:11 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-a2d9d8e1-78f8-43ef-8276-eae727529062 tempest-VolumesGetTest-543965088 None] Volume volume-38968aed-67bf-43af-b13f-3775c3cb337f (38968aed-67bf-43af-b13f-3775c3cb337f): created successfully Nov 04 12:17:11 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a2d9d8e1-78f8-43ef-8276-eae727529062 tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9b2b785-6105-4952-b31a-ee452d78e37a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:17:11 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a2d9d8e1-78f8-43ef-8276-eae727529062 tempest-VolumesGetTest-543965088 None] Flow 'volume_create_manager' (5fd45cca-59ea-4910-ad25-3b1cf4c06a04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:17:11 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-a2d9d8e1-78f8-43ef-8276-eae727529062 tempest-VolumesGetTest-543965088 None] Created volume successfully. Nov 04 12:17:11 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ca95e6f0-cd3b-43ff-a9c0-1ea8c0db684b tempest-VolumesCloneTest-1305397264 None] Acquiring lock "cinder-da414b4b-eacd-48ad-8c35-5dce9432bb1c-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:17:12 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ca95e6f0-cd3b-43ff-a9c0-1ea8c0db684b tempest-VolumesCloneTest-1305397264 None] Lock "cinder-da414b4b-eacd-48ad-8c35-5dce9432bb1c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:17:12 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ca95e6f0-cd3b-43ff-a9c0-1ea8c0db684b tempest-VolumesCloneTest-1305397264 None] Acquiring lock "cinder-quobyte-da414b4b-eacd-48ad-8c35-5dce9432bb1c" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:17:12 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ca95e6f0-cd3b-43ff-a9c0-1ea8c0db684b tempest-VolumesCloneTest-1305397264 None] Lock "cinder-quobyte-da414b4b-eacd-48ad-8c35-5dce9432bb1c" acquired by "delete_volume" :: waited 0.022s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:17:12 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a33204-585e-40c1-ad27-706de9080a85]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:17:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ca95e6f0-cd3b-43ff-a9c0-1ea8c0db684b tempest-VolumesCloneTest-1305397264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-da414b4b-eacd-48ad-8c35-5dce9432bb1c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:12 devstack sudo[94790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-da414b4b-eacd-48ad-8c35-5dce9432bb1c Nov 04 12:17:12 devstack sudo[94790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:12 devstack sudo[94790]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ca95e6f0-cd3b-43ff-a9c0-1ea8c0db684b tempest-VolumesCloneTest-1305397264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-da414b4b-eacd-48ad-8c35-5dce9432bb1c" returned: 0 in 0.501s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ca95e6f0-cd3b-43ff-a9c0-1ea8c0db684b tempest-VolumesCloneTest-1305397264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-da414b4b-eacd-48ad-8c35-5dce9432bb1c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:12 devstack sudo[94797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-da414b4b-eacd-48ad-8c35-5dce9432bb1c Nov 04 12:17:12 devstack sudo[94797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:13 devstack sudo[94797]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ca95e6f0-cd3b-43ff-a9c0-1ea8c0db684b tempest-VolumesCloneTest-1305397264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-da414b4b-eacd-48ad-8c35-5dce9432bb1c" returned: 0 in 0.378s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:13 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ca95e6f0-cd3b-43ff-a9c0-1ea8c0db684b tempest-VolumesCloneTest-1305397264 None] Lock "cinder-quobyte-da414b4b-eacd-48ad-8c35-5dce9432bb1c" released by "delete_volume" :: held 0.993s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:17:13 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-ca95e6f0-cd3b-43ff-a9c0-1ea8c0db684b tempest-VolumesCloneTest-1305397264 None] Created reservations ['f85c610c-c6f6-4653-bc34-751b0875365f', '0f966128-6336-4e97-a4e6-15e737393521', '4b1a0002-9939-452a-997a-3f5642c47af5', 'b8f34190-7d17-40c8-8ae7-908832105407'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:17:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ca95e6f0-cd3b-43ff-a9c0-1ea8c0db684b tempest-VolumesCloneTest-1305397264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:17:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ca95e6f0-cd3b-43ff-a9c0-1ea8c0db684b tempest-VolumesCloneTest-1305397264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:17:13 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ca95e6f0-cd3b-43ff-a9c0-1ea8c0db684b tempest-VolumesCloneTest-1305397264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:17:13 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ca95e6f0-cd3b-43ff-a9c0-1ea8c0db684b tempest-VolumesCloneTest-1305397264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:17:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ca95e6f0-cd3b-43ff-a9c0-1ea8c0db684b tempest-VolumesCloneTest-1305397264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:17:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ca95e6f0-cd3b-43ff-a9c0-1ea8c0db684b tempest-VolumesCloneTest-1305397264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:13 devstack sudo[94800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:17:13 devstack sudo[94800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:13 devstack sudo[94800]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ca95e6f0-cd3b-43ff-a9c0-1ea8c0db684b tempest-VolumesCloneTest-1305397264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.376s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:13 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-ca95e6f0-cd3b-43ff-a9c0-1ea8c0db684b tempest-VolumesCloneTest-1305397264 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:17:13 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-ca95e6f0-cd3b-43ff-a9c0-1ea8c0db684b tempest-VolumesCloneTest-1305397264 None] Deleted volume successfully. Nov 04 12:17:13 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa00d152-45c4-4a09-ac7a-99c098844040 tempest-VolumesGetTest-543965088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:17:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-aa00d152-45c4-4a09-ac7a-99c098844040 tempest-VolumesGetTest-543965088 None] Flow 'volume_create_manager' (ea0f00f1-0bd6-4c4c-84b2-28b43866dc76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:17:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-aa00d152-45c4-4a09-ac7a-99c098844040 tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38473817-f7a8-4cf9-9734-bbb284f6b73b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:17:13 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ca95e6f0-cd3b-43ff-a9c0-1ea8c0db684b tempest-VolumesCloneTest-1305397264 None] Lock "cinder-da414b4b-eacd-48ad-8c35-5dce9432bb1c-delete_volume" released by "delete_volume" :: held 1.847s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:17:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-aa00d152-45c4-4a09-ac7a-99c098844040 tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38473817-f7a8-4cf9-9734-bbb284f6b73b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:17:13Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-249715586',display_name='tempest-VolumesGetTest-Volume-860073495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e5f611f-8334-418e-a7e9-7d101e971c50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49933e1eef4b45629df206d9a70d2739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:17:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:17:14Z,use_quota=True,user_id='916d8be431be4dab84c49f86dfb5372e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:17:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-aa00d152-45c4-4a09-ac7a-99c098844040 tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47f3f6da-1772-4e2a-950f-fbe85314fdd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:17:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-aa00d152-45c4-4a09-ac7a-99c098844040 tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47f3f6da-1772-4e2a-950f-fbe85314fdd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:17:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-aa00d152-45c4-4a09-ac7a-99c098844040 tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddb1b114-c6e9-437e-be34-43e236b626d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:17:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-aa00d152-45c4-4a09-ac7a-99c098844040 tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddb1b114-c6e9-437e-be34-43e236b626d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e5f611f-8334-418e-a7e9-7d101e971c50', 'volume_name': 'volume-2e5f611f-8334-418e-a7e9-7d101e971c50', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:17:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-aa00d152-45c4-4a09-ac7a-99c098844040 tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1fcc07a-6717-4c30-b0db-85097656f426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:17:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-aa00d152-45c4-4a09-ac7a-99c098844040 tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1fcc07a-6717-4c30-b0db-85097656f426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:17:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-aa00d152-45c4-4a09-ac7a-99c098844040 tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82bf9721-90c3-4bb8-8470-33d67f8233bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:17:13 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-aa00d152-45c4-4a09-ac7a-99c098844040 tempest-VolumesGetTest-543965088 None] Volume 2e5f611f-8334-418e-a7e9-7d101e971c50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e5f611f-8334-418e-a7e9-7d101e971c50', 'volume_size': 1} Nov 04 12:17:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-aa00d152-45c4-4a09-ac7a-99c098844040 tempest-VolumesGetTest-543965088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:17:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-aa00d152-45c4-4a09-ac7a-99c098844040 tempest-VolumesGetTest-543965088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:17:13 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-aa00d152-45c4-4a09-ac7a-99c098844040 tempest-VolumesGetTest-543965088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:17:13Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-249715586',display_name='tempest-VolumesGetTest-Volume-860073495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e5f611f-8334-418e-a7e9-7d101e971c50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49933e1eef4b45629df206d9a70d2739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:17:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:17:14Z,use_quota=True,user_id='916d8be431be4dab84c49f86dfb5372e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:17:13 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-aa00d152-45c4-4a09-ac7a-99c098844040 tempest-VolumesGetTest-543965088 None] Creating volume 2e5f611f-8334-418e-a7e9-7d101e971c50 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:17:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-aa00d152-45c4-4a09-ac7a-99c098844040 tempest-VolumesGetTest-543965088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:17:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-aa00d152-45c4-4a09-ac7a-99c098844040 tempest-VolumesGetTest-543965088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:17:13 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-aa00d152-45c4-4a09-ac7a-99c098844040 tempest-VolumesGetTest-543965088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:17:13 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-aa00d152-45c4-4a09-ac7a-99c098844040 tempest-VolumesGetTest-543965088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:17:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-aa00d152-45c4-4a09-ac7a-99c098844040 tempest-VolumesGetTest-543965088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:17:13 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-aa00d152-45c4-4a09-ac7a-99c098844040 tempest-VolumesGetTest-543965088 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:17:13 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-aa00d152-45c4-4a09-ac7a-99c098844040 tempest-VolumesGetTest-543965088 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:17:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-aa00d152-45c4-4a09-ac7a-99c098844040 tempest-VolumesGetTest-543965088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2e5f611f-8334-418e-a7e9-7d101e971c50 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:13 devstack sudo[94807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2e5f611f-8334-418e-a7e9-7d101e971c50 1073741824 Nov 04 12:17:13 devstack sudo[94807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:14 devstack sudo[94807]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-aa00d152-45c4-4a09-ac7a-99c098844040 tempest-VolumesGetTest-543965088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2e5f611f-8334-418e-a7e9-7d101e971c50 1073741824" returned: 0 in 0.678s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-aa00d152-45c4-4a09-ac7a-99c098844040 tempest-VolumesGetTest-543965088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2e5f611f-8334-418e-a7e9-7d101e971c50 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:14 devstack sudo[94826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2e5f611f-8334-418e-a7e9-7d101e971c50 Nov 04 12:17:14 devstack sudo[94826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:15 devstack sudo[94826]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-aa00d152-45c4-4a09-ac7a-99c098844040 tempest-VolumesGetTest-543965088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2e5f611f-8334-418e-a7e9-7d101e971c50" returned: 0 in 0.422s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:15 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-aa00d152-45c4-4a09-ac7a-99c098844040 tempest-VolumesGetTest-543965088 None] <== create_volume: return (1208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:17:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-aa00d152-45c4-4a09-ac7a-99c098844040 tempest-VolumesGetTest-543965088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.211s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:17:15 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-aa00d152-45c4-4a09-ac7a-99c098844040 tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82bf9721-90c3-4bb8-8470-33d67f8233bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e5f611f-8334-418e-a7e9-7d101e971c50', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:17:15 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-aa00d152-45c4-4a09-ac7a-99c098844040 tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d401f42-35e4-42ce-88e7-69a8effe3ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:17:15 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-aa00d152-45c4-4a09-ac7a-99c098844040 tempest-VolumesGetTest-543965088 None] Volume volume-2e5f611f-8334-418e-a7e9-7d101e971c50 (2e5f611f-8334-418e-a7e9-7d101e971c50): created successfully Nov 04 12:17:15 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-aa00d152-45c4-4a09-ac7a-99c098844040 tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d401f42-35e4-42ce-88e7-69a8effe3ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:17:15 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-aa00d152-45c4-4a09-ac7a-99c098844040 tempest-VolumesGetTest-543965088 None] Flow 'volume_create_manager' (ea0f00f1-0bd6-4c4c-84b2-28b43866dc76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:17:15 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-aa00d152-45c4-4a09-ac7a-99c098844040 tempest-VolumesGetTest-543965088 None] Created volume successfully. Nov 04 12:17:16 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e6722d13-a0f0-4cfd-b012-8b5da91f9a67 tempest-VolumesGetTest-543965088 None] Acquiring lock "cinder-2e5f611f-8334-418e-a7e9-7d101e971c50-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:17:16 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e6722d13-a0f0-4cfd-b012-8b5da91f9a67 tempest-VolumesGetTest-543965088 None] Lock "cinder-2e5f611f-8334-418e-a7e9-7d101e971c50-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:17:16 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e6722d13-a0f0-4cfd-b012-8b5da91f9a67 tempest-VolumesGetTest-543965088 None] Acquiring lock "cinder-quobyte-2e5f611f-8334-418e-a7e9-7d101e971c50" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:17:16 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e6722d13-a0f0-4cfd-b012-8b5da91f9a67 tempest-VolumesGetTest-543965088 None] Lock "cinder-quobyte-2e5f611f-8334-418e-a7e9-7d101e971c50" acquired by "delete_volume" :: waited 0.022s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:17:16 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d93cdf30-3fbc-413b-85f2-c291466ce61a]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:17:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e6722d13-a0f0-4cfd-b012-8b5da91f9a67 tempest-VolumesGetTest-543965088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2e5f611f-8334-418e-a7e9-7d101e971c50 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:16 devstack sudo[94830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2e5f611f-8334-418e-a7e9-7d101e971c50 Nov 04 12:17:16 devstack sudo[94830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:16 devstack sudo[94830]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e6722d13-a0f0-4cfd-b012-8b5da91f9a67 tempest-VolumesGetTest-543965088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2e5f611f-8334-418e-a7e9-7d101e971c50" returned: 0 in 0.410s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e6722d13-a0f0-4cfd-b012-8b5da91f9a67 tempest-VolumesGetTest-543965088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2e5f611f-8334-418e-a7e9-7d101e971c50 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:16 devstack sudo[94835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2e5f611f-8334-418e-a7e9-7d101e971c50 Nov 04 12:17:16 devstack sudo[94835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:16 devstack sudo[94835]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e6722d13-a0f0-4cfd-b012-8b5da91f9a67 tempest-VolumesGetTest-543965088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2e5f611f-8334-418e-a7e9-7d101e971c50" returned: 0 in 0.271s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:16 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e6722d13-a0f0-4cfd-b012-8b5da91f9a67 tempest-VolumesGetTest-543965088 None] Lock "cinder-quobyte-2e5f611f-8334-418e-a7e9-7d101e971c50" released by "delete_volume" :: held 0.741s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:17:17 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-e6722d13-a0f0-4cfd-b012-8b5da91f9a67 tempest-VolumesGetTest-543965088 None] Created reservations ['975c5b6f-43be-4bc9-902a-362aa9135f8a', '75272df8-90c9-49b2-b85f-2b38f43b3722', '01f03a3e-e198-4d76-baaf-4dcf81fc3b9a', '4c412c31-333c-4997-bb33-fd7d125e9a35'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:17:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e6722d13-a0f0-4cfd-b012-8b5da91f9a67 tempest-VolumesGetTest-543965088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:17:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e6722d13-a0f0-4cfd-b012-8b5da91f9a67 tempest-VolumesGetTest-543965088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:17:17 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e6722d13-a0f0-4cfd-b012-8b5da91f9a67 tempest-VolumesGetTest-543965088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:17:17 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e6722d13-a0f0-4cfd-b012-8b5da91f9a67 tempest-VolumesGetTest-543965088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:17:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e6722d13-a0f0-4cfd-b012-8b5da91f9a67 tempest-VolumesGetTest-543965088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:17:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e6722d13-a0f0-4cfd-b012-8b5da91f9a67 tempest-VolumesGetTest-543965088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:17 devstack sudo[94839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:17:17 devstack sudo[94839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:17 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-44c2626e-aad4-49aa-832d-a7fb258ebaf8 tempest-VolumesGetTest-543965088 None] Acquiring lock "cinder-38968aed-67bf-43af-b13f-3775c3cb337f-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:17:17 devstack sudo[94839]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e6722d13-a0f0-4cfd-b012-8b5da91f9a67 tempest-VolumesGetTest-543965088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.406s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:17 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-e6722d13-a0f0-4cfd-b012-8b5da91f9a67 tempest-VolumesGetTest-543965088 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:17:17 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-44c2626e-aad4-49aa-832d-a7fb258ebaf8 tempest-VolumesGetTest-543965088 None] Lock "cinder-38968aed-67bf-43af-b13f-3775c3cb337f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:17:17 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-e6722d13-a0f0-4cfd-b012-8b5da91f9a67 tempest-VolumesGetTest-543965088 None] Deleted volume successfully. Nov 04 12:17:17 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e6722d13-a0f0-4cfd-b012-8b5da91f9a67 tempest-VolumesGetTest-543965088 None] Lock "cinder-2e5f611f-8334-418e-a7e9-7d101e971c50-delete_volume" released by "delete_volume" :: held 1.461s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:17:17 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-44c2626e-aad4-49aa-832d-a7fb258ebaf8 tempest-VolumesGetTest-543965088 None] Acquiring lock "cinder-quobyte-38968aed-67bf-43af-b13f-3775c3cb337f" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:17:17 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-44c2626e-aad4-49aa-832d-a7fb258ebaf8 tempest-VolumesGetTest-543965088 None] Lock "cinder-quobyte-38968aed-67bf-43af-b13f-3775c3cb337f" acquired by "delete_volume" :: waited 0.025s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:17:17 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48e5b0c-3523-4f62-8aae-a3b3f1ac08aa]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:17:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-44c2626e-aad4-49aa-832d-a7fb258ebaf8 tempest-VolumesGetTest-543965088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-38968aed-67bf-43af-b13f-3775c3cb337f {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:17 devstack sudo[94842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-38968aed-67bf-43af-b13f-3775c3cb337f Nov 04 12:17:17 devstack sudo[94842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:18 devstack sudo[94842]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-44c2626e-aad4-49aa-832d-a7fb258ebaf8 tempest-VolumesGetTest-543965088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-38968aed-67bf-43af-b13f-3775c3cb337f" returned: 0 in 0.442s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-44c2626e-aad4-49aa-832d-a7fb258ebaf8 tempest-VolumesGetTest-543965088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-38968aed-67bf-43af-b13f-3775c3cb337f {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:18 devstack sudo[94847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-38968aed-67bf-43af-b13f-3775c3cb337f Nov 04 12:17:18 devstack sudo[94847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:18 devstack sudo[94847]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-44c2626e-aad4-49aa-832d-a7fb258ebaf8 tempest-VolumesGetTest-543965088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-38968aed-67bf-43af-b13f-3775c3cb337f" returned: 0 in 0.328s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:18 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-44c2626e-aad4-49aa-832d-a7fb258ebaf8 tempest-VolumesGetTest-543965088 None] Lock "cinder-quobyte-38968aed-67bf-43af-b13f-3775c3cb337f" released by "delete_volume" :: held 0.868s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:17:18 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-44c2626e-aad4-49aa-832d-a7fb258ebaf8 tempest-VolumesGetTest-543965088 None] Created reservations ['e072bc6e-2e00-4ba6-8144-854e183a6a44', '364b7ca4-15d5-44cc-915a-60b9b82531ad', '18995fae-9eb3-445f-84de-fb18ed2222b0', 'b4241218-8c28-4adc-b4e5-aaa5b410f142'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:17:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-44c2626e-aad4-49aa-832d-a7fb258ebaf8 tempest-VolumesGetTest-543965088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:17:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-44c2626e-aad4-49aa-832d-a7fb258ebaf8 tempest-VolumesGetTest-543965088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:17:18 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-44c2626e-aad4-49aa-832d-a7fb258ebaf8 tempest-VolumesGetTest-543965088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:17:18 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-44c2626e-aad4-49aa-832d-a7fb258ebaf8 tempest-VolumesGetTest-543965088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:17:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-44c2626e-aad4-49aa-832d-a7fb258ebaf8 tempest-VolumesGetTest-543965088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:17:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-44c2626e-aad4-49aa-832d-a7fb258ebaf8 tempest-VolumesGetTest-543965088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:18 devstack sudo[94887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:17:18 devstack sudo[94887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:19 devstack sudo[94887]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-44c2626e-aad4-49aa-832d-a7fb258ebaf8 tempest-VolumesGetTest-543965088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.581s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:19 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-44c2626e-aad4-49aa-832d-a7fb258ebaf8 tempest-VolumesGetTest-543965088 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:17:19 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-44c2626e-aad4-49aa-832d-a7fb258ebaf8 tempest-VolumesGetTest-543965088 None] Deleted volume successfully. Nov 04 12:17:19 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-44c2626e-aad4-49aa-832d-a7fb258ebaf8 tempest-VolumesGetTest-543965088 None] Lock "cinder-38968aed-67bf-43af-b13f-3775c3cb337f-delete_volume" released by "delete_volume" :: held 1.960s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:17:20 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-73691934-52e3-494c-a73f-c1fee4ea2d0c tempest-VolumesGetTest-543965088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:17:20 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-73691934-52e3-494c-a73f-c1fee4ea2d0c tempest-VolumesGetTest-543965088 None] Flow 'volume_create_manager' (43bc381a-27c5-4b21-b753-fe6ae3a477a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:17:20 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-73691934-52e3-494c-a73f-c1fee4ea2d0c tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2af9857e-226c-4b3f-8987-4b1b7f990700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:17:20 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-73691934-52e3-494c-a73f-c1fee4ea2d0c tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2af9857e-226c-4b3f-8987-4b1b7f990700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:17:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1598498366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=036f5090-fabd-419d-b5be-31ffd83eec7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49933e1eef4b45629df206d9a70d2739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:17:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:17:21Z,use_quota=True,user_id='916d8be431be4dab84c49f86dfb5372e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:17:20 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-73691934-52e3-494c-a73f-c1fee4ea2d0c tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c20afb7-8170-4682-a08e-63e253975c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:17:20 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-73691934-52e3-494c-a73f-c1fee4ea2d0c tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c20afb7-8170-4682-a08e-63e253975c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:17:20 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-73691934-52e3-494c-a73f-c1fee4ea2d0c tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a7a8c0f-f8c8-4b01-be0d-0810d98512f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:17:20 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-73691934-52e3-494c-a73f-c1fee4ea2d0c tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a7a8c0f-f8c8-4b01-be0d-0810d98512f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '036f5090-fabd-419d-b5be-31ffd83eec7d', 'volume_name': 'volume-036f5090-fabd-419d-b5be-31ffd83eec7d', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:17:20 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-73691934-52e3-494c-a73f-c1fee4ea2d0c tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89caf3cf-4bf3-4f96-82a8-84432d2978a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:17:20 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-73691934-52e3-494c-a73f-c1fee4ea2d0c tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89caf3cf-4bf3-4f96-82a8-84432d2978a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:17:20 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-73691934-52e3-494c-a73f-c1fee4ea2d0c tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54859d61-4463-4d81-9834-1ea8b75127b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:17:20 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-73691934-52e3-494c-a73f-c1fee4ea2d0c tempest-VolumesGetTest-543965088 None] Volume 036f5090-fabd-419d-b5be-31ffd83eec7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-036f5090-fabd-419d-b5be-31ffd83eec7d', 'volume_size': 1} Nov 04 12:17:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-73691934-52e3-494c-a73f-c1fee4ea2d0c tempest-VolumesGetTest-543965088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:17:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-73691934-52e3-494c-a73f-c1fee4ea2d0c tempest-VolumesGetTest-543965088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:17:20 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-73691934-52e3-494c-a73f-c1fee4ea2d0c tempest-VolumesGetTest-543965088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:17:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1598498366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=036f5090-fabd-419d-b5be-31ffd83eec7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49933e1eef4b45629df206d9a70d2739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:17:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:17:21Z,use_quota=True,user_id='916d8be431be4dab84c49f86dfb5372e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:17:20 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-73691934-52e3-494c-a73f-c1fee4ea2d0c tempest-VolumesGetTest-543965088 None] Creating volume 036f5090-fabd-419d-b5be-31ffd83eec7d {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:17:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-73691934-52e3-494c-a73f-c1fee4ea2d0c tempest-VolumesGetTest-543965088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:17:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-73691934-52e3-494c-a73f-c1fee4ea2d0c tempest-VolumesGetTest-543965088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:17:20 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-73691934-52e3-494c-a73f-c1fee4ea2d0c tempest-VolumesGetTest-543965088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:17:20 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-73691934-52e3-494c-a73f-c1fee4ea2d0c tempest-VolumesGetTest-543965088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:17:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-73691934-52e3-494c-a73f-c1fee4ea2d0c tempest-VolumesGetTest-543965088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:17:20 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-73691934-52e3-494c-a73f-c1fee4ea2d0c tempest-VolumesGetTest-543965088 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:17:20 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-73691934-52e3-494c-a73f-c1fee4ea2d0c tempest-VolumesGetTest-543965088 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:17:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-73691934-52e3-494c-a73f-c1fee4ea2d0c tempest-VolumesGetTest-543965088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-036f5090-fabd-419d-b5be-31ffd83eec7d 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:20 devstack sudo[94957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-036f5090-fabd-419d-b5be-31ffd83eec7d 1073741824 Nov 04 12:17:20 devstack sudo[94957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:21 devstack sudo[94957]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-73691934-52e3-494c-a73f-c1fee4ea2d0c tempest-VolumesGetTest-543965088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-036f5090-fabd-419d-b5be-31ffd83eec7d 1073741824" returned: 0 in 0.945s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-73691934-52e3-494c-a73f-c1fee4ea2d0c tempest-VolumesGetTest-543965088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-036f5090-fabd-419d-b5be-31ffd83eec7d {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:21 devstack sudo[94965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-036f5090-fabd-419d-b5be-31ffd83eec7d Nov 04 12:17:21 devstack sudo[94965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:22 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ae2c103-6402-415d-8814-553d4e6655c9 tempest-VolumesCloneNegativeTest-1402278520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:17:22 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6ae2c103-6402-415d-8814-553d4e6655c9 tempest-VolumesCloneNegativeTest-1402278520 None] Flow 'volume_create_manager' (5be2e509-0c80-4582-9848-797ef5207f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:17:22 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6ae2c103-6402-415d-8814-553d4e6655c9 tempest-VolumesCloneNegativeTest-1402278520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1eae1ef-eb70-4642-9333-e567bf3cd021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:17:22 devstack sudo[94965]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:22 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6ae2c103-6402-415d-8814-553d4e6655c9 tempest-VolumesCloneNegativeTest-1402278520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1eae1ef-eb70-4642-9333-e567bf3cd021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:17:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-91851886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49186b95-5621-42f3-a862-dc2f9261d84a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3d89ea7c9ae4f30b966add1bf546715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:17:22Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:17:22Z,use_quota=True,user_id='5e65610c57e94a15bff089f759ab31fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:17:22 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6ae2c103-6402-415d-8814-553d4e6655c9 tempest-VolumesCloneNegativeTest-1402278520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52f14652-e902-48cf-8b51-1e42a238ec56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:17:22 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6ae2c103-6402-415d-8814-553d4e6655c9 tempest-VolumesCloneNegativeTest-1402278520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52f14652-e902-48cf-8b51-1e42a238ec56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:17:22 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6ae2c103-6402-415d-8814-553d4e6655c9 tempest-VolumesCloneNegativeTest-1402278520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e47de08-3fa7-4935-a42d-aee28c635a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:17:22 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6ae2c103-6402-415d-8814-553d4e6655c9 tempest-VolumesCloneNegativeTest-1402278520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e47de08-3fa7-4935-a42d-aee28c635a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49186b95-5621-42f3-a862-dc2f9261d84a', 'volume_name': 'volume-49186b95-5621-42f3-a862-dc2f9261d84a', 'volume_size': 2}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:17:22 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6ae2c103-6402-415d-8814-553d4e6655c9 tempest-VolumesCloneNegativeTest-1402278520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bdd1bce-8413-4df5-8ecc-063240a6f223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:17:22 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6ae2c103-6402-415d-8814-553d4e6655c9 tempest-VolumesCloneNegativeTest-1402278520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bdd1bce-8413-4df5-8ecc-063240a6f223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:17:22 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6ae2c103-6402-415d-8814-553d4e6655c9 tempest-VolumesCloneNegativeTest-1402278520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54d59daa-f4dc-450a-9889-12286e9b6b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:17:22 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-6ae2c103-6402-415d-8814-553d4e6655c9 tempest-VolumesCloneNegativeTest-1402278520 None] Volume 49186b95-5621-42f3-a862-dc2f9261d84a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49186b95-5621-42f3-a862-dc2f9261d84a', 'volume_size': 2} Nov 04 12:17:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6ae2c103-6402-415d-8814-553d4e6655c9 tempest-VolumesCloneNegativeTest-1402278520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:17:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-73691934-52e3-494c-a73f-c1fee4ea2d0c tempest-VolumesGetTest-543965088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-036f5090-fabd-419d-b5be-31ffd83eec7d" returned: 0 in 0.491s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:22 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-73691934-52e3-494c-a73f-c1fee4ea2d0c tempest-VolumesGetTest-543965088 None] <== create_volume: return (1537ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:17:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-73691934-52e3-494c-a73f-c1fee4ea2d0c tempest-VolumesGetTest-543965088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.540s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:17:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6ae2c103-6402-415d-8814-553d4e6655c9 tempest-VolumesCloneNegativeTest-1402278520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.010s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:17:22 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6ae2c103-6402-415d-8814-553d4e6655c9 tempest-VolumesCloneNegativeTest-1402278520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:17:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-91851886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49186b95-5621-42f3-a862-dc2f9261d84a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3d89ea7c9ae4f30b966add1bf546715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:17:22Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:17:22Z,use_quota=True,user_id='5e65610c57e94a15bff089f759ab31fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:17:22 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-6ae2c103-6402-415d-8814-553d4e6655c9 tempest-VolumesCloneNegativeTest-1402278520 None] Creating volume 49186b95-5621-42f3-a862-dc2f9261d84a {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:17:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6ae2c103-6402-415d-8814-553d4e6655c9 tempest-VolumesCloneNegativeTest-1402278520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:17:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6ae2c103-6402-415d-8814-553d4e6655c9 tempest-VolumesCloneNegativeTest-1402278520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:17:22 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6ae2c103-6402-415d-8814-553d4e6655c9 tempest-VolumesCloneNegativeTest-1402278520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:17:22 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6ae2c103-6402-415d-8814-553d4e6655c9 tempest-VolumesCloneNegativeTest-1402278520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:17:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6ae2c103-6402-415d-8814-553d4e6655c9 tempest-VolumesCloneNegativeTest-1402278520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:17:22 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6ae2c103-6402-415d-8814-553d4e6655c9 tempest-VolumesCloneNegativeTest-1402278520 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:17:22 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-6ae2c103-6402-415d-8814-553d4e6655c9 tempest-VolumesCloneNegativeTest-1402278520 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:17:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6ae2c103-6402-415d-8814-553d4e6655c9 tempest-VolumesCloneNegativeTest-1402278520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-49186b95-5621-42f3-a862-dc2f9261d84a 2147483648 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:22 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-73691934-52e3-494c-a73f-c1fee4ea2d0c tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54859d61-4463-4d81-9834-1ea8b75127b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-036f5090-fabd-419d-b5be-31ffd83eec7d', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:17:22 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-73691934-52e3-494c-a73f-c1fee4ea2d0c tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c103934-5a92-4b9a-a2f1-b3ca7a5b14bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:17:22 devstack sudo[94968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-49186b95-5621-42f3-a862-dc2f9261d84a 2147483648 Nov 04 12:17:22 devstack sudo[94968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:22 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-73691934-52e3-494c-a73f-c1fee4ea2d0c tempest-VolumesGetTest-543965088 None] Volume volume-036f5090-fabd-419d-b5be-31ffd83eec7d (036f5090-fabd-419d-b5be-31ffd83eec7d): created successfully Nov 04 12:17:22 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-73691934-52e3-494c-a73f-c1fee4ea2d0c tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c103934-5a92-4b9a-a2f1-b3ca7a5b14bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:17:22 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-73691934-52e3-494c-a73f-c1fee4ea2d0c tempest-VolumesGetTest-543965088 None] Flow 'volume_create_manager' (43bc381a-27c5-4b21-b753-fe6ae3a477a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:17:22 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-73691934-52e3-494c-a73f-c1fee4ea2d0c tempest-VolumesGetTest-543965088 None] Created volume successfully. Nov 04 12:17:23 devstack sudo[94968]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6ae2c103-6402-415d-8814-553d4e6655c9 tempest-VolumesCloneNegativeTest-1402278520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-49186b95-5621-42f3-a862-dc2f9261d84a 2147483648" returned: 0 in 0.941s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6ae2c103-6402-415d-8814-553d4e6655c9 tempest-VolumesCloneNegativeTest-1402278520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-49186b95-5621-42f3-a862-dc2f9261d84a {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:23 devstack sudo[94976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-49186b95-5621-42f3-a862-dc2f9261d84a Nov 04 12:17:23 devstack sudo[94976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:23 devstack sudo[94976]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6ae2c103-6402-415d-8814-553d4e6655c9 tempest-VolumesCloneNegativeTest-1402278520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-49186b95-5621-42f3-a862-dc2f9261d84a" returned: 0 in 0.430s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:23 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6ae2c103-6402-415d-8814-553d4e6655c9 tempest-VolumesCloneNegativeTest-1402278520 None] <== create_volume: return (1470ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:17:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6ae2c103-6402-415d-8814-553d4e6655c9 tempest-VolumesCloneNegativeTest-1402278520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.474s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:17:23 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6ae2c103-6402-415d-8814-553d4e6655c9 tempest-VolumesCloneNegativeTest-1402278520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54d59daa-f4dc-450a-9889-12286e9b6b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49186b95-5621-42f3-a862-dc2f9261d84a', 'volume_size': 2}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:17:23 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6ae2c103-6402-415d-8814-553d4e6655c9 tempest-VolumesCloneNegativeTest-1402278520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e5c6fed-08e8-4da3-9941-59bc9353e3f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:17:23 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-6ae2c103-6402-415d-8814-553d4e6655c9 tempest-VolumesCloneNegativeTest-1402278520 None] Volume volume-49186b95-5621-42f3-a862-dc2f9261d84a (49186b95-5621-42f3-a862-dc2f9261d84a): created successfully Nov 04 12:17:23 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6ae2c103-6402-415d-8814-553d4e6655c9 tempest-VolumesCloneNegativeTest-1402278520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e5c6fed-08e8-4da3-9941-59bc9353e3f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:17:23 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6ae2c103-6402-415d-8814-553d4e6655c9 tempest-VolumesCloneNegativeTest-1402278520 None] Flow 'volume_create_manager' (5be2e509-0c80-4582-9848-797ef5207f5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:17:23 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-58dc8174-c1b7-4740-8f9a-2a4ce83e8e7e tempest-VolumesGetTest-543965088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:17:23 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-6ae2c103-6402-415d-8814-553d4e6655c9 tempest-VolumesCloneNegativeTest-1402278520 None] Created volume successfully. Nov 04 12:17:23 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-58dc8174-c1b7-4740-8f9a-2a4ce83e8e7e tempest-VolumesGetTest-543965088 None] Flow 'volume_create_manager' (bb3a9047-41c3-470b-b0ad-3b822b32e4a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:17:23 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-58dc8174-c1b7-4740-8f9a-2a4ce83e8e7e tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ed8a828-d0f6-4c9a-a46b-672f92e971ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:17:23 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-58dc8174-c1b7-4740-8f9a-2a4ce83e8e7e tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ed8a828-d0f6-4c9a-a46b-672f92e971ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:17:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1952264944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06c0264c-3470-402f-aac5-1eeec22b3ab9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='49933e1eef4b45629df206d9a70d2739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:17:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=036f5090-fabd-419d-b5be-31ffd83eec7d,status='creating',terminated_at=None,updated_at=2026-11-04T11:17:24Z,use_quota=True,user_id='916d8be431be4dab84c49f86dfb5372e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:17:23 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-58dc8174-c1b7-4740-8f9a-2a4ce83e8e7e tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3850417f-d0a4-403f-ad9f-5f13b32fb3d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:17:23 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-58dc8174-c1b7-4740-8f9a-2a4ce83e8e7e tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3850417f-d0a4-403f-ad9f-5f13b32fb3d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:17:23 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-58dc8174-c1b7-4740-8f9a-2a4ce83e8e7e tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3087af54-8576-4a1f-8cbb-ac3dc974c195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:17:23 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-58dc8174-c1b7-4740-8f9a-2a4ce83e8e7e tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3087af54-8576-4a1f-8cbb-ac3dc974c195) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '06c0264c-3470-402f-aac5-1eeec22b3ab9', 'volume_name': 'volume-06c0264c-3470-402f-aac5-1eeec22b3ab9', 'volume_size': 1, 'source_volid': '036f5090-fabd-419d-b5be-31ffd83eec7d', 'source_volstatus': 'available'}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:17:23 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-58dc8174-c1b7-4740-8f9a-2a4ce83e8e7e tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bb017d1-42ce-4539-accd-3765ffbff916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:17:23 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-58dc8174-c1b7-4740-8f9a-2a4ce83e8e7e tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bb017d1-42ce-4539-accd-3765ffbff916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:17:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-58dc8174-c1b7-4740-8f9a-2a4ce83e8e7e tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fb9a4f8-f2a9-49c6-8caa-171e4bb16d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:17:24 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-58dc8174-c1b7-4740-8f9a-2a4ce83e8e7e tempest-VolumesGetTest-543965088 None] Volume 06c0264c-3470-402f-aac5-1eeec22b3ab9: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-06c0264c-3470-402f-aac5-1eeec22b3ab9', 'volume_size': 1, 'source_volid': '036f5090-fabd-419d-b5be-31ffd83eec7d', 'source_volstatus': 'available'} Nov 04 12:17:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-58dc8174-c1b7-4740-8f9a-2a4ce83e8e7e tempest-VolumesGetTest-543965088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:17:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-58dc8174-c1b7-4740-8f9a-2a4ce83e8e7e tempest-VolumesGetTest-543965088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:17:24 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-58dc8174-c1b7-4740-8f9a-2a4ce83e8e7e tempest-VolumesGetTest-543965088 None] Cloning volume 036f5090-fabd-419d-b5be-31ffd83eec7d to volume 06c0264c-3470-402f-aac5-1eeec22b3ab9 Nov 04 12:17:24 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-58dc8174-c1b7-4740-8f9a-2a4ce83e8e7e tempest-VolumesGetTest-543965088 None] Creating offline snapshot 988df9db-135e-40e8-95d5-7d9a7162a72e of volume 036f5090-fabd-419d-b5be-31ffd83eec7d {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 12:17:24 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3c5c15-ae52-459e-835d-8b97282268be]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:17:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-58dc8174-c1b7-4740-8f9a-2a4ce83e8e7e tempest-VolumesGetTest-543965088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-036f5090-fabd-419d-b5be-31ffd83eec7d {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:24 devstack sudo[94980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-036f5090-fabd-419d-b5be-31ffd83eec7d Nov 04 12:17:24 devstack sudo[94980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:24 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-769416db-0b4a-41cb-9cbf-6d188ee20abe tempest-VolumesCloneNegativeTest-1402278520 None] Acquiring lock "cinder-49186b95-5621-42f3-a862-dc2f9261d84a-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:17:24 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-769416db-0b4a-41cb-9cbf-6d188ee20abe tempest-VolumesCloneNegativeTest-1402278520 None] Lock "cinder-49186b95-5621-42f3-a862-dc2f9261d84a-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:17:24 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-769416db-0b4a-41cb-9cbf-6d188ee20abe tempest-VolumesCloneNegativeTest-1402278520 None] Acquiring lock "cinder-quobyte-49186b95-5621-42f3-a862-dc2f9261d84a" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:17:24 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-769416db-0b4a-41cb-9cbf-6d188ee20abe tempest-VolumesCloneNegativeTest-1402278520 None] Lock "cinder-quobyte-49186b95-5621-42f3-a862-dc2f9261d84a" acquired by "delete_volume" :: waited 0.027s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:17:24 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[938d1e4d-3060-430c-9575-7da41b1cae1b]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:17:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-769416db-0b4a-41cb-9cbf-6d188ee20abe tempest-VolumesCloneNegativeTest-1402278520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-49186b95-5621-42f3-a862-dc2f9261d84a {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:24 devstack sudo[94980]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-58dc8174-c1b7-4740-8f9a-2a4ce83e8e7e tempest-VolumesGetTest-543965088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-036f5090-fabd-419d-b5be-31ffd83eec7d" returned: 0 in 0.695s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-58dc8174-c1b7-4740-8f9a-2a4ce83e8e7e tempest-VolumesGetTest-543965088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-036f5090-fabd-419d-b5be-31ffd83eec7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-036f5090-fabd-419d-b5be-31ffd83eec7d.988df9db-135e-40e8-95d5-7d9a7162a72e 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:24 devstack sudo[94987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-036f5090-fabd-419d-b5be-31ffd83eec7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-036f5090-fabd-419d-b5be-31ffd83eec7d.988df9db-135e-40e8-95d5-7d9a7162a72e 1G Nov 04 12:17:24 devstack sudo[94987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:24 devstack sudo[94986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-49186b95-5621-42f3-a862-dc2f9261d84a Nov 04 12:17:25 devstack sudo[94986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:25 devstack sudo[94986]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-769416db-0b4a-41cb-9cbf-6d188ee20abe tempest-VolumesCloneNegativeTest-1402278520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-49186b95-5621-42f3-a862-dc2f9261d84a" returned: 0 in 0.567s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-769416db-0b4a-41cb-9cbf-6d188ee20abe tempest-VolumesCloneNegativeTest-1402278520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-49186b95-5621-42f3-a862-dc2f9261d84a {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:25 devstack sudo[94997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-49186b95-5621-42f3-a862-dc2f9261d84a Nov 04 12:17:25 devstack sudo[94997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:25 devstack sudo[94987]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-58dc8174-c1b7-4740-8f9a-2a4ce83e8e7e tempest-VolumesGetTest-543965088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-036f5090-fabd-419d-b5be-31ffd83eec7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-036f5090-fabd-419d-b5be-31ffd83eec7d.988df9db-135e-40e8-95d5-7d9a7162a72e 1G" returned: 0 in 0.647s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-58dc8174-c1b7-4740-8f9a-2a4ce83e8e7e tempest-VolumesGetTest-543965088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-036f5090-fabd-419d-b5be-31ffd83eec7d -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-036f5090-fabd-419d-b5be-31ffd83eec7d.988df9db-135e-40e8-95d5-7d9a7162a72e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:25 devstack sudo[94999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-036f5090-fabd-419d-b5be-31ffd83eec7d -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-036f5090-fabd-419d-b5be-31ffd83eec7d.988df9db-135e-40e8-95d5-7d9a7162a72e Nov 04 12:17:25 devstack sudo[94999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:25 devstack sudo[94997]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-769416db-0b4a-41cb-9cbf-6d188ee20abe tempest-VolumesCloneNegativeTest-1402278520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-49186b95-5621-42f3-a862-dc2f9261d84a" returned: 0 in 0.374s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:25 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-769416db-0b4a-41cb-9cbf-6d188ee20abe tempest-VolumesCloneNegativeTest-1402278520 None] Lock "cinder-quobyte-49186b95-5621-42f3-a862-dc2f9261d84a" released by "delete_volume" :: held 1.039s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:17:25 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-769416db-0b4a-41cb-9cbf-6d188ee20abe tempest-VolumesCloneNegativeTest-1402278520 None] Created reservations ['133bc272-4434-4d32-9c8d-87773ea09b7d', 'e2bb49a8-d82c-49d4-a999-c6983be55426', '0fc9e1a0-640b-41b3-bc49-40ffa6a9cbf5', '39da87f3-8c2c-477c-b46c-ae974124412b'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:17:26 devstack sudo[94999]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-58dc8174-c1b7-4740-8f9a-2a4ce83e8e7e tempest-VolumesGetTest-543965088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-036f5090-fabd-419d-b5be-31ffd83eec7d -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-036f5090-fabd-419d-b5be-31ffd83eec7d.988df9db-135e-40e8-95d5-7d9a7162a72e" returned: 0 in 0.499s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:26 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-58dc8174-c1b7-4740-8f9a-2a4ce83e8e7e tempest-VolumesGetTest-543965088 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-036f5090-fabd-419d-b5be-31ffd83eec7d.988df9db-135e-40e8-95d5-7d9a7162a72e is being set with open permissions: ugo+rw Nov 04 12:17:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-58dc8174-c1b7-4740-8f9a-2a4ce83e8e7e tempest-VolumesGetTest-543965088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-036f5090-fabd-419d-b5be-31ffd83eec7d.988df9db-135e-40e8-95d5-7d9a7162a72e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-769416db-0b4a-41cb-9cbf-6d188ee20abe tempest-VolumesCloneNegativeTest-1402278520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:17:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-769416db-0b4a-41cb-9cbf-6d188ee20abe tempest-VolumesCloneNegativeTest-1402278520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:17:26 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-769416db-0b4a-41cb-9cbf-6d188ee20abe tempest-VolumesCloneNegativeTest-1402278520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:17:26 devstack sudo[95006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-036f5090-fabd-419d-b5be-31ffd83eec7d.988df9db-135e-40e8-95d5-7d9a7162a72e Nov 04 12:17:26 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-769416db-0b4a-41cb-9cbf-6d188ee20abe tempest-VolumesCloneNegativeTest-1402278520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:17:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-769416db-0b4a-41cb-9cbf-6d188ee20abe tempest-VolumesCloneNegativeTest-1402278520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:17:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-769416db-0b4a-41cb-9cbf-6d188ee20abe tempest-VolumesCloneNegativeTest-1402278520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:26 devstack sudo[95006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:26 devstack sudo[95008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:17:26 devstack sudo[95008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:26 devstack sudo[95006]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-58dc8174-c1b7-4740-8f9a-2a4ce83e8e7e tempest-VolumesGetTest-543965088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-036f5090-fabd-419d-b5be-31ffd83eec7d.988df9db-135e-40e8-95d5-7d9a7162a72e" returned: 0 in 0.334s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-58dc8174-c1b7-4740-8f9a-2a4ce83e8e7e tempest-VolumesGetTest-543965088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-036f5090-fabd-419d-b5be-31ffd83eec7d.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:26 devstack sudo[95008]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-769416db-0b4a-41cb-9cbf-6d188ee20abe tempest-VolumesCloneNegativeTest-1402278520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.353s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:26 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-769416db-0b4a-41cb-9cbf-6d188ee20abe tempest-VolumesCloneNegativeTest-1402278520 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:17:26 devstack sudo[95012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-036f5090-fabd-419d-b5be-31ffd83eec7d.info Nov 04 12:17:26 devstack sudo[95012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:26 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-769416db-0b4a-41cb-9cbf-6d188ee20abe tempest-VolumesCloneNegativeTest-1402278520 None] Deleted volume successfully. Nov 04 12:17:26 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-769416db-0b4a-41cb-9cbf-6d188ee20abe tempest-VolumesCloneNegativeTest-1402278520 None] Lock "cinder-49186b95-5621-42f3-a862-dc2f9261d84a-delete_volume" released by "delete_volume" :: held 1.812s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:17:26 devstack sudo[95012]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-58dc8174-c1b7-4740-8f9a-2a4ce83e8e7e tempest-VolumesGetTest-543965088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-036f5090-fabd-419d-b5be-31ffd83eec7d.info" returned: 0 in 0.337s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:26 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-58dc8174-c1b7-4740-8f9a-2a4ce83e8e7e tempest-VolumesGetTest-543965088 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-036f5090-fabd-419d-b5be-31ffd83eec7d.info is being set with open permissions: ugo+rw Nov 04 12:17:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-58dc8174-c1b7-4740-8f9a-2a4ce83e8e7e tempest-VolumesGetTest-543965088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-036f5090-fabd-419d-b5be-31ffd83eec7d.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:26 devstack sudo[95015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-036f5090-fabd-419d-b5be-31ffd83eec7d.info Nov 04 12:17:26 devstack sudo[95015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:27 devstack sudo[95015]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-58dc8174-c1b7-4740-8f9a-2a4ce83e8e7e tempest-VolumesGetTest-543965088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-036f5090-fabd-419d-b5be-31ffd83eec7d.info" returned: 0 in 0.406s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:27 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-58dc8174-c1b7-4740-8f9a-2a4ce83e8e7e tempest-VolumesGetTest-543965088 None] Acquiring lock "cinder-quobyte-06c0264c-3470-402f-aac5-1eeec22b3ab9" by "_copy_volume_from_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:17:27 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-58dc8174-c1b7-4740-8f9a-2a4ce83e8e7e tempest-VolumesGetTest-543965088 None] Lock "cinder-quobyte-06c0264c-3470-402f-aac5-1eeec22b3ab9" acquired by "_copy_volume_from_snapshot" :: waited 0.046s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:17:27 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-58dc8174-c1b7-4740-8f9a-2a4ce83e8e7e tempest-VolumesGetTest-543965088 None] snapshot: 988df9db-135e-40e8-95d5-7d9a7162a72e, volume: 06c0264c-3470-402f-aac5-1eeec22b3ab9, {{(pid=87095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 12:17:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-58dc8174-c1b7-4740-8f9a-2a4ce83e8e7e tempest-VolumesGetTest-543965088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:17:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-58dc8174-c1b7-4740-8f9a-2a4ce83e8e7e tempest-VolumesGetTest-543965088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:17:27 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-58dc8174-c1b7-4740-8f9a-2a4ce83e8e7e tempest-VolumesGetTest-543965088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:17:27 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-58dc8174-c1b7-4740-8f9a-2a4ce83e8e7e tempest-VolumesGetTest-543965088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:17:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-58dc8174-c1b7-4740-8f9a-2a4ce83e8e7e tempest-VolumesGetTest-543965088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:17:27 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[db04c386-722c-42c3-bd62-d72a6d2914c9]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:17:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-58dc8174-c1b7-4740-8f9a-2a4ce83e8e7e tempest-VolumesGetTest-543965088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-036f5090-fabd-419d-b5be-31ffd83eec7d.988df9db-135e-40e8-95d5-7d9a7162a72e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:27 devstack sudo[95020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-036f5090-fabd-419d-b5be-31ffd83eec7d.988df9db-135e-40e8-95d5-7d9a7162a72e Nov 04 12:17:27 devstack sudo[95020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:27 devstack sudo[95020]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-58dc8174-c1b7-4740-8f9a-2a4ce83e8e7e tempest-VolumesGetTest-543965088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-036f5090-fabd-419d-b5be-31ffd83eec7d.988df9db-135e-40e8-95d5-7d9a7162a72e" returned: 0 in 0.547s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:27 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-58dc8174-c1b7-4740-8f9a-2a4ce83e8e7e tempest-VolumesGetTest-543965088 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-036f5090-fabd-419d-b5be-31ffd83eec7d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 12:17:27 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1b53de-b8ed-438d-8eac-ebc93800127d]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:17:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-58dc8174-c1b7-4740-8f9a-2a4ce83e8e7e tempest-VolumesGetTest-543965088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-036f5090-fabd-419d-b5be-31ffd83eec7d {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:28 devstack sudo[95032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-036f5090-fabd-419d-b5be-31ffd83eec7d Nov 04 12:17:28 devstack sudo[95032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:28 devstack sudo[95032]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-58dc8174-c1b7-4740-8f9a-2a4ce83e8e7e tempest-VolumesGetTest-543965088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-036f5090-fabd-419d-b5be-31ffd83eec7d" returned: 0 in 0.824s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:28 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-58dc8174-c1b7-4740-8f9a-2a4ce83e8e7e tempest-VolumesGetTest-543965088 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-036f5090-fabd-419d-b5be-31ffd83eec7d {{(pid=87095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 12:17:28 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-58dc8174-c1b7-4740-8f9a-2a4ce83e8e7e tempest-VolumesGetTest-543965088 None] Creating direct copy from snapshot {{(pid=87095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 12:17:28 devstack cinder-volume[87095]: DEBUG cinder.utils [None req-58dc8174-c1b7-4740-8f9a-2a4ce83e8e7e tempest-VolumesGetTest-543965088 None] Path /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-06c0264c-3470-402f-aac5-1eeec22b3ab9 not found in is_blk_device check {{(pid=87095) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 04 12:17:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-58dc8174-c1b7-4740-8f9a-2a4ce83e8e7e tempest-VolumesGetTest-543965088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-036f5090-fabd-419d-b5be-31ffd83eec7d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-06c0264c-3470-402f-aac5-1eeec22b3ab9 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:28 devstack sudo[95044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-036f5090-fabd-419d-b5be-31ffd83eec7d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-06c0264c-3470-402f-aac5-1eeec22b3ab9 Nov 04 12:17:28 devstack sudo[95044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:35 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bddff88-101e-4da8-b60d-46017981c156 tempest-VolumesExtendTest-251807362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:17:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9bddff88-101e-4da8-b60d-46017981c156 tempest-VolumesExtendTest-251807362 None] Flow 'volume_create_manager' (ef4f1fb3-2725-4866-8be8-86394e8380bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:17:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9bddff88-101e-4da8-b60d-46017981c156 tempest-VolumesExtendTest-251807362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51362867-e1e3-4d97-863a-dd42636c1a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:17:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9bddff88-101e-4da8-b60d-46017981c156 tempest-VolumesExtendTest-251807362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51362867-e1e3-4d97-863a-dd42636c1a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:17:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-778073693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4efd45ef-de40-41e2-90b7-f31d550603cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b9d356a250940e59fd8792dfd5cfe42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:17:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:17:36Z,use_quota=True,user_id='96377cc37c974f00bfe90fddd1123ac6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:17:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9bddff88-101e-4da8-b60d-46017981c156 tempest-VolumesExtendTest-251807362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccd94ea7-fab2-4a74-a2d7-714dc5d1278a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:17:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9bddff88-101e-4da8-b60d-46017981c156 tempest-VolumesExtendTest-251807362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccd94ea7-fab2-4a74-a2d7-714dc5d1278a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:17:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9bddff88-101e-4da8-b60d-46017981c156 tempest-VolumesExtendTest-251807362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdb3665c-fe86-49b4-b9fa-053e755cd2eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:17:35 devstack cinder-volume[87095]: DEBUG cinder.image.glance [None req-9bddff88-101e-4da8-b60d-46017981c156 tempest-VolumesExtendTest-251807362 None] Creating Keystone auth plugin from conf {{(pid=87095) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 04 12:17:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9bddff88-101e-4da8-b60d-46017981c156 tempest-VolumesExtendTest-251807362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdb3665c-fe86-49b4-b9fa-053e755cd2eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4efd45ef-de40-41e2-90b7-f31d550603cb', 'volume_name': 'volume-4efd45ef-de40-41e2-90b7-f31d550603cb', 'volume_size': 1, 'image_id': 'b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '021c36f8b23249aabf2d5e363bccb8bc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af', 'created_at': datetime.datetime(2026, 11, 4, 11, 4, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 11, 4, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:17:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9bddff88-101e-4da8-b60d-46017981c156 tempest-VolumesExtendTest-251807362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a458f70-9a7b-4df8-b6c4-8f16e082a464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:17:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9bddff88-101e-4da8-b60d-46017981c156 tempest-VolumesExtendTest-251807362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a458f70-9a7b-4df8-b6c4-8f16e082a464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:17:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9bddff88-101e-4da8-b60d-46017981c156 tempest-VolumesExtendTest-251807362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9502cde4-b56c-4917-a60e-774594816851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:17:36 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-9bddff88-101e-4da8-b60d-46017981c156 tempest-VolumesExtendTest-251807362 None] Volume 4efd45ef-de40-41e2-90b7-f31d550603cb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4efd45ef-de40-41e2-90b7-f31d550603cb', 'volume_size': 1, 'image_id': 'b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '021c36f8b23249aabf2d5e363bccb8bc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af', 'created_at': datetime.datetime(2026, 11, 4, 11, 4, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 11, 4, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 04 12:17:36 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bddff88-101e-4da8-b60d-46017981c156 tempest-VolumesExtendTest-251807362 None] Trying to clone 4efd45ef-de40-41e2-90b7-f31d550603cb from image b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af at location (None, [{'url': 'file:///opt/stack/data/glance/images/b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af', 'metadata': {}}]). {{(pid=87095) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 04 12:17:36 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-9bddff88-101e-4da8-b60d-46017981c156 tempest-VolumesExtendTest-251807362 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_ksiwz166devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87095) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 04 12:17:36 devstack cinder-volume[87095]: INFO cinder.image.image_utils [None req-9bddff88-101e-4da8-b60d-46017981c156 tempest-VolumesExtendTest-251807362 None] Image download 20.69 MB at 20.69 MB/s Nov 04 12:17:37 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fff5252-ebd1-45fc-8c73-90967e19c346]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:17:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9bddff88-101e-4da8-b60d-46017981c156 tempest-VolumesExtendTest-251807362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_ksiwz166devstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:37 devstack sudo[95089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_ksiwz166devstack@QuobyteHD Nov 04 12:17:37 devstack sudo[95089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:37 devstack sudo[95089]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9bddff88-101e-4da8-b60d-46017981c156 tempest-VolumesExtendTest-251807362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_ksiwz166devstack@QuobyteHD" returned: 0 in 0.485s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:37 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-9bddff88-101e-4da8-b60d-46017981c156 tempest-VolumesExtendTest-251807362 None] Temporary image b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af is fetched for user 96377cc37c974f00bfe90fddd1123ac6. {{(pid=87095) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 04 12:17:37 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e39340d9-532a-4434-b74a-090bf4f13153]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:17:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9bddff88-101e-4da8-b60d-46017981c156 tempest-VolumesExtendTest-251807362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_ksiwz166devstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:37 devstack sudo[95044]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-58dc8174-c1b7-4740-8f9a-2a4ce83e8e7e tempest-VolumesGetTest-543965088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-036f5090-fabd-419d-b5be-31ffd83eec7d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-06c0264c-3470-402f-aac5-1eeec22b3ab9" returned: 0 in 9.257s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:37 devstack sudo[95095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_ksiwz166devstack@QuobyteHD Nov 04 12:17:37 devstack sudo[95095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:37 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-58dc8174-c1b7-4740-8f9a-2a4ce83e8e7e tempest-VolumesGetTest-543965088 None] Image conversion details: src /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-036f5090-fabd-419d-b5be-31ffd83eec7d, size 1024.00 MB, duration 9.26 sec, destination /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-06c0264c-3470-402f-aac5-1eeec22b3ab9 {{(pid=87095) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 12:17:37 devstack cinder-volume[87095]: INFO cinder.image.image_utils [None req-58dc8174-c1b7-4740-8f9a-2a4ce83e8e7e tempest-VolumesGetTest-543965088 None] Converted 1024.00 MB image at 110.59 MB/s Nov 04 12:17:37 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-58dc8174-c1b7-4740-8f9a-2a4ce83e8e7e tempest-VolumesGetTest-543965088 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-06c0264c-3470-402f-aac5-1eeec22b3ab9 is being set with open permissions: ugo+rw Nov 04 12:17:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-58dc8174-c1b7-4740-8f9a-2a4ce83e8e7e tempest-VolumesGetTest-543965088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-06c0264c-3470-402f-aac5-1eeec22b3ab9 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:37 devstack sudo[95097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-06c0264c-3470-402f-aac5-1eeec22b3ab9 Nov 04 12:17:37 devstack sudo[95097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:38 devstack sudo[95095]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9bddff88-101e-4da8-b60d-46017981c156 tempest-VolumesExtendTest-251807362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_ksiwz166devstack@QuobyteHD" returned: 0 in 0.431s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9bddff88-101e-4da8-b60d-46017981c156 tempest-VolumesExtendTest-251807362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:17:38 devstack sudo[95097]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-58dc8174-c1b7-4740-8f9a-2a4ce83e8e7e tempest-VolumesGetTest-543965088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-06c0264c-3470-402f-aac5-1eeec22b3ab9" returned: 0 in 0.268s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:38 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-58dc8174-c1b7-4740-8f9a-2a4ce83e8e7e tempest-VolumesGetTest-543965088 None] Lock "cinder-quobyte-06c0264c-3470-402f-aac5-1eeec22b3ab9" released by "_copy_volume_from_snapshot" :: held 11.029s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:17:38 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-58dc8174-c1b7-4740-8f9a-2a4ce83e8e7e tempest-VolumesGetTest-543965088 None] Acquiring lock "cinder-quobyte-988df9db-135e-40e8-95d5-7d9a7162a72e" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:17:38 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-58dc8174-c1b7-4740-8f9a-2a4ce83e8e7e tempest-VolumesGetTest-543965088 None] Lock "cinder-quobyte-988df9db-135e-40e8-95d5-7d9a7162a72e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:17:38 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-58dc8174-c1b7-4740-8f9a-2a4ce83e8e7e tempest-VolumesGetTest-543965088 None] Deleting offline snapshot 988df9db-135e-40e8-95d5-7d9a7162a72e of volume 036f5090-fabd-419d-b5be-31ffd83eec7d {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 12:17:38 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-58dc8174-c1b7-4740-8f9a-2a4ce83e8e7e tempest-VolumesGetTest-543965088 None] snapshot_file for this snap is: volume-036f5090-fabd-419d-b5be-31ffd83eec7d.988df9db-135e-40e8-95d5-7d9a7162a72e {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 12:17:38 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca223f12-81a2-4e4d-ba05-56ec8379833b]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:17:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-58dc8174-c1b7-4740-8f9a-2a4ce83e8e7e tempest-VolumesGetTest-543965088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-036f5090-fabd-419d-b5be-31ffd83eec7d.988df9db-135e-40e8-95d5-7d9a7162a72e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:38 devstack sudo[95103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-036f5090-fabd-419d-b5be-31ffd83eec7d.988df9db-135e-40e8-95d5-7d9a7162a72e Nov 04 12:17:38 devstack sudo[95103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:38 devstack sudo[95103]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-58dc8174-c1b7-4740-8f9a-2a4ce83e8e7e tempest-VolumesGetTest-543965088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-036f5090-fabd-419d-b5be-31ffd83eec7d.988df9db-135e-40e8-95d5-7d9a7162a72e" returned: 0 in 0.407s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:38 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-58dc8174-c1b7-4740-8f9a-2a4ce83e8e7e tempest-VolumesGetTest-543965088 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-036f5090-fabd-419d-b5be-31ffd83eec7d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 12:17:38 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b4c179-3b7b-4e09-8b00-466ee1d47e51]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:17:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-58dc8174-c1b7-4740-8f9a-2a4ce83e8e7e tempest-VolumesGetTest-543965088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-036f5090-fabd-419d-b5be-31ffd83eec7d {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:38 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dafac2e-03bd-44ca-a4db-cd45bae3d70d tempest-TestInstancesWithCinderVolumes-2035661098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:17:38 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9dafac2e-03bd-44ca-a4db-cd45bae3d70d tempest-TestInstancesWithCinderVolumes-2035661098 None] Flow 'volume_create_manager' (8cfa731f-53bd-49e3-8663-6c6e36303268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:17:38 devstack sudo[95109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-036f5090-fabd-419d-b5be-31ffd83eec7d Nov 04 12:17:38 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9dafac2e-03bd-44ca-a4db-cd45bae3d70d tempest-TestInstancesWithCinderVolumes-2035661098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (138e3760-120b-4be4-85ba-9ae7f2f132ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:17:38 devstack sudo[95109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:38 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9dafac2e-03bd-44ca-a4db-cd45bae3d70d tempest-TestInstancesWithCinderVolumes-2035661098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (138e3760-120b-4be4-85ba-9ae7f2f132ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:17:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1885507067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc9f4232-f950-42f6-aeb4-52431867740c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd57901491a648308a96d935b392fa3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:17:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:17:39Z,use_quota=True,user_id='a4f3604c7e344ac88ebb380917359bca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9371f1d7-32ac-4f89-a7f8-d8ab78d7305a),volume_type_id=9371f1d7-32ac-4f89-a7f8-d8ab78d7305a)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:17:38 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9dafac2e-03bd-44ca-a4db-cd45bae3d70d tempest-TestInstancesWithCinderVolumes-2035661098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d50a070-432e-4c2e-98f8-51a43bdb0f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:17:38 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9dafac2e-03bd-44ca-a4db-cd45bae3d70d tempest-TestInstancesWithCinderVolumes-2035661098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d50a070-432e-4c2e-98f8-51a43bdb0f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:17:38 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9dafac2e-03bd-44ca-a4db-cd45bae3d70d tempest-TestInstancesWithCinderVolumes-2035661098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eb72380-a3e0-44f7-a485-6d3b3e4fed0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:17:38 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9dafac2e-03bd-44ca-a4db-cd45bae3d70d tempest-TestInstancesWithCinderVolumes-2035661098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eb72380-a3e0-44f7-a485-6d3b3e4fed0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc9f4232-f950-42f6-aeb4-52431867740c', 'volume_name': 'volume-cc9f4232-f950-42f6-aeb4-52431867740c', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:17:38 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9dafac2e-03bd-44ca-a4db-cd45bae3d70d tempest-TestInstancesWithCinderVolumes-2035661098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95452f6b-37ea-4bbb-ac43-dc63a12f20d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:17:38 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9dafac2e-03bd-44ca-a4db-cd45bae3d70d tempest-TestInstancesWithCinderVolumes-2035661098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95452f6b-37ea-4bbb-ac43-dc63a12f20d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:17:38 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9dafac2e-03bd-44ca-a4db-cd45bae3d70d tempest-TestInstancesWithCinderVolumes-2035661098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d207b2e7-a1a0-44b6-8288-fd2c806583eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:17:38 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-9dafac2e-03bd-44ca-a4db-cd45bae3d70d tempest-TestInstancesWithCinderVolumes-2035661098 None] Volume cc9f4232-f950-42f6-aeb4-52431867740c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc9f4232-f950-42f6-aeb4-52431867740c', 'volume_size': 1} Nov 04 12:17:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9dafac2e-03bd-44ca-a4db-cd45bae3d70d tempest-TestInstancesWithCinderVolumes-2035661098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:17:39 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b2e2dfc-6a4f-4ad9-8a2f-3db513daa01c tempest-TestInstancesWithCinderVolumes-2035661098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:17:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8b2e2dfc-6a4f-4ad9-8a2f-3db513daa01c tempest-TestInstancesWithCinderVolumes-2035661098 None] Flow 'volume_create_manager' (12ae63d6-ca34-4d53-879e-7f9f93c3725f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:17:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8b2e2dfc-6a4f-4ad9-8a2f-3db513daa01c tempest-TestInstancesWithCinderVolumes-2035661098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bb8f857-6988-40c7-93a5-a0a1fc5fe3df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:17:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8b2e2dfc-6a4f-4ad9-8a2f-3db513daa01c tempest-TestInstancesWithCinderVolumes-2035661098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bb8f857-6988-40c7-93a5-a0a1fc5fe3df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:17:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2112010152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1af736e2-760b-435a-94d5-cc7f61f23fe4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd57901491a648308a96d935b392fa3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:17:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:17:39Z,use_quota=True,user_id='a4f3604c7e344ac88ebb380917359bca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3bc122d5-f3bc-4c6c-949b-aa315909d540),volume_type_id=3bc122d5-f3bc-4c6c-949b-aa315909d540)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:17:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8b2e2dfc-6a4f-4ad9-8a2f-3db513daa01c tempest-TestInstancesWithCinderVolumes-2035661098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0428d98-d440-40a3-979c-25fd68a356bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:17:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8b2e2dfc-6a4f-4ad9-8a2f-3db513daa01c tempest-TestInstancesWithCinderVolumes-2035661098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0428d98-d440-40a3-979c-25fd68a356bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:17:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8b2e2dfc-6a4f-4ad9-8a2f-3db513daa01c tempest-TestInstancesWithCinderVolumes-2035661098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae05128a-8548-4a00-a9c1-0a4ed448ed28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:17:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8b2e2dfc-6a4f-4ad9-8a2f-3db513daa01c tempest-TestInstancesWithCinderVolumes-2035661098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae05128a-8548-4a00-a9c1-0a4ed448ed28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1af736e2-760b-435a-94d5-cc7f61f23fe4', 'volume_name': 'volume-1af736e2-760b-435a-94d5-cc7f61f23fe4', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:17:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8b2e2dfc-6a4f-4ad9-8a2f-3db513daa01c tempest-TestInstancesWithCinderVolumes-2035661098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc7c4c83-c9fb-4d02-94dd-b064a3eab1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:17:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8b2e2dfc-6a4f-4ad9-8a2f-3db513daa01c tempest-TestInstancesWithCinderVolumes-2035661098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc7c4c83-c9fb-4d02-94dd-b064a3eab1b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:17:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8b2e2dfc-6a4f-4ad9-8a2f-3db513daa01c tempest-TestInstancesWithCinderVolumes-2035661098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c93da94c-df16-4aca-b730-855a6742a77e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:17:39 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-8b2e2dfc-6a4f-4ad9-8a2f-3db513daa01c tempest-TestInstancesWithCinderVolumes-2035661098 None] Volume 1af736e2-760b-435a-94d5-cc7f61f23fe4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1af736e2-760b-435a-94d5-cc7f61f23fe4', 'volume_size': 1} Nov 04 12:17:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-8b2e2dfc-6a4f-4ad9-8a2f-3db513daa01c tempest-TestInstancesWithCinderVolumes-2035661098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:17:39 devstack sudo[95109]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-58dc8174-c1b7-4740-8f9a-2a4ce83e8e7e tempest-VolumesGetTest-543965088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-036f5090-fabd-419d-b5be-31ffd83eec7d" returned: 0 in 0.681s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-58dc8174-c1b7-4740-8f9a-2a4ce83e8e7e tempest-VolumesGetTest-543965088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-036f5090-fabd-419d-b5be-31ffd83eec7d.988df9db-135e-40e8-95d5-7d9a7162a72e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:39 devstack sudo[95114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-036f5090-fabd-419d-b5be-31ffd83eec7d.988df9db-135e-40e8-95d5-7d9a7162a72e Nov 04 12:17:39 devstack sudo[95114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:39 devstack sudo[95114]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-58dc8174-c1b7-4740-8f9a-2a4ce83e8e7e tempest-VolumesGetTest-543965088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-036f5090-fabd-419d-b5be-31ffd83eec7d.988df9db-135e-40e8-95d5-7d9a7162a72e" returned: 0 in 0.453s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-58dc8174-c1b7-4740-8f9a-2a4ce83e8e7e tempest-VolumesGetTest-543965088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-036f5090-fabd-419d-b5be-31ffd83eec7d.988df9db-135e-40e8-95d5-7d9a7162a72e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:39 devstack sudo[95119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-036f5090-fabd-419d-b5be-31ffd83eec7d.988df9db-135e-40e8-95d5-7d9a7162a72e Nov 04 12:17:39 devstack sudo[95119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:39 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-e57273ac-ee7e-4c22-b876-bfd0a8699546 tempest-TestInstancesWithCinderVolumes-2035661098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:17:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e57273ac-ee7e-4c22-b876-bfd0a8699546 tempest-TestInstancesWithCinderVolumes-2035661098 None] Flow 'volume_create_manager' (121c0d18-3908-4f43-8b75-5f3b9dd5f64c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:17:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e57273ac-ee7e-4c22-b876-bfd0a8699546 tempest-TestInstancesWithCinderVolumes-2035661098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f6092ef-d302-48d7-84c2-77d6fd94b890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:17:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e57273ac-ee7e-4c22-b876-bfd0a8699546 tempest-TestInstancesWithCinderVolumes-2035661098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f6092ef-d302-48d7-84c2-77d6fd94b890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:17:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-160827943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d58d6b3-adf2-4b46-94f2-7f39a50f8f9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd57901491a648308a96d935b392fa3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:17:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:17:40Z,use_quota=True,user_id='a4f3604c7e344ac88ebb380917359bca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa5eacef-d61b-4d57-a7db-7eb58b6a92c9),volume_type_id=fa5eacef-d61b-4d57-a7db-7eb58b6a92c9)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:17:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e57273ac-ee7e-4c22-b876-bfd0a8699546 tempest-TestInstancesWithCinderVolumes-2035661098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcfac83f-fec8-45f5-b850-94a3a96626da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:17:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e57273ac-ee7e-4c22-b876-bfd0a8699546 tempest-TestInstancesWithCinderVolumes-2035661098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcfac83f-fec8-45f5-b850-94a3a96626da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:17:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e57273ac-ee7e-4c22-b876-bfd0a8699546 tempest-TestInstancesWithCinderVolumes-2035661098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (371a159d-5216-4971-b54d-d3fb940d91b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:17:40 devstack cinder-volume[87095]: DEBUG cinder.image.glance [None req-e57273ac-ee7e-4c22-b876-bfd0a8699546 tempest-TestInstancesWithCinderVolumes-2035661098 None] Creating Keystone auth plugin from conf {{(pid=87095) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 04 12:17:40 devstack sudo[95119]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-58dc8174-c1b7-4740-8f9a-2a4ce83e8e7e tempest-VolumesGetTest-543965088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-036f5090-fabd-419d-b5be-31ffd83eec7d.988df9db-135e-40e8-95d5-7d9a7162a72e" returned: 0 in 0.309s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:40 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-58dc8174-c1b7-4740-8f9a-2a4ce83e8e7e tempest-VolumesGetTest-543965088 None] Lock "cinder-quobyte-988df9db-135e-40e8-95d5-7d9a7162a72e" released by "_delete_snapshot" :: held 1.979s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:17:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-58dc8174-c1b7-4740-8f9a-2a4ce83e8e7e tempest-VolumesGetTest-543965088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.250s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:17:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9bddff88-101e-4da8-b60d-46017981c156 tempest-VolumesExtendTest-251807362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.097s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:17:40 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9bddff88-101e-4da8-b60d-46017981c156 tempest-VolumesExtendTest-251807362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:17:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-778073693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4efd45ef-de40-41e2-90b7-f31d550603cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b9d356a250940e59fd8792dfd5cfe42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:17:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:17:36Z,use_quota=True,user_id='96377cc37c974f00bfe90fddd1123ac6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:17:40 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-9bddff88-101e-4da8-b60d-46017981c156 tempest-VolumesExtendTest-251807362 None] Creating volume 4efd45ef-de40-41e2-90b7-f31d550603cb {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:17:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9bddff88-101e-4da8-b60d-46017981c156 tempest-VolumesExtendTest-251807362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:17:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9bddff88-101e-4da8-b60d-46017981c156 tempest-VolumesExtendTest-251807362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:17:40 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9bddff88-101e-4da8-b60d-46017981c156 tempest-VolumesExtendTest-251807362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:17:40 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9bddff88-101e-4da8-b60d-46017981c156 tempest-VolumesExtendTest-251807362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:17:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9bddff88-101e-4da8-b60d-46017981c156 tempest-VolumesExtendTest-251807362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:17:40 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9bddff88-101e-4da8-b60d-46017981c156 tempest-VolumesExtendTest-251807362 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:17:40 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-9bddff88-101e-4da8-b60d-46017981c156 tempest-VolumesExtendTest-251807362 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:17:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9bddff88-101e-4da8-b60d-46017981c156 tempest-VolumesExtendTest-251807362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4efd45ef-de40-41e2-90b7-f31d550603cb 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e57273ac-ee7e-4c22-b876-bfd0a8699546 tempest-TestInstancesWithCinderVolumes-2035661098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (371a159d-5216-4971-b54d-d3fb940d91b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9d58d6b3-adf2-4b46-94f2-7f39a50f8f9b', 'volume_name': 'volume-9d58d6b3-adf2-4b46-94f2-7f39a50f8f9b', 'volume_size': 1, 'image_id': '480da815-23bd-48bc-891e-c1c9d5d09d67', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/480da815-23bd-48bc-891e-c1c9d5d09d67', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1543519288', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dd57901491a648308a96d935b392fa3e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '480da815-23bd-48bc-891e-c1c9d5d09d67', 'created_at': datetime.datetime(2026, 11, 4, 11, 17, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 11, 17, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/480da815-23bd-48bc-891e-c1c9d5d09d67/file', 'properties': {}}, 'image_service': }' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:17:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e57273ac-ee7e-4c22-b876-bfd0a8699546 tempest-TestInstancesWithCinderVolumes-2035661098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8d2f6f2-626a-46f0-97d1-ba86da401d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:17:40 devstack sudo[95122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4efd45ef-de40-41e2-90b7-f31d550603cb 1073741824 Nov 04 12:17:40 devstack sudo[95122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e57273ac-ee7e-4c22-b876-bfd0a8699546 tempest-TestInstancesWithCinderVolumes-2035661098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8d2f6f2-626a-46f0-97d1-ba86da401d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:17:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e57273ac-ee7e-4c22-b876-bfd0a8699546 tempest-TestInstancesWithCinderVolumes-2035661098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1befa8e-aeed-4012-9bc2-360e0e2ea53d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:17:40 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-e57273ac-ee7e-4c22-b876-bfd0a8699546 tempest-TestInstancesWithCinderVolumes-2035661098 None] Volume 9d58d6b3-adf2-4b46-94f2-7f39a50f8f9b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9d58d6b3-adf2-4b46-94f2-7f39a50f8f9b', 'volume_size': 1, 'image_id': '480da815-23bd-48bc-891e-c1c9d5d09d67', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/480da815-23bd-48bc-891e-c1c9d5d09d67', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1543519288', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dd57901491a648308a96d935b392fa3e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '480da815-23bd-48bc-891e-c1c9d5d09d67', 'created_at': datetime.datetime(2026, 11, 4, 11, 17, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 11, 17, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/480da815-23bd-48bc-891e-c1c9d5d09d67/file', 'properties': {}}, 'image_service': } Nov 04 12:17:40 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-e57273ac-ee7e-4c22-b876-bfd0a8699546 tempest-TestInstancesWithCinderVolumes-2035661098 None] Trying to clone 9d58d6b3-adf2-4b46-94f2-7f39a50f8f9b from image 480da815-23bd-48bc-891e-c1c9d5d09d67 at location (None, [{'url': 'file:///opt/stack/data/glance/images/480da815-23bd-48bc-891e-c1c9d5d09d67', 'metadata': {}}]). {{(pid=87095) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 04 12:17:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-58dc8174-c1b7-4740-8f9a-2a4ce83e8e7e tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fb9a4f8-f2a9-49c6-8caa-171e4bb16d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06c0264c-3470-402f-aac5-1eeec22b3ab9', 'volume_size': 1, 'source_volid': '036f5090-fabd-419d-b5be-31ffd83eec7d', 'source_volstatus': 'available'}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:17:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-58dc8174-c1b7-4740-8f9a-2a4ce83e8e7e tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa8b5ebf-c5e4-4241-a4bd-2e60122a1a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:17:40 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-58dc8174-c1b7-4740-8f9a-2a4ce83e8e7e tempest-VolumesGetTest-543965088 None] Volume volume-06c0264c-3470-402f-aac5-1eeec22b3ab9 (06c0264c-3470-402f-aac5-1eeec22b3ab9): created successfully Nov 04 12:17:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-58dc8174-c1b7-4740-8f9a-2a4ce83e8e7e tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa8b5ebf-c5e4-4241-a4bd-2e60122a1a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:17:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-58dc8174-c1b7-4740-8f9a-2a4ce83e8e7e tempest-VolumesGetTest-543965088 None] Flow 'volume_create_manager' (bb3a9047-41c3-470b-b0ad-3b822b32e4a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:17:40 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-58dc8174-c1b7-4740-8f9a-2a4ce83e8e7e tempest-VolumesGetTest-543965088 None] Created volume successfully. Nov 04 12:17:40 devstack sudo[95122]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9bddff88-101e-4da8-b60d-46017981c156 tempest-VolumesExtendTest-251807362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4efd45ef-de40-41e2-90b7-f31d550603cb 1073741824" returned: 0 in 0.509s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9bddff88-101e-4da8-b60d-46017981c156 tempest-VolumesExtendTest-251807362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4efd45ef-de40-41e2-90b7-f31d550603cb {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:40 devstack sudo[95128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4efd45ef-de40-41e2-90b7-f31d550603cb Nov 04 12:17:40 devstack sudo[95128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:41 devstack sudo[95128]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9bddff88-101e-4da8-b60d-46017981c156 tempest-VolumesExtendTest-251807362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4efd45ef-de40-41e2-90b7-f31d550603cb" returned: 0 in 0.394s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:41 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9bddff88-101e-4da8-b60d-46017981c156 tempest-VolumesExtendTest-251807362 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:17:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9bddff88-101e-4da8-b60d-46017981c156 tempest-VolumesExtendTest-251807362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:17:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9dafac2e-03bd-44ca-a4db-cd45bae3d70d tempest-TestInstancesWithCinderVolumes-2035661098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.321s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:17:41 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9dafac2e-03bd-44ca-a4db-cd45bae3d70d tempest-TestInstancesWithCinderVolumes-2035661098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:17:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1885507067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc9f4232-f950-42f6-aeb4-52431867740c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd57901491a648308a96d935b392fa3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:17:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:17:39Z,use_quota=True,user_id='a4f3604c7e344ac88ebb380917359bca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9371f1d7-32ac-4f89-a7f8-d8ab78d7305a),volume_type_id=9371f1d7-32ac-4f89-a7f8-d8ab78d7305a)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:17:41 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-9dafac2e-03bd-44ca-a4db-cd45bae3d70d tempest-TestInstancesWithCinderVolumes-2035661098 None] Creating volume cc9f4232-f950-42f6-aeb4-52431867740c {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:17:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9dafac2e-03bd-44ca-a4db-cd45bae3d70d tempest-TestInstancesWithCinderVolumes-2035661098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:17:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9dafac2e-03bd-44ca-a4db-cd45bae3d70d tempest-TestInstancesWithCinderVolumes-2035661098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:17:41 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9dafac2e-03bd-44ca-a4db-cd45bae3d70d tempest-TestInstancesWithCinderVolumes-2035661098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:17:41 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9dafac2e-03bd-44ca-a4db-cd45bae3d70d tempest-TestInstancesWithCinderVolumes-2035661098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:17:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9dafac2e-03bd-44ca-a4db-cd45bae3d70d tempest-TestInstancesWithCinderVolumes-2035661098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:17:41 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9dafac2e-03bd-44ca-a4db-cd45bae3d70d tempest-TestInstancesWithCinderVolumes-2035661098 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:17:41 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-9dafac2e-03bd-44ca-a4db-cd45bae3d70d tempest-TestInstancesWithCinderVolumes-2035661098 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:17:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9dafac2e-03bd-44ca-a4db-cd45bae3d70d tempest-TestInstancesWithCinderVolumes-2035661098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cc9f4232-f950-42f6-aeb4-52431867740c 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:41 devstack sudo[95131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cc9f4232-f950-42f6-aeb4-52431867740c 1073741824 Nov 04 12:17:41 devstack sudo[95131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:41 devstack cinder-volume[87095]: DEBUG cinder.volume.volume_utils [None req-9bddff88-101e-4da8-b60d-46017981c156 tempest-VolumesExtendTest-251807362 None] Attempting download of b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af ((None, [{'url': 'file:///opt/stack/data/glance/images/b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af', 'metadata': {}}])) to volume 4efd45ef-de40-41e2-90b7-f31d550603cb. {{(pid=87095) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 04 12:17:41 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc3eec9-0851-4b40-93f6-a970972a8a31]: (4, 'raw') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:17:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9bddff88-101e-4da8-b60d-46017981c156 tempest-VolumesExtendTest-251807362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_y9644xbo {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:41 devstack sudo[95133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_y9644xbo Nov 04 12:17:41 devstack sudo[95133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:41 devstack sudo[95133]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9bddff88-101e-4da8-b60d-46017981c156 tempest-VolumesExtendTest-251807362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_y9644xbo" returned: 0 in 0.408s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9bddff88-101e-4da8-b60d-46017981c156 tempest-VolumesExtendTest-251807362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_y9644xbo {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:41 devstack sudo[95131]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9dafac2e-03bd-44ca-a4db-cd45bae3d70d tempest-TestInstancesWithCinderVolumes-2035661098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cc9f4232-f950-42f6-aeb4-52431867740c 1073741824" returned: 0 in 0.581s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:41 devstack sudo[95141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_y9644xbo Nov 04 12:17:41 devstack sudo[95141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:41 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-57686cb7-af1f-4469-bbe6-c77db505908f tempest-VolumesGetTest-543965088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:17:41 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-57686cb7-af1f-4469-bbe6-c77db505908f tempest-VolumesGetTest-543965088 None] Flow 'volume_create_manager' (4779a427-3cf5-4baa-829b-c5feb660d1e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:17:41 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-57686cb7-af1f-4469-bbe6-c77db505908f tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e84ceec-acf4-4792-8c0f-e308da322abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:17:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9dafac2e-03bd-44ca-a4db-cd45bae3d70d tempest-TestInstancesWithCinderVolumes-2035661098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cc9f4232-f950-42f6-aeb4-52431867740c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-57686cb7-af1f-4469-bbe6-c77db505908f tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e84ceec-acf4-4792-8c0f-e308da322abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:17:42Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2056587791',display_name='tempest-VolumesGetTest-Volume-795976142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57c5b656-905f-4081-bdd6-ea43e89135a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49933e1eef4b45629df206d9a70d2739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:17:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:17:42Z,use_quota=True,user_id='916d8be431be4dab84c49f86dfb5372e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:17:42 devstack sudo[95143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cc9f4232-f950-42f6-aeb4-52431867740c Nov 04 12:17:42 devstack sudo[95143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-57686cb7-af1f-4469-bbe6-c77db505908f tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7c461df-ccc0-4291-b870-6b10120de46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:17:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-57686cb7-af1f-4469-bbe6-c77db505908f tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7c461df-ccc0-4291-b870-6b10120de46d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:17:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-57686cb7-af1f-4469-bbe6-c77db505908f tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab1283f0-469d-49d8-8c57-77446325a9c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:17:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-57686cb7-af1f-4469-bbe6-c77db505908f tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab1283f0-469d-49d8-8c57-77446325a9c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57c5b656-905f-4081-bdd6-ea43e89135a7', 'volume_name': 'volume-57c5b656-905f-4081-bdd6-ea43e89135a7', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:17:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-57686cb7-af1f-4469-bbe6-c77db505908f tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89ac0927-58be-44b0-9692-2c082f347100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:17:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-57686cb7-af1f-4469-bbe6-c77db505908f tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89ac0927-58be-44b0-9692-2c082f347100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:17:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-57686cb7-af1f-4469-bbe6-c77db505908f tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33ee7705-3c9d-4959-a8d3-cc5710be7c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:17:42 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-57686cb7-af1f-4469-bbe6-c77db505908f tempest-VolumesGetTest-543965088 None] Volume 57c5b656-905f-4081-bdd6-ea43e89135a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57c5b656-905f-4081-bdd6-ea43e89135a7', 'volume_size': 1} Nov 04 12:17:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-57686cb7-af1f-4469-bbe6-c77db505908f tempest-VolumesGetTest-543965088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:17:42 devstack sudo[95141]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9bddff88-101e-4da8-b60d-46017981c156 tempest-VolumesExtendTest-251807362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_y9644xbo" returned: 1 in 0.385s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9bddff88-101e-4da8-b60d-46017981c156 tempest-VolumesExtendTest-251807362 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_y9644xbo' failed. Not Retrying. {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 12:17:42 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1165c9df-b8c8-4d4a-9895-868003dabb87]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:17:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9bddff88-101e-4da8-b60d-46017981c156 tempest-VolumesExtendTest-251807362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_ksiwz166devstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:42 devstack sudo[95143]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9dafac2e-03bd-44ca-a4db-cd45bae3d70d tempest-TestInstancesWithCinderVolumes-2035661098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cc9f4232-f950-42f6-aeb4-52431867740c" returned: 0 in 0.326s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:42 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9dafac2e-03bd-44ca-a4db-cd45bae3d70d tempest-TestInstancesWithCinderVolumes-2035661098 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:17:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9dafac2e-03bd-44ca-a4db-cd45bae3d70d tempest-TestInstancesWithCinderVolumes-2035661098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:17:42 devstack sudo[95147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_ksiwz166devstack@QuobyteHD Nov 04 12:17:42 devstack sudo[95147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-8b2e2dfc-6a4f-4ad9-8a2f-3db513daa01c tempest-TestInstancesWithCinderVolumes-2035661098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.971s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:17:42 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-8b2e2dfc-6a4f-4ad9-8a2f-3db513daa01c tempest-TestInstancesWithCinderVolumes-2035661098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:17:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2112010152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1af736e2-760b-435a-94d5-cc7f61f23fe4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd57901491a648308a96d935b392fa3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:17:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:17:39Z,use_quota=True,user_id='a4f3604c7e344ac88ebb380917359bca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3bc122d5-f3bc-4c6c-949b-aa315909d540),volume_type_id=3bc122d5-f3bc-4c6c-949b-aa315909d540)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:17:42 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-8b2e2dfc-6a4f-4ad9-8a2f-3db513daa01c tempest-TestInstancesWithCinderVolumes-2035661098 None] Creating volume 1af736e2-760b-435a-94d5-cc7f61f23fe4 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:17:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-8b2e2dfc-6a4f-4ad9-8a2f-3db513daa01c tempest-TestInstancesWithCinderVolumes-2035661098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:17:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-8b2e2dfc-6a4f-4ad9-8a2f-3db513daa01c tempest-TestInstancesWithCinderVolumes-2035661098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:17:42 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-8b2e2dfc-6a4f-4ad9-8a2f-3db513daa01c tempest-TestInstancesWithCinderVolumes-2035661098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:17:42 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-8b2e2dfc-6a4f-4ad9-8a2f-3db513daa01c tempest-TestInstancesWithCinderVolumes-2035661098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:17:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-8b2e2dfc-6a4f-4ad9-8a2f-3db513daa01c tempest-TestInstancesWithCinderVolumes-2035661098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:17:42 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-8b2e2dfc-6a4f-4ad9-8a2f-3db513daa01c tempest-TestInstancesWithCinderVolumes-2035661098 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:17:42 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-8b2e2dfc-6a4f-4ad9-8a2f-3db513daa01c tempest-TestInstancesWithCinderVolumes-2035661098 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:17:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8b2e2dfc-6a4f-4ad9-8a2f-3db513daa01c tempest-TestInstancesWithCinderVolumes-2035661098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1af736e2-760b-435a-94d5-cc7f61f23fe4 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9dafac2e-03bd-44ca-a4db-cd45bae3d70d tempest-TestInstancesWithCinderVolumes-2035661098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d207b2e7-a1a0-44b6-8288-fd2c806583eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc9f4232-f950-42f6-aeb4-52431867740c', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:17:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9dafac2e-03bd-44ca-a4db-cd45bae3d70d tempest-TestInstancesWithCinderVolumes-2035661098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8317982a-7c13-4f01-b835-f8fed062ff70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:17:42 devstack sudo[95150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1af736e2-760b-435a-94d5-cc7f61f23fe4 1073741824 Nov 04 12:17:42 devstack sudo[95150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:42 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-9dafac2e-03bd-44ca-a4db-cd45bae3d70d tempest-TestInstancesWithCinderVolumes-2035661098 None] Volume volume-cc9f4232-f950-42f6-aeb4-52431867740c (cc9f4232-f950-42f6-aeb4-52431867740c): created successfully Nov 04 12:17:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9dafac2e-03bd-44ca-a4db-cd45bae3d70d tempest-TestInstancesWithCinderVolumes-2035661098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8317982a-7c13-4f01-b835-f8fed062ff70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:17:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9dafac2e-03bd-44ca-a4db-cd45bae3d70d tempest-TestInstancesWithCinderVolumes-2035661098 None] Flow 'volume_create_manager' (8cfa731f-53bd-49e3-8663-6c6e36303268) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:17:42 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-9dafac2e-03bd-44ca-a4db-cd45bae3d70d tempest-TestInstancesWithCinderVolumes-2035661098 None] Created volume successfully. Nov 04 12:17:42 devstack sudo[95147]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9bddff88-101e-4da8-b60d-46017981c156 tempest-VolumesExtendTest-251807362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_ksiwz166devstack@QuobyteHD" returned: 0 in 0.372s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:42 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-9bddff88-101e-4da8-b60d-46017981c156 tempest-VolumesExtendTest-251807362 None] b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af was qcow2, converting to qcow2 {{(pid=87095) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 04 12:17:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9bddff88-101e-4da8-b60d-46017981c156 tempest-VolumesExtendTest-251807362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_ksiwz166devstack@QuobyteHD /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4efd45ef-de40-41e2-90b7-f31d550603cb {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:42 devstack sudo[95158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_ksiwz166devstack@QuobyteHD /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4efd45ef-de40-41e2-90b7-f31d550603cb Nov 04 12:17:42 devstack sudo[95158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:42 devstack sudo[95150]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8b2e2dfc-6a4f-4ad9-8a2f-3db513daa01c tempest-TestInstancesWithCinderVolumes-2035661098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1af736e2-760b-435a-94d5-cc7f61f23fe4 1073741824" returned: 0 in 0.475s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8b2e2dfc-6a4f-4ad9-8a2f-3db513daa01c tempest-TestInstancesWithCinderVolumes-2035661098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1af736e2-760b-435a-94d5-cc7f61f23fe4 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:42 devstack sudo[95165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1af736e2-760b-435a-94d5-cc7f61f23fe4 Nov 04 12:17:42 devstack sudo[95165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:43 devstack sudo[95165]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8b2e2dfc-6a4f-4ad9-8a2f-3db513daa01c tempest-TestInstancesWithCinderVolumes-2035661098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1af736e2-760b-435a-94d5-cc7f61f23fe4" returned: 0 in 0.309s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-8b2e2dfc-6a4f-4ad9-8a2f-3db513daa01c tempest-TestInstancesWithCinderVolumes-2035661098 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:17:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-8b2e2dfc-6a4f-4ad9-8a2f-3db513daa01c tempest-TestInstancesWithCinderVolumes-2035661098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:17:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-57686cb7-af1f-4469-bbe6-c77db505908f tempest-VolumesGetTest-543965088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.127s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:17:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-57686cb7-af1f-4469-bbe6-c77db505908f tempest-VolumesGetTest-543965088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:17:42Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2056587791',display_name='tempest-VolumesGetTest-Volume-795976142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57c5b656-905f-4081-bdd6-ea43e89135a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49933e1eef4b45629df206d9a70d2739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:17:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:17:42Z,use_quota=True,user_id='916d8be431be4dab84c49f86dfb5372e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:17:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-57686cb7-af1f-4469-bbe6-c77db505908f tempest-VolumesGetTest-543965088 None] Creating volume 57c5b656-905f-4081-bdd6-ea43e89135a7 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:17:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-57686cb7-af1f-4469-bbe6-c77db505908f tempest-VolumesGetTest-543965088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:17:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-57686cb7-af1f-4469-bbe6-c77db505908f tempest-VolumesGetTest-543965088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:17:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-57686cb7-af1f-4469-bbe6-c77db505908f tempest-VolumesGetTest-543965088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:17:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-57686cb7-af1f-4469-bbe6-c77db505908f tempest-VolumesGetTest-543965088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:17:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-57686cb7-af1f-4469-bbe6-c77db505908f tempest-VolumesGetTest-543965088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:17:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-57686cb7-af1f-4469-bbe6-c77db505908f tempest-VolumesGetTest-543965088 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:17:43 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-57686cb7-af1f-4469-bbe6-c77db505908f tempest-VolumesGetTest-543965088 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:17:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-57686cb7-af1f-4469-bbe6-c77db505908f tempest-VolumesGetTest-543965088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-57c5b656-905f-4081-bdd6-ea43e89135a7 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8b2e2dfc-6a4f-4ad9-8a2f-3db513daa01c tempest-TestInstancesWithCinderVolumes-2035661098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c93da94c-df16-4aca-b730-855a6742a77e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1af736e2-760b-435a-94d5-cc7f61f23fe4', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:17:43 devstack sudo[95168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-57c5b656-905f-4081-bdd6-ea43e89135a7 1073741824 Nov 04 12:17:43 devstack sudo[95168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8b2e2dfc-6a4f-4ad9-8a2f-3db513daa01c tempest-TestInstancesWithCinderVolumes-2035661098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56c7f63e-e539-4c1a-8b2d-0d3f70404c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:17:43 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-8b2e2dfc-6a4f-4ad9-8a2f-3db513daa01c tempest-TestInstancesWithCinderVolumes-2035661098 None] Volume volume-1af736e2-760b-435a-94d5-cc7f61f23fe4 (1af736e2-760b-435a-94d5-cc7f61f23fe4): created successfully Nov 04 12:17:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8b2e2dfc-6a4f-4ad9-8a2f-3db513daa01c tempest-TestInstancesWithCinderVolumes-2035661098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56c7f63e-e539-4c1a-8b2d-0d3f70404c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:17:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8b2e2dfc-6a4f-4ad9-8a2f-3db513daa01c tempest-TestInstancesWithCinderVolumes-2035661098 None] Flow 'volume_create_manager' (12ae63d6-ca34-4d53-879e-7f9f93c3725f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:17:43 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-8b2e2dfc-6a4f-4ad9-8a2f-3db513daa01c tempest-TestInstancesWithCinderVolumes-2035661098 None] Created volume successfully. Nov 04 12:17:43 devstack sudo[95168]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-57686cb7-af1f-4469-bbe6-c77db505908f tempest-VolumesGetTest-543965088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-57c5b656-905f-4081-bdd6-ea43e89135a7 1073741824" returned: 0 in 0.565s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-57686cb7-af1f-4469-bbe6-c77db505908f tempest-VolumesGetTest-543965088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-57c5b656-905f-4081-bdd6-ea43e89135a7 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:43 devstack sudo[95176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-57c5b656-905f-4081-bdd6-ea43e89135a7 Nov 04 12:17:43 devstack sudo[95176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:44 devstack sudo[95176]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-57686cb7-af1f-4469-bbe6-c77db505908f tempest-VolumesGetTest-543965088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-57c5b656-905f-4081-bdd6-ea43e89135a7" returned: 0 in 0.276s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:44 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-57686cb7-af1f-4469-bbe6-c77db505908f tempest-VolumesGetTest-543965088 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:17:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-57686cb7-af1f-4469-bbe6-c77db505908f tempest-VolumesGetTest-543965088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:17:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-57686cb7-af1f-4469-bbe6-c77db505908f tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33ee7705-3c9d-4959-a8d3-cc5710be7c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57c5b656-905f-4081-bdd6-ea43e89135a7', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:17:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-57686cb7-af1f-4469-bbe6-c77db505908f tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6e4ef6b-d100-4927-b959-ddda069b2b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:17:44 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-57686cb7-af1f-4469-bbe6-c77db505908f tempest-VolumesGetTest-543965088 None] Volume volume-57c5b656-905f-4081-bdd6-ea43e89135a7 (57c5b656-905f-4081-bdd6-ea43e89135a7): created successfully Nov 04 12:17:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-57686cb7-af1f-4469-bbe6-c77db505908f tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6e4ef6b-d100-4927-b959-ddda069b2b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:17:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-57686cb7-af1f-4469-bbe6-c77db505908f tempest-VolumesGetTest-543965088 None] Flow 'volume_create_manager' (4779a427-3cf5-4baa-829b-c5feb660d1e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:17:44 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-57686cb7-af1f-4469-bbe6-c77db505908f tempest-VolumesGetTest-543965088 None] Created volume successfully. Nov 04 12:17:44 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-e57273ac-ee7e-4c22-b876-bfd0a8699546 tempest-TestInstancesWithCinderVolumes-2035661098 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_480da815-23bd-48bc-891e-c1c9d5d09d67_xzzqpl9mdevstack@QuobyteHD, size 20.69 MB, duration 4.14 sec {{(pid=87095) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 04 12:17:44 devstack cinder-volume[87095]: INFO cinder.image.image_utils [None req-e57273ac-ee7e-4c22-b876-bfd0a8699546 tempest-TestInstancesWithCinderVolumes-2035661098 None] Image download 20.69 MB at 5.00 MB/s Nov 04 12:17:44 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f15b5a8f-7b14-40d0-aa42-132eeb12a94b]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:17:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e57273ac-ee7e-4c22-b876-bfd0a8699546 tempest-TestInstancesWithCinderVolumes-2035661098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_480da815-23bd-48bc-891e-c1c9d5d09d67_xzzqpl9mdevstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:44 devstack sudo[95185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_480da815-23bd-48bc-891e-c1c9d5d09d67_xzzqpl9mdevstack@QuobyteHD Nov 04 12:17:44 devstack sudo[95185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:44 devstack sudo[95158]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9bddff88-101e-4da8-b60d-46017981c156 tempest-VolumesExtendTest-251807362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_ksiwz166devstack@QuobyteHD /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4efd45ef-de40-41e2-90b7-f31d550603cb" returned: 0 in 2.085s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:44 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-9bddff88-101e-4da8-b60d-46017981c156 tempest-VolumesExtendTest-251807362 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_ksiwz166devstack@QuobyteHD, size 112.00 MB, duration 2.09 sec, destination /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4efd45ef-de40-41e2-90b7-f31d550603cb {{(pid=87095) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 12:17:44 devstack cinder-volume[87095]: INFO cinder.image.image_utils [None req-9bddff88-101e-4da8-b60d-46017981c156 tempest-VolumesExtendTest-251807362 None] Converted 112.00 MB image at 53.69 MB/s Nov 04 12:17:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9bddff88-101e-4da8-b60d-46017981c156 tempest-VolumesExtendTest-251807362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4efd45ef-de40-41e2-90b7-f31d550603cb 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:44 devstack sudo[95188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4efd45ef-de40-41e2-90b7-f31d550603cb 1G Nov 04 12:17:44 devstack sudo[95188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:44 devstack sudo[95185]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e57273ac-ee7e-4c22-b876-bfd0a8699546 tempest-TestInstancesWithCinderVolumes-2035661098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_480da815-23bd-48bc-891e-c1c9d5d09d67_xzzqpl9mdevstack@QuobyteHD" returned: 0 in 0.354s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:44 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-e57273ac-ee7e-4c22-b876-bfd0a8699546 tempest-TestInstancesWithCinderVolumes-2035661098 None] Temporary image 480da815-23bd-48bc-891e-c1c9d5d09d67 is fetched for user a4f3604c7e344ac88ebb380917359bca. {{(pid=87095) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 04 12:17:44 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0c2bb6-ec87-4a72-b044-03ecea62bdf6]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:17:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e57273ac-ee7e-4c22-b876-bfd0a8699546 tempest-TestInstancesWithCinderVolumes-2035661098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_480da815-23bd-48bc-891e-c1c9d5d09d67_xzzqpl9mdevstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:45 devstack sudo[95188]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9bddff88-101e-4da8-b60d-46017981c156 tempest-VolumesExtendTest-251807362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4efd45ef-de40-41e2-90b7-f31d550603cb 1G" returned: 0 in 0.431s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:45 devstack cinder-volume[87095]: DEBUG cinder.volume.volume_utils [None req-9bddff88-101e-4da8-b60d-46017981c156 tempest-VolumesExtendTest-251807362 None] Downloaded image b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af ((None, [{'url': 'file:///opt/stack/data/glance/images/b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af', 'metadata': {}}])) to volume 4efd45ef-de40-41e2-90b7-f31d550603cb successfully. {{(pid=87095) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 04 12:17:45 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-9bddff88-101e-4da8-b60d-46017981c156 tempest-VolumesExtendTest-251807362 None] Temporary image b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af for user 96377cc37c974f00bfe90fddd1123ac6 is deleted. {{(pid=87095) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 04 12:17:45 devstack cinder-volume[87095]: DEBUG cinder.volume.volume_utils [None req-9bddff88-101e-4da8-b60d-46017981c156 tempest-VolumesExtendTest-251807362 None] Marking volume 4efd45ef-de40-41e2-90b7-f31d550603cb as bootable. {{(pid=87095) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 04 12:17:45 devstack sudo[95196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_480da815-23bd-48bc-891e-c1c9d5d09d67_xzzqpl9mdevstack@QuobyteHD Nov 04 12:17:45 devstack sudo[95196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:45 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bddff88-101e-4da8-b60d-46017981c156 tempest-VolumesExtendTest-251807362 None] Copying metadata from image b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af to 4efd45ef-de40-41e2-90b7-f31d550603cb. {{(pid=87095) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 04 12:17:45 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bddff88-101e-4da8-b60d-46017981c156 tempest-VolumesExtendTest-251807362 None] Creating volume glance metadata for volume 4efd45ef-de40-41e2-90b7-f31d550603cb backed by image b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87095) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 04 12:17:45 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-0decc4e0-164b-4bb7-85d8-8492d1e23178 tempest-AttachVolumeTestJSON-1999482404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:17:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0decc4e0-164b-4bb7-85d8-8492d1e23178 tempest-AttachVolumeTestJSON-1999482404 None] Flow 'volume_create_manager' (d071992a-c3ed-499f-a28c-7c65fed97a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:17:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0decc4e0-164b-4bb7-85d8-8492d1e23178 tempest-AttachVolumeTestJSON-1999482404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d32f10e-8c0e-4d31-a714-441a19cfb6e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:17:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0decc4e0-164b-4bb7-85d8-8492d1e23178 tempest-AttachVolumeTestJSON-1999482404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d32f10e-8c0e-4d31-a714-441a19cfb6e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:17:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-979798878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0ac70db-2a5a-4ad1-a80f-1ae58516ccd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f3393a5a9324a1fa2a9e14272c58611',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:17:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:17:45Z,use_quota=True,user_id='d7257aa9cd244214bde6a8311299af7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:17:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0decc4e0-164b-4bb7-85d8-8492d1e23178 tempest-AttachVolumeTestJSON-1999482404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cc0bc4f-6cde-4d9a-aab1-ce89dc83d7a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:17:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0decc4e0-164b-4bb7-85d8-8492d1e23178 tempest-AttachVolumeTestJSON-1999482404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cc0bc4f-6cde-4d9a-aab1-ce89dc83d7a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:17:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0decc4e0-164b-4bb7-85d8-8492d1e23178 tempest-AttachVolumeTestJSON-1999482404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f24429c-b7d1-4939-9c87-ae56178052fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:17:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0decc4e0-164b-4bb7-85d8-8492d1e23178 tempest-AttachVolumeTestJSON-1999482404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f24429c-b7d1-4939-9c87-ae56178052fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0ac70db-2a5a-4ad1-a80f-1ae58516ccd5', 'volume_name': 'volume-f0ac70db-2a5a-4ad1-a80f-1ae58516ccd5', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:17:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0decc4e0-164b-4bb7-85d8-8492d1e23178 tempest-AttachVolumeTestJSON-1999482404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b51ef803-5a9d-4973-97a5-14cd9ec2f9b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:17:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0decc4e0-164b-4bb7-85d8-8492d1e23178 tempest-AttachVolumeTestJSON-1999482404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b51ef803-5a9d-4973-97a5-14cd9ec2f9b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:17:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0decc4e0-164b-4bb7-85d8-8492d1e23178 tempest-AttachVolumeTestJSON-1999482404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (380a5f70-71fb-42a4-b552-76046a071823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:17:45 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-0decc4e0-164b-4bb7-85d8-8492d1e23178 tempest-AttachVolumeTestJSON-1999482404 None] Volume f0ac70db-2a5a-4ad1-a80f-1ae58516ccd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0ac70db-2a5a-4ad1-a80f-1ae58516ccd5', 'volume_size': 1} Nov 04 12:17:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0decc4e0-164b-4bb7-85d8-8492d1e23178 tempest-AttachVolumeTestJSON-1999482404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:17:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0decc4e0-164b-4bb7-85d8-8492d1e23178 tempest-AttachVolumeTestJSON-1999482404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:17:45 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0decc4e0-164b-4bb7-85d8-8492d1e23178 tempest-AttachVolumeTestJSON-1999482404 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:17:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-979798878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0ac70db-2a5a-4ad1-a80f-1ae58516ccd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f3393a5a9324a1fa2a9e14272c58611',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:17:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:17:45Z,use_quota=True,user_id='d7257aa9cd244214bde6a8311299af7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:17:45 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-0decc4e0-164b-4bb7-85d8-8492d1e23178 tempest-AttachVolumeTestJSON-1999482404 None] Creating volume f0ac70db-2a5a-4ad1-a80f-1ae58516ccd5 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:17:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0decc4e0-164b-4bb7-85d8-8492d1e23178 tempest-AttachVolumeTestJSON-1999482404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:17:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0decc4e0-164b-4bb7-85d8-8492d1e23178 tempest-AttachVolumeTestJSON-1999482404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:17:45 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0decc4e0-164b-4bb7-85d8-8492d1e23178 tempest-AttachVolumeTestJSON-1999482404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:17:45 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0decc4e0-164b-4bb7-85d8-8492d1e23178 tempest-AttachVolumeTestJSON-1999482404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:17:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0decc4e0-164b-4bb7-85d8-8492d1e23178 tempest-AttachVolumeTestJSON-1999482404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:17:45 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0decc4e0-164b-4bb7-85d8-8492d1e23178 tempest-AttachVolumeTestJSON-1999482404 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:17:45 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-0decc4e0-164b-4bb7-85d8-8492d1e23178 tempest-AttachVolumeTestJSON-1999482404 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:17:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0decc4e0-164b-4bb7-85d8-8492d1e23178 tempest-AttachVolumeTestJSON-1999482404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f0ac70db-2a5a-4ad1-a80f-1ae58516ccd5 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:45 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a73334e5-5c84-45fd-8599-f989e6d3865f tempest-VolumesGetTest-543965088 None] Acquiring lock "cinder-57c5b656-905f-4081-bdd6-ea43e89135a7-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:17:45 devstack sudo[95198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f0ac70db-2a5a-4ad1-a80f-1ae58516ccd5 1073741824 Nov 04 12:17:45 devstack sudo[95198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:45 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a73334e5-5c84-45fd-8599-f989e6d3865f tempest-VolumesGetTest-543965088 None] Lock "cinder-57c5b656-905f-4081-bdd6-ea43e89135a7-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:17:45 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a73334e5-5c84-45fd-8599-f989e6d3865f tempest-VolumesGetTest-543965088 None] Acquiring lock "cinder-quobyte-57c5b656-905f-4081-bdd6-ea43e89135a7" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:17:45 devstack sudo[95196]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e57273ac-ee7e-4c22-b876-bfd0a8699546 tempest-TestInstancesWithCinderVolumes-2035661098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_480da815-23bd-48bc-891e-c1c9d5d09d67_xzzqpl9mdevstack@QuobyteHD" returned: 0 in 0.433s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e57273ac-ee7e-4c22-b876-bfd0a8699546 tempest-TestInstancesWithCinderVolumes-2035661098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:17:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9bddff88-101e-4da8-b60d-46017981c156 tempest-VolumesExtendTest-251807362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9502cde4-b56c-4917-a60e-774594816851) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4efd45ef-de40-41e2-90b7-f31d550603cb', 'volume_size': 1, 'image_id': 'b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '021c36f8b23249aabf2d5e363bccb8bc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af', 'created_at': datetime.datetime(2026, 11, 4, 11, 4, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 11, 4, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:17:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9bddff88-101e-4da8-b60d-46017981c156 tempest-VolumesExtendTest-251807362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (692f88ca-6df4-4417-b354-0e71c207d459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:17:45 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a73334e5-5c84-45fd-8599-f989e6d3865f tempest-VolumesGetTest-543965088 None] Lock "cinder-quobyte-57c5b656-905f-4081-bdd6-ea43e89135a7" acquired by "delete_volume" :: waited 0.033s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:17:45 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-9bddff88-101e-4da8-b60d-46017981c156 tempest-VolumesExtendTest-251807362 None] Volume volume-4efd45ef-de40-41e2-90b7-f31d550603cb (4efd45ef-de40-41e2-90b7-f31d550603cb): created successfully Nov 04 12:17:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9bddff88-101e-4da8-b60d-46017981c156 tempest-VolumesExtendTest-251807362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (692f88ca-6df4-4417-b354-0e71c207d459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:17:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9bddff88-101e-4da8-b60d-46017981c156 tempest-VolumesExtendTest-251807362 None] Flow 'volume_create_manager' (ef4f1fb3-2725-4866-8be8-86394e8380bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:17:45 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72eee98-226b-4c7d-bbf9-c477e28321b2]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:17:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a73334e5-5c84-45fd-8599-f989e6d3865f tempest-VolumesGetTest-543965088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-57c5b656-905f-4081-bdd6-ea43e89135a7 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:45 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-9bddff88-101e-4da8-b60d-46017981c156 tempest-VolumesExtendTest-251807362 None] Created volume successfully. Nov 04 12:17:45 devstack sudo[95204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-57c5b656-905f-4081-bdd6-ea43e89135a7 Nov 04 12:17:45 devstack sudo[95204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:45 devstack sudo[95198]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0decc4e0-164b-4bb7-85d8-8492d1e23178 tempest-AttachVolumeTestJSON-1999482404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f0ac70db-2a5a-4ad1-a80f-1ae58516ccd5 1073741824" returned: 0 in 0.479s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0decc4e0-164b-4bb7-85d8-8492d1e23178 tempest-AttachVolumeTestJSON-1999482404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f0ac70db-2a5a-4ad1-a80f-1ae58516ccd5 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:45 devstack sudo[95211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f0ac70db-2a5a-4ad1-a80f-1ae58516ccd5 Nov 04 12:17:45 devstack sudo[95211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:45 devstack sudo[95204]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a73334e5-5c84-45fd-8599-f989e6d3865f tempest-VolumesGetTest-543965088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-57c5b656-905f-4081-bdd6-ea43e89135a7" returned: 0 in 0.372s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a73334e5-5c84-45fd-8599-f989e6d3865f tempest-VolumesGetTest-543965088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-57c5b656-905f-4081-bdd6-ea43e89135a7 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:45 devstack sudo[95214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-57c5b656-905f-4081-bdd6-ea43e89135a7 Nov 04 12:17:45 devstack sudo[95214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:46 devstack sudo[95211]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0decc4e0-164b-4bb7-85d8-8492d1e23178 tempest-AttachVolumeTestJSON-1999482404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f0ac70db-2a5a-4ad1-a80f-1ae58516ccd5" returned: 0 in 0.259s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:46 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0decc4e0-164b-4bb7-85d8-8492d1e23178 tempest-AttachVolumeTestJSON-1999482404 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:17:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0decc4e0-164b-4bb7-85d8-8492d1e23178 tempest-AttachVolumeTestJSON-1999482404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:17:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e57273ac-ee7e-4c22-b876-bfd0a8699546 tempest-TestInstancesWithCinderVolumes-2035661098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.628s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:17:46 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e57273ac-ee7e-4c22-b876-bfd0a8699546 tempest-TestInstancesWithCinderVolumes-2035661098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:17:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-160827943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d58d6b3-adf2-4b46-94f2-7f39a50f8f9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd57901491a648308a96d935b392fa3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:17:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:17:40Z,use_quota=True,user_id='a4f3604c7e344ac88ebb380917359bca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa5eacef-d61b-4d57-a7db-7eb58b6a92c9),volume_type_id=fa5eacef-d61b-4d57-a7db-7eb58b6a92c9)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:17:46 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-e57273ac-ee7e-4c22-b876-bfd0a8699546 tempest-TestInstancesWithCinderVolumes-2035661098 None] Creating volume 9d58d6b3-adf2-4b46-94f2-7f39a50f8f9b {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:17:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e57273ac-ee7e-4c22-b876-bfd0a8699546 tempest-TestInstancesWithCinderVolumes-2035661098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:17:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e57273ac-ee7e-4c22-b876-bfd0a8699546 tempest-TestInstancesWithCinderVolumes-2035661098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:17:46 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e57273ac-ee7e-4c22-b876-bfd0a8699546 tempest-TestInstancesWithCinderVolumes-2035661098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:17:46 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e57273ac-ee7e-4c22-b876-bfd0a8699546 tempest-TestInstancesWithCinderVolumes-2035661098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:17:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e57273ac-ee7e-4c22-b876-bfd0a8699546 tempest-TestInstancesWithCinderVolumes-2035661098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:17:46 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e57273ac-ee7e-4c22-b876-bfd0a8699546 tempest-TestInstancesWithCinderVolumes-2035661098 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:17:46 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-e57273ac-ee7e-4c22-b876-bfd0a8699546 tempest-TestInstancesWithCinderVolumes-2035661098 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:17:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e57273ac-ee7e-4c22-b876-bfd0a8699546 tempest-TestInstancesWithCinderVolumes-2035661098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9d58d6b3-adf2-4b46-94f2-7f39a50f8f9b 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:46 devstack sudo[95218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9d58d6b3-adf2-4b46-94f2-7f39a50f8f9b 1073741824 Nov 04 12:17:46 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0decc4e0-164b-4bb7-85d8-8492d1e23178 tempest-AttachVolumeTestJSON-1999482404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (380a5f70-71fb-42a4-b552-76046a071823) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0ac70db-2a5a-4ad1-a80f-1ae58516ccd5', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:17:46 devstack sudo[95218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:46 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0decc4e0-164b-4bb7-85d8-8492d1e23178 tempest-AttachVolumeTestJSON-1999482404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67e8d1ed-c2fd-4acf-88fc-1882ab88cebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:17:46 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-0decc4e0-164b-4bb7-85d8-8492d1e23178 tempest-AttachVolumeTestJSON-1999482404 None] Volume volume-f0ac70db-2a5a-4ad1-a80f-1ae58516ccd5 (f0ac70db-2a5a-4ad1-a80f-1ae58516ccd5): created successfully Nov 04 12:17:46 devstack sudo[95214]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:46 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0decc4e0-164b-4bb7-85d8-8492d1e23178 tempest-AttachVolumeTestJSON-1999482404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67e8d1ed-c2fd-4acf-88fc-1882ab88cebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:17:46 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0decc4e0-164b-4bb7-85d8-8492d1e23178 tempest-AttachVolumeTestJSON-1999482404 None] Flow 'volume_create_manager' (d071992a-c3ed-499f-a28c-7c65fed97a0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:17:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a73334e5-5c84-45fd-8599-f989e6d3865f tempest-VolumesGetTest-543965088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-57c5b656-905f-4081-bdd6-ea43e89135a7" returned: 0 in 0.282s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:46 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a73334e5-5c84-45fd-8599-f989e6d3865f tempest-VolumesGetTest-543965088 None] Lock "cinder-quobyte-57c5b656-905f-4081-bdd6-ea43e89135a7" released by "delete_volume" :: held 0.709s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:17:46 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-0decc4e0-164b-4bb7-85d8-8492d1e23178 tempest-AttachVolumeTestJSON-1999482404 None] Created volume successfully. Nov 04 12:17:46 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-a73334e5-5c84-45fd-8599-f989e6d3865f tempest-VolumesGetTest-543965088 None] Created reservations ['3577af6d-ec7e-4586-a010-f1636a963807', '21b6887c-bb89-4e1e-87b3-80c19ff09e47', '85a0d9f4-e28a-4e42-a652-4ffdf27ca3b0', 'cd924974-1db6-4389-a3ce-d7c30cb4f4fe'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:17:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a73334e5-5c84-45fd-8599-f989e6d3865f tempest-VolumesGetTest-543965088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:17:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a73334e5-5c84-45fd-8599-f989e6d3865f tempest-VolumesGetTest-543965088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:17:46 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a73334e5-5c84-45fd-8599-f989e6d3865f tempest-VolumesGetTest-543965088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:17:46 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a73334e5-5c84-45fd-8599-f989e6d3865f tempest-VolumesGetTest-543965088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:17:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a73334e5-5c84-45fd-8599-f989e6d3865f tempest-VolumesGetTest-543965088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:17:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a73334e5-5c84-45fd-8599-f989e6d3865f tempest-VolumesGetTest-543965088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:46 devstack sudo[95220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:17:46 devstack sudo[95220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:46 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-1fc642b7-5aba-4558-9f0f-10a14395062a tempest-VolumesGetTest-543965088 None] Acquiring lock "cinder-06c0264c-3470-402f-aac5-1eeec22b3ab9-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:17:46 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-1fc642b7-5aba-4558-9f0f-10a14395062a tempest-VolumesGetTest-543965088 None] Lock "cinder-06c0264c-3470-402f-aac5-1eeec22b3ab9-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:17:46 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-1fc642b7-5aba-4558-9f0f-10a14395062a tempest-VolumesGetTest-543965088 None] Acquiring lock "cinder-quobyte-06c0264c-3470-402f-aac5-1eeec22b3ab9" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:17:46 devstack sudo[95220]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:46 devstack sudo[95218]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a73334e5-5c84-45fd-8599-f989e6d3865f tempest-VolumesGetTest-543965088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.326s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:46 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-a73334e5-5c84-45fd-8599-f989e6d3865f tempest-VolumesGetTest-543965088 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:17:46 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-1fc642b7-5aba-4558-9f0f-10a14395062a tempest-VolumesGetTest-543965088 None] Lock "cinder-quobyte-06c0264c-3470-402f-aac5-1eeec22b3ab9" acquired by "delete_volume" :: waited 0.021s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:17:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e57273ac-ee7e-4c22-b876-bfd0a8699546 tempest-TestInstancesWithCinderVolumes-2035661098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9d58d6b3-adf2-4b46-94f2-7f39a50f8f9b 1073741824" returned: 0 in 0.568s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:46 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-a73334e5-5c84-45fd-8599-f989e6d3865f tempest-VolumesGetTest-543965088 None] Deleted volume successfully. Nov 04 12:17:46 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53d4651-44e8-45e9-8fce-285781dbb7b5]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:17:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1fc642b7-5aba-4558-9f0f-10a14395062a tempest-VolumesGetTest-543965088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-06c0264c-3470-402f-aac5-1eeec22b3ab9 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:46 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a73334e5-5c84-45fd-8599-f989e6d3865f tempest-VolumesGetTest-543965088 None] Lock "cinder-57c5b656-905f-4081-bdd6-ea43e89135a7-delete_volume" released by "delete_volume" :: held 1.330s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:17:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e57273ac-ee7e-4c22-b876-bfd0a8699546 tempest-TestInstancesWithCinderVolumes-2035661098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9d58d6b3-adf2-4b46-94f2-7f39a50f8f9b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:46 devstack sudo[95228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9d58d6b3-adf2-4b46-94f2-7f39a50f8f9b Nov 04 12:17:46 devstack sudo[95228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-001be4d1-ec28-4ff5-bec3-02a8e7cad753 tempest-VolumesExtendTest-251807362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:17:46 devstack sudo[95227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-06c0264c-3470-402f-aac5-1eeec22b3ab9 Nov 04 12:17:46 devstack sudo[95227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:46 devstack sudo[95228]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e57273ac-ee7e-4c22-b876-bfd0a8699546 tempest-TestInstancesWithCinderVolumes-2035661098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9d58d6b3-adf2-4b46-94f2-7f39a50f8f9b" returned: 0 in 0.250s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:46 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e57273ac-ee7e-4c22-b876-bfd0a8699546 tempest-TestInstancesWithCinderVolumes-2035661098 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:17:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e57273ac-ee7e-4c22-b876-bfd0a8699546 tempest-TestInstancesWithCinderVolumes-2035661098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:17:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-001be4d1-ec28-4ff5-bec3-02a8e7cad753 tempest-VolumesExtendTest-251807362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.201s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:17:46 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b354bd30-d4d1-461c-b665-563735d5bde8]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:17:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-001be4d1-ec28-4ff5-bec3-02a8e7cad753 tempest-VolumesExtendTest-251807362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4efd45ef-de40-41e2-90b7-f31d550603cb {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:46 devstack cinder-volume[87095]: DEBUG cinder.volume.volume_utils [None req-e57273ac-ee7e-4c22-b876-bfd0a8699546 tempest-TestInstancesWithCinderVolumes-2035661098 None] Attempting download of 480da815-23bd-48bc-891e-c1c9d5d09d67 ((None, [{'url': 'file:///opt/stack/data/glance/images/480da815-23bd-48bc-891e-c1c9d5d09d67', 'metadata': {}}])) to volume 9d58d6b3-adf2-4b46-94f2-7f39a50f8f9b. {{(pid=87095) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 04 12:17:47 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[467bd1f4-4928-4b02-86b9-a9fbbb6d3624]: (4, 'raw') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:17:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e57273ac-ee7e-4c22-b876-bfd0a8699546 tempest-TestInstancesWithCinderVolumes-2035661098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_480da815-23bd-48bc-891e-c1c9d5d09d67_ipf1lvfe {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:47 devstack sudo[95227]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1fc642b7-5aba-4558-9f0f-10a14395062a tempest-VolumesGetTest-543965088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-06c0264c-3470-402f-aac5-1eeec22b3ab9" returned: 0 in 0.416s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1fc642b7-5aba-4558-9f0f-10a14395062a tempest-VolumesGetTest-543965088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-06c0264c-3470-402f-aac5-1eeec22b3ab9 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:47 devstack sudo[95232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4efd45ef-de40-41e2-90b7-f31d550603cb Nov 04 12:17:47 devstack sudo[95232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:47 devstack sudo[95237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-06c0264c-3470-402f-aac5-1eeec22b3ab9 Nov 04 12:17:47 devstack sudo[95237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:47 devstack sudo[95236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_480da815-23bd-48bc-891e-c1c9d5d09d67_ipf1lvfe Nov 04 12:17:47 devstack sudo[95236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:47 devstack sudo[95232]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-001be4d1-ec28-4ff5-bec3-02a8e7cad753 tempest-VolumesExtendTest-251807362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4efd45ef-de40-41e2-90b7-f31d550603cb" returned: 0 in 0.456s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-001be4d1-ec28-4ff5-bec3-02a8e7cad753 tempest-VolumesExtendTest-251807362 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4efd45ef-de40-41e2-90b7-f31d550603cb 2G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:47 devstack sudo[95237]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1fc642b7-5aba-4558-9f0f-10a14395062a tempest-VolumesGetTest-543965088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-06c0264c-3470-402f-aac5-1eeec22b3ab9" returned: 0 in 0.377s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:47 devstack sudo[95236]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e57273ac-ee7e-4c22-b876-bfd0a8699546 tempest-TestInstancesWithCinderVolumes-2035661098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_480da815-23bd-48bc-891e-c1c9d5d09d67_ipf1lvfe" returned: 0 in 0.426s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e57273ac-ee7e-4c22-b876-bfd0a8699546 tempest-TestInstancesWithCinderVolumes-2035661098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_480da815-23bd-48bc-891e-c1c9d5d09d67_ipf1lvfe {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:47 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-1fc642b7-5aba-4558-9f0f-10a14395062a tempest-VolumesGetTest-543965088 None] Lock "cinder-quobyte-06c0264c-3470-402f-aac5-1eeec22b3ab9" released by "delete_volume" :: held 0.865s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:17:47 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-1fc642b7-5aba-4558-9f0f-10a14395062a tempest-VolumesGetTest-543965088 None] Created reservations ['0b8ae6d5-e8f0-485d-82db-c62df0462044', '55e067e9-7b56-432d-ae06-51f5148fd389', '64efed5a-1182-4c22-a027-1cf2671bf96f', 'a7e97f3a-d9fb-454e-b197-c0daa7d16e99'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:17:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-001be4d1-ec28-4ff5-bec3-02a8e7cad753 tempest-VolumesExtendTest-251807362 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4efd45ef-de40-41e2-90b7-f31d550603cb 2G" returned: 0 in 0.165s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-001be4d1-ec28-4ff5-bec3-02a8e7cad753 tempest-VolumesExtendTest-251807362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.653s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:17:47 devstack sudo[95254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_480da815-23bd-48bc-891e-c1c9d5d09d67_ipf1lvfe Nov 04 12:17:47 devstack sudo[95254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1fc642b7-5aba-4558-9f0f-10a14395062a tempest-VolumesGetTest-543965088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:17:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1fc642b7-5aba-4558-9f0f-10a14395062a tempest-VolumesGetTest-543965088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:17:47 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1fc642b7-5aba-4558-9f0f-10a14395062a tempest-VolumesGetTest-543965088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:17:47 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1fc642b7-5aba-4558-9f0f-10a14395062a tempest-VolumesGetTest-543965088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:17:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1fc642b7-5aba-4558-9f0f-10a14395062a tempest-VolumesGetTest-543965088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:17:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1fc642b7-5aba-4558-9f0f-10a14395062a tempest-VolumesGetTest-543965088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:47 devstack sudo[95257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:17:47 devstack sudo[95257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:47 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-001be4d1-ec28-4ff5-bec3-02a8e7cad753 tempest-VolumesExtendTest-251807362 None] Extend volume completed successfully. Nov 04 12:17:47 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a4239652-98d0-409a-8d32-3753a8c9abfc tempest-VolumesGetTest-543965088 None] Acquiring lock "cinder-036f5090-fabd-419d-b5be-31ffd83eec7d-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:17:47 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a4239652-98d0-409a-8d32-3753a8c9abfc tempest-VolumesGetTest-543965088 None] Lock "cinder-036f5090-fabd-419d-b5be-31ffd83eec7d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:17:47 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a4239652-98d0-409a-8d32-3753a8c9abfc tempest-VolumesGetTest-543965088 None] Acquiring lock "cinder-quobyte-036f5090-fabd-419d-b5be-31ffd83eec7d" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:17:47 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a4239652-98d0-409a-8d32-3753a8c9abfc tempest-VolumesGetTest-543965088 None] Lock "cinder-quobyte-036f5090-fabd-419d-b5be-31ffd83eec7d" acquired by "delete_volume" :: waited 0.018s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:17:47 devstack sudo[95254]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e57273ac-ee7e-4c22-b876-bfd0a8699546 tempest-TestInstancesWithCinderVolumes-2035661098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_480da815-23bd-48bc-891e-c1c9d5d09d67_ipf1lvfe" returned: 1 in 0.518s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e57273ac-ee7e-4c22-b876-bfd0a8699546 tempest-TestInstancesWithCinderVolumes-2035661098 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_480da815-23bd-48bc-891e-c1c9d5d09d67_ipf1lvfe' failed. Not Retrying. {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 12:17:47 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[48793460-3a42-4e58-adca-d497618e100c]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:17:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e57273ac-ee7e-4c22-b876-bfd0a8699546 tempest-TestInstancesWithCinderVolumes-2035661098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_480da815-23bd-48bc-891e-c1c9d5d09d67_xzzqpl9mdevstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:48 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[95586515-44c1-432e-b84d-71403274d16e]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:17:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a4239652-98d0-409a-8d32-3753a8c9abfc tempest-VolumesGetTest-543965088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-036f5090-fabd-419d-b5be-31ffd83eec7d {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:48 devstack sudo[95257]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1fc642b7-5aba-4558-9f0f-10a14395062a tempest-VolumesGetTest-543965088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.392s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:48 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-1fc642b7-5aba-4558-9f0f-10a14395062a tempest-VolumesGetTest-543965088 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:17:48 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-1fc642b7-5aba-4558-9f0f-10a14395062a tempest-VolumesGetTest-543965088 None] Deleted volume successfully. Nov 04 12:17:48 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-1fc642b7-5aba-4558-9f0f-10a14395062a tempest-VolumesGetTest-543965088 None] Lock "cinder-06c0264c-3470-402f-aac5-1eeec22b3ab9-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:17:48 devstack sudo[95265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_480da815-23bd-48bc-891e-c1c9d5d09d67_xzzqpl9mdevstack@QuobyteHD Nov 04 12:17:48 devstack sudo[95265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:48 devstack sudo[95266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-036f5090-fabd-419d-b5be-31ffd83eec7d Nov 04 12:17:48 devstack sudo[95266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:48 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a5153be1-010b-4b48-9480-aa7283950654 tempest-VolumesExtendTest-251807362 None] Acquiring lock "cinder-4efd45ef-de40-41e2-90b7-f31d550603cb-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:17:48 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a5153be1-010b-4b48-9480-aa7283950654 tempest-VolumesExtendTest-251807362 None] Lock "cinder-4efd45ef-de40-41e2-90b7-f31d550603cb-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:17:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-1518e9cd-9df0-44f7-86e4-78f248157498 req-ceac4023-c514-436b-a33f-3d3897c0f2e1 tempest-AttachVolumeTestJSON-1999482404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:17:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-1518e9cd-9df0-44f7-86e4-78f248157498 req-ceac4023-c514-436b-a33f-3d3897c0f2e1 tempest-AttachVolumeTestJSON-1999482404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:17:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-1518e9cd-9df0-44f7-86e4-78f248157498 req-ceac4023-c514-436b-a33f-3d3897c0f2e1 tempest-AttachVolumeTestJSON-1999482404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:17:48 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a5153be1-010b-4b48-9480-aa7283950654 tempest-VolumesExtendTest-251807362 None] Acquiring lock "cinder-quobyte-4efd45ef-de40-41e2-90b7-f31d550603cb" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:17:48 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a5153be1-010b-4b48-9480-aa7283950654 tempest-VolumesExtendTest-251807362 None] Lock "cinder-quobyte-4efd45ef-de40-41e2-90b7-f31d550603cb" acquired by "delete_volume" :: waited 0.020s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:17:48 devstack sudo[95265]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e57273ac-ee7e-4c22-b876-bfd0a8699546 tempest-TestInstancesWithCinderVolumes-2035661098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_480da815-23bd-48bc-891e-c1c9d5d09d67_xzzqpl9mdevstack@QuobyteHD" returned: 0 in 0.514s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:48 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-e57273ac-ee7e-4c22-b876-bfd0a8699546 tempest-TestInstancesWithCinderVolumes-2035661098 None] 480da815-23bd-48bc-891e-c1c9d5d09d67 was qcow2, converting to qcow2 {{(pid=87095) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 04 12:17:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e57273ac-ee7e-4c22-b876-bfd0a8699546 tempest-TestInstancesWithCinderVolumes-2035661098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_480da815-23bd-48bc-891e-c1c9d5d09d67_xzzqpl9mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9d58d6b3-adf2-4b46-94f2-7f39a50f8f9b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:48 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e915cd8-45d5-47d4-96bc-3fc610ad7e1b]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:17:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a5153be1-010b-4b48-9480-aa7283950654 tempest-VolumesExtendTest-251807362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4efd45ef-de40-41e2-90b7-f31d550603cb {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:48 devstack sudo[95266]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:48 devstack sudo[95284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_480da815-23bd-48bc-891e-c1c9d5d09d67_xzzqpl9mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9d58d6b3-adf2-4b46-94f2-7f39a50f8f9b Nov 04 12:17:48 devstack sudo[95284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-1518e9cd-9df0-44f7-86e4-78f248157498 req-ceac4023-c514-436b-a33f-3d3897c0f2e1 tempest-AttachVolumeTestJSON-1999482404 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784', 'name': 'volume-f0ac70db-2a5a-4ad1-a80f-1ae58516ccd5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '445e14fb-ee75-4364-a7f5-c4154805da06', 'enforce_multipath': True} {{(pid=87095) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 12:17:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a4239652-98d0-409a-8d32-3753a8c9abfc tempest-VolumesGetTest-543965088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-036f5090-fabd-419d-b5be-31ffd83eec7d" returned: 0 in 0.540s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a4239652-98d0-409a-8d32-3753a8c9abfc tempest-VolumesGetTest-543965088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-036f5090-fabd-419d-b5be-31ffd83eec7d {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:48 devstack sudo[95287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-036f5090-fabd-419d-b5be-31ffd83eec7d Nov 04 12:17:48 devstack sudo[95287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:48 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-1518e9cd-9df0-44f7-86e4-78f248157498 req-ceac4023-c514-436b-a33f-3d3897c0f2e1 tempest-AttachVolumeTestJSON-1999482404 None] attachment_update completed successfully. Nov 04 12:17:48 devstack sudo[95285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4efd45ef-de40-41e2-90b7-f31d550603cb Nov 04 12:17:48 devstack sudo[95285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:48 devstack sudo[95287]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a4239652-98d0-409a-8d32-3753a8c9abfc tempest-VolumesGetTest-543965088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-036f5090-fabd-419d-b5be-31ffd83eec7d" returned: 0 in 0.310s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:48 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a4239652-98d0-409a-8d32-3753a8c9abfc tempest-VolumesGetTest-543965088 None] Lock "cinder-quobyte-036f5090-fabd-419d-b5be-31ffd83eec7d" released by "delete_volume" :: held 0.953s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:17:48 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-a4239652-98d0-409a-8d32-3753a8c9abfc tempest-VolumesGetTest-543965088 None] Created reservations ['7dc1e5ca-70d1-49f5-aafc-f4c369e0cb35', '874e67f8-98d8-481b-bdcc-e502b7713d9f', 'ad93c85d-7004-4b34-9e88-f6590450be81', '672d5b23-4a97-4aeb-885d-113a81670597'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:17:48 devstack sudo[95285]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a5153be1-010b-4b48-9480-aa7283950654 tempest-VolumesExtendTest-251807362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4efd45ef-de40-41e2-90b7-f31d550603cb" returned: 0 in 0.464s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a5153be1-010b-4b48-9480-aa7283950654 tempest-VolumesExtendTest-251807362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4efd45ef-de40-41e2-90b7-f31d550603cb {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:49 devstack sudo[95467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4efd45ef-de40-41e2-90b7-f31d550603cb Nov 04 12:17:49 devstack sudo[95467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a4239652-98d0-409a-8d32-3753a8c9abfc tempest-VolumesGetTest-543965088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:17:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a4239652-98d0-409a-8d32-3753a8c9abfc tempest-VolumesGetTest-543965088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:17:49 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a4239652-98d0-409a-8d32-3753a8c9abfc tempest-VolumesGetTest-543965088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:17:49 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a4239652-98d0-409a-8d32-3753a8c9abfc tempest-VolumesGetTest-543965088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:17:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a4239652-98d0-409a-8d32-3753a8c9abfc tempest-VolumesGetTest-543965088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:17:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a4239652-98d0-409a-8d32-3753a8c9abfc tempest-VolumesGetTest-543965088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:49 devstack sudo[95716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:17:49 devstack sudo[95716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:49 devstack sudo[95467]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a5153be1-010b-4b48-9480-aa7283950654 tempest-VolumesExtendTest-251807362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4efd45ef-de40-41e2-90b7-f31d550603cb" returned: 0 in 0.419s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:49 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a5153be1-010b-4b48-9480-aa7283950654 tempest-VolumesExtendTest-251807362 None] Lock "cinder-quobyte-4efd45ef-de40-41e2-90b7-f31d550603cb" released by "delete_volume" :: held 0.959s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:17:49 devstack sudo[95716]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a4239652-98d0-409a-8d32-3753a8c9abfc tempest-VolumesGetTest-543965088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.361s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:49 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-a4239652-98d0-409a-8d32-3753a8c9abfc tempest-VolumesGetTest-543965088 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:17:49 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-a4239652-98d0-409a-8d32-3753a8c9abfc tempest-VolumesGetTest-543965088 None] Deleted volume successfully. Nov 04 12:17:49 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a4239652-98d0-409a-8d32-3753a8c9abfc tempest-VolumesGetTest-543965088 None] Lock "cinder-036f5090-fabd-419d-b5be-31ffd83eec7d-delete_volume" released by "delete_volume" :: held 1.741s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:17:49 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-a5153be1-010b-4b48-9480-aa7283950654 tempest-VolumesExtendTest-251807362 None] Created reservations ['48d116e1-2a36-4b4d-a80f-7ba016d2bfb6', '255cdae4-5657-445a-a722-e500ddc1cb2c', 'e102118c-f284-44a7-9a61-e0c385f4b737', 'b26b26d4-9a3f-4a64-bf22-36a9db3ebfa4'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:17:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a5153be1-010b-4b48-9480-aa7283950654 tempest-VolumesExtendTest-251807362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:17:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a5153be1-010b-4b48-9480-aa7283950654 tempest-VolumesExtendTest-251807362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:17:49 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a5153be1-010b-4b48-9480-aa7283950654 tempest-VolumesExtendTest-251807362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:17:49 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a5153be1-010b-4b48-9480-aa7283950654 tempest-VolumesExtendTest-251807362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:17:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a5153be1-010b-4b48-9480-aa7283950654 tempest-VolumesExtendTest-251807362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:17:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a5153be1-010b-4b48-9480-aa7283950654 tempest-VolumesExtendTest-251807362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:49 devstack sudo[95721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:17:49 devstack sudo[95721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:50 devstack sudo[95721]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a5153be1-010b-4b48-9480-aa7283950654 tempest-VolumesExtendTest-251807362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.391s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:50 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-a5153be1-010b-4b48-9480-aa7283950654 tempest-VolumesExtendTest-251807362 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:17:50 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-a5153be1-010b-4b48-9480-aa7283950654 tempest-VolumesExtendTest-251807362 None] Deleted volume successfully. Nov 04 12:17:50 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a5153be1-010b-4b48-9480-aa7283950654 tempest-VolumesExtendTest-251807362 None] Lock "cinder-4efd45ef-de40-41e2-90b7-f31d550603cb-delete_volume" released by "delete_volume" :: held 1.781s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:17:50 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa41de4f-7707-4989-9901-2ad5b5e2b492 tempest-VolumesGetTest-543965088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:17:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-aa41de4f-7707-4989-9901-2ad5b5e2b492 tempest-VolumesGetTest-543965088 None] Flow 'volume_create_manager' (f7f5389f-c0f2-404e-a603-6f5be7ed2902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:17:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-aa41de4f-7707-4989-9901-2ad5b5e2b492 tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36d3beee-4595-43fa-856f-e909abab391c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:17:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-aa41de4f-7707-4989-9901-2ad5b5e2b492 tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36d3beee-4595-43fa-856f-e909abab391c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:17:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-71312725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c14b290-55cd-4a3f-9751-df213a476767,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='49933e1eef4b45629df206d9a70d2739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:17:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:17:50Z,use_quota=True,user_id='916d8be431be4dab84c49f86dfb5372e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:17:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-aa41de4f-7707-4989-9901-2ad5b5e2b492 tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf7dd8ee-88b9-44f9-aeec-55b40f5d6732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:17:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-aa41de4f-7707-4989-9901-2ad5b5e2b492 tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf7dd8ee-88b9-44f9-aeec-55b40f5d6732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:17:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-aa41de4f-7707-4989-9901-2ad5b5e2b492 tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (916e7255-bc1d-4833-a271-d797645390f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:17:50 devstack cinder-volume[87095]: DEBUG cinder.image.glance [None req-aa41de4f-7707-4989-9901-2ad5b5e2b492 tempest-VolumesGetTest-543965088 None] Creating Keystone auth plugin from conf {{(pid=87095) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 04 12:17:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-aa41de4f-7707-4989-9901-2ad5b5e2b492 tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (916e7255-bc1d-4833-a271-d797645390f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6c14b290-55cd-4a3f-9751-df213a476767', 'volume_name': 'volume-6c14b290-55cd-4a3f-9751-df213a476767', 'volume_size': 1, 'image_id': 'b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '021c36f8b23249aabf2d5e363bccb8bc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af', 'created_at': datetime.datetime(2026, 11, 4, 11, 4, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 11, 4, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:17:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-aa41de4f-7707-4989-9901-2ad5b5e2b492 tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8466080-eec2-4334-be47-d303719321c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:17:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-aa41de4f-7707-4989-9901-2ad5b5e2b492 tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8466080-eec2-4334-be47-d303719321c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:17:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-aa41de4f-7707-4989-9901-2ad5b5e2b492 tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89eccae7-f4d0-42ea-9764-653753210b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:17:50 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-aa41de4f-7707-4989-9901-2ad5b5e2b492 tempest-VolumesGetTest-543965088 None] Volume 6c14b290-55cd-4a3f-9751-df213a476767: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6c14b290-55cd-4a3f-9751-df213a476767', 'volume_size': 1, 'image_id': 'b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '021c36f8b23249aabf2d5e363bccb8bc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af', 'created_at': datetime.datetime(2026, 11, 4, 11, 4, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 11, 4, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 04 12:17:50 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa41de4f-7707-4989-9901-2ad5b5e2b492 tempest-VolumesGetTest-543965088 None] Trying to clone 6c14b290-55cd-4a3f-9751-df213a476767 from image b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af at location (None, [{'url': 'file:///opt/stack/data/glance/images/b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af', 'metadata': {}}]). {{(pid=87095) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 04 12:17:51 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-aa41de4f-7707-4989-9901-2ad5b5e2b492 tempest-VolumesGetTest-543965088 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_oudvi8uudevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87095) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 04 12:17:51 devstack cinder-volume[87095]: INFO cinder.image.image_utils [None req-aa41de4f-7707-4989-9901-2ad5b5e2b492 tempest-VolumesGetTest-543965088 None] Image download 20.69 MB at 20.69 MB/s Nov 04 12:17:51 devstack sudo[95284]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e57273ac-ee7e-4c22-b876-bfd0a8699546 tempest-TestInstancesWithCinderVolumes-2035661098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_480da815-23bd-48bc-891e-c1c9d5d09d67_xzzqpl9mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9d58d6b3-adf2-4b46-94f2-7f39a50f8f9b" returned: 0 in 2.724s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:51 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-e57273ac-ee7e-4c22-b876-bfd0a8699546 tempest-TestInstancesWithCinderVolumes-2035661098 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_480da815-23bd-48bc-891e-c1c9d5d09d67_xzzqpl9mdevstack@QuobyteHD, size 112.00 MB, duration 2.73 sec, destination /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9d58d6b3-adf2-4b46-94f2-7f39a50f8f9b {{(pid=87095) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 12:17:51 devstack cinder-volume[87095]: INFO cinder.image.image_utils [None req-e57273ac-ee7e-4c22-b876-bfd0a8699546 tempest-TestInstancesWithCinderVolumes-2035661098 None] Converted 112.00 MB image at 41.09 MB/s Nov 04 12:17:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e57273ac-ee7e-4c22-b876-bfd0a8699546 tempest-TestInstancesWithCinderVolumes-2035661098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9d58d6b3-adf2-4b46-94f2-7f39a50f8f9b 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:51 devstack sudo[95734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9d58d6b3-adf2-4b46-94f2-7f39a50f8f9b 1G Nov 04 12:17:51 devstack sudo[95734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:51 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[881edde0-cdd3-4bee-b8fd-e80375129ae7]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:17:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-aa41de4f-7707-4989-9901-2ad5b5e2b492 tempest-VolumesGetTest-543965088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_oudvi8uudevstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:51 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-85e8b7d3-2f4e-4356-ba74-3562209bdb80 tempest-VolumesExtendTest-251807362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:17:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-85e8b7d3-2f4e-4356-ba74-3562209bdb80 tempest-VolumesExtendTest-251807362 None] Flow 'volume_create_manager' (196d0a69-c0e5-4e6d-9b7c-66bcab44af0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:17:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-85e8b7d3-2f4e-4356-ba74-3562209bdb80 tempest-VolumesExtendTest-251807362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60918089-77f9-4f0d-bb78-553e452979da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:17:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-85e8b7d3-2f4e-4356-ba74-3562209bdb80 tempest-VolumesExtendTest-251807362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60918089-77f9-4f0d-bb78-553e452979da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:17:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1924668391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1185db6-73b2-4f31-9aa0-4a8ff24087c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b9d356a250940e59fd8792dfd5cfe42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:17:51Z,use_quota=True,user_id='96377cc37c974f00bfe90fddd1123ac6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:17:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-85e8b7d3-2f4e-4356-ba74-3562209bdb80 tempest-VolumesExtendTest-251807362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10969c5c-6900-4a09-a603-72d2cc988654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:17:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-85e8b7d3-2f4e-4356-ba74-3562209bdb80 tempest-VolumesExtendTest-251807362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10969c5c-6900-4a09-a603-72d2cc988654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:17:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-85e8b7d3-2f4e-4356-ba74-3562209bdb80 tempest-VolumesExtendTest-251807362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ec73687-8db7-4e94-8971-fccbd88404e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:17:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-85e8b7d3-2f4e-4356-ba74-3562209bdb80 tempest-VolumesExtendTest-251807362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ec73687-8db7-4e94-8971-fccbd88404e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1185db6-73b2-4f31-9aa0-4a8ff24087c7', 'volume_name': 'volume-f1185db6-73b2-4f31-9aa0-4a8ff24087c7', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:17:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-85e8b7d3-2f4e-4356-ba74-3562209bdb80 tempest-VolumesExtendTest-251807362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec44398c-fe5e-465a-8f1a-9670c07da6df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:17:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-85e8b7d3-2f4e-4356-ba74-3562209bdb80 tempest-VolumesExtendTest-251807362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec44398c-fe5e-465a-8f1a-9670c07da6df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:17:51 devstack sudo[95736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_oudvi8uudevstack@QuobyteHD Nov 04 12:17:51 devstack sudo[95736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-85e8b7d3-2f4e-4356-ba74-3562209bdb80 tempest-VolumesExtendTest-251807362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c82f9215-9b26-4124-97d9-964be4c70e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:17:51 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-85e8b7d3-2f4e-4356-ba74-3562209bdb80 tempest-VolumesExtendTest-251807362 None] Volume f1185db6-73b2-4f31-9aa0-4a8ff24087c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1185db6-73b2-4f31-9aa0-4a8ff24087c7', 'volume_size': 1} Nov 04 12:17:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-85e8b7d3-2f4e-4356-ba74-3562209bdb80 tempest-VolumesExtendTest-251807362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:17:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-85e8b7d3-2f4e-4356-ba74-3562209bdb80 tempest-VolumesExtendTest-251807362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:17:51 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-85e8b7d3-2f4e-4356-ba74-3562209bdb80 tempest-VolumesExtendTest-251807362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:17:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1924668391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1185db6-73b2-4f31-9aa0-4a8ff24087c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b9d356a250940e59fd8792dfd5cfe42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:17:51Z,use_quota=True,user_id='96377cc37c974f00bfe90fddd1123ac6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:17:51 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-85e8b7d3-2f4e-4356-ba74-3562209bdb80 tempest-VolumesExtendTest-251807362 None] Creating volume f1185db6-73b2-4f31-9aa0-4a8ff24087c7 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:17:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-85e8b7d3-2f4e-4356-ba74-3562209bdb80 tempest-VolumesExtendTest-251807362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:17:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-85e8b7d3-2f4e-4356-ba74-3562209bdb80 tempest-VolumesExtendTest-251807362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:17:51 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-85e8b7d3-2f4e-4356-ba74-3562209bdb80 tempest-VolumesExtendTest-251807362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:17:51 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-85e8b7d3-2f4e-4356-ba74-3562209bdb80 tempest-VolumesExtendTest-251807362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:17:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-85e8b7d3-2f4e-4356-ba74-3562209bdb80 tempest-VolumesExtendTest-251807362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:17:51 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-85e8b7d3-2f4e-4356-ba74-3562209bdb80 tempest-VolumesExtendTest-251807362 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:17:51 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-85e8b7d3-2f4e-4356-ba74-3562209bdb80 tempest-VolumesExtendTest-251807362 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:17:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-85e8b7d3-2f4e-4356-ba74-3562209bdb80 tempest-VolumesExtendTest-251807362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f1185db6-73b2-4f31-9aa0-4a8ff24087c7 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:51 devstack sudo[95738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f1185db6-73b2-4f31-9aa0-4a8ff24087c7 1073741824 Nov 04 12:17:51 devstack sudo[95738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:51 devstack sudo[95734]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e57273ac-ee7e-4c22-b876-bfd0a8699546 tempest-TestInstancesWithCinderVolumes-2035661098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9d58d6b3-adf2-4b46-94f2-7f39a50f8f9b 1G" returned: 0 in 0.345s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:51 devstack cinder-volume[87095]: DEBUG cinder.volume.volume_utils [None req-e57273ac-ee7e-4c22-b876-bfd0a8699546 tempest-TestInstancesWithCinderVolumes-2035661098 None] Downloaded image 480da815-23bd-48bc-891e-c1c9d5d09d67 ((None, [{'url': 'file:///opt/stack/data/glance/images/480da815-23bd-48bc-891e-c1c9d5d09d67', 'metadata': {}}])) to volume 9d58d6b3-adf2-4b46-94f2-7f39a50f8f9b successfully. {{(pid=87095) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 04 12:17:51 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-e57273ac-ee7e-4c22-b876-bfd0a8699546 tempest-TestInstancesWithCinderVolumes-2035661098 None] Temporary image 480da815-23bd-48bc-891e-c1c9d5d09d67 for user a4f3604c7e344ac88ebb380917359bca is deleted. {{(pid=87095) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 04 12:17:51 devstack cinder-volume[87095]: DEBUG cinder.volume.volume_utils [None req-e57273ac-ee7e-4c22-b876-bfd0a8699546 tempest-TestInstancesWithCinderVolumes-2035661098 None] Marking volume 9d58d6b3-adf2-4b46-94f2-7f39a50f8f9b as bootable. {{(pid=87095) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 04 12:17:51 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-e57273ac-ee7e-4c22-b876-bfd0a8699546 tempest-TestInstancesWithCinderVolumes-2035661098 None] Copying metadata from image 480da815-23bd-48bc-891e-c1c9d5d09d67 to 9d58d6b3-adf2-4b46-94f2-7f39a50f8f9b. {{(pid=87095) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 04 12:17:51 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-e57273ac-ee7e-4c22-b876-bfd0a8699546 tempest-TestInstancesWithCinderVolumes-2035661098 None] Creating volume glance metadata for volume 9d58d6b3-adf2-4b46-94f2-7f39a50f8f9b backed by image 480da815-23bd-48bc-891e-c1c9d5d09d67 with: {'image_id': '480da815-23bd-48bc-891e-c1c9d5d09d67', 'image_name': 'tempest-scenario-img--1543519288', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87095) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 04 12:17:51 devstack sudo[95736]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-aa41de4f-7707-4989-9901-2ad5b5e2b492 tempest-VolumesGetTest-543965088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_oudvi8uudevstack@QuobyteHD" returned: 0 in 0.356s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:51 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-aa41de4f-7707-4989-9901-2ad5b5e2b492 tempest-VolumesGetTest-543965088 None] Temporary image b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af is fetched for user 916d8be431be4dab84c49f86dfb5372e. {{(pid=87095) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 04 12:17:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e57273ac-ee7e-4c22-b876-bfd0a8699546 tempest-TestInstancesWithCinderVolumes-2035661098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1befa8e-aeed-4012-9bc2-360e0e2ea53d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d58d6b3-adf2-4b46-94f2-7f39a50f8f9b', 'volume_size': 1, 'image_id': '480da815-23bd-48bc-891e-c1c9d5d09d67', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/480da815-23bd-48bc-891e-c1c9d5d09d67', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1543519288', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dd57901491a648308a96d935b392fa3e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '480da815-23bd-48bc-891e-c1c9d5d09d67', 'created_at': datetime.datetime(2026, 11, 4, 11, 17, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 11, 17, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/480da815-23bd-48bc-891e-c1c9d5d09d67/file', 'properties': {}}, 'image_service': }' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:17:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e57273ac-ee7e-4c22-b876-bfd0a8699546 tempest-TestInstancesWithCinderVolumes-2035661098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a4ce916-3fdc-4688-a094-383c20428e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:17:51 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-e57273ac-ee7e-4c22-b876-bfd0a8699546 tempest-TestInstancesWithCinderVolumes-2035661098 None] Volume volume-9d58d6b3-adf2-4b46-94f2-7f39a50f8f9b (9d58d6b3-adf2-4b46-94f2-7f39a50f8f9b): created successfully Nov 04 12:17:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e57273ac-ee7e-4c22-b876-bfd0a8699546 tempest-TestInstancesWithCinderVolumes-2035661098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a4ce916-3fdc-4688-a094-383c20428e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:17:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e57273ac-ee7e-4c22-b876-bfd0a8699546 tempest-TestInstancesWithCinderVolumes-2035661098 None] Flow 'volume_create_manager' (121c0d18-3908-4f43-8b75-5f3b9dd5f64c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:17:51 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-e57273ac-ee7e-4c22-b876-bfd0a8699546 tempest-TestInstancesWithCinderVolumes-2035661098 None] Created volume successfully. Nov 04 12:17:51 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e258de16-9ad0-4f2a-8ec6-43c46d47b1b9]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:17:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-aa41de4f-7707-4989-9901-2ad5b5e2b492 tempest-VolumesGetTest-543965088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_oudvi8uudevstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:51 devstack sudo[95749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_oudvi8uudevstack@QuobyteHD Nov 04 12:17:51 devstack sudo[95749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:51 devstack sudo[95738]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-85e8b7d3-2f4e-4356-ba74-3562209bdb80 tempest-VolumesExtendTest-251807362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f1185db6-73b2-4f31-9aa0-4a8ff24087c7 1073741824" returned: 0 in 0.543s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-85e8b7d3-2f4e-4356-ba74-3562209bdb80 tempest-VolumesExtendTest-251807362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f1185db6-73b2-4f31-9aa0-4a8ff24087c7 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:52 devstack sudo[95751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f1185db6-73b2-4f31-9aa0-4a8ff24087c7 Nov 04 12:17:52 devstack sudo[95751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:52 devstack sudo[95749]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-aa41de4f-7707-4989-9901-2ad5b5e2b492 tempest-VolumesGetTest-543965088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_oudvi8uudevstack@QuobyteHD" returned: 0 in 0.496s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-aa41de4f-7707-4989-9901-2ad5b5e2b492 tempest-VolumesGetTest-543965088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:17:52 devstack sudo[95751]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-85e8b7d3-2f4e-4356-ba74-3562209bdb80 tempest-VolumesExtendTest-251807362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f1185db6-73b2-4f31-9aa0-4a8ff24087c7" returned: 0 in 0.367s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:52 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-85e8b7d3-2f4e-4356-ba74-3562209bdb80 tempest-VolumesExtendTest-251807362 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:17:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-85e8b7d3-2f4e-4356-ba74-3562209bdb80 tempest-VolumesExtendTest-251807362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:17:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-aa41de4f-7707-4989-9901-2ad5b5e2b492 tempest-VolumesGetTest-543965088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.144s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:17:52 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-aa41de4f-7707-4989-9901-2ad5b5e2b492 tempest-VolumesGetTest-543965088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:17:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-71312725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c14b290-55cd-4a3f-9751-df213a476767,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='49933e1eef4b45629df206d9a70d2739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:17:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:17:50Z,use_quota=True,user_id='916d8be431be4dab84c49f86dfb5372e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:17:52 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-aa41de4f-7707-4989-9901-2ad5b5e2b492 tempest-VolumesGetTest-543965088 None] Creating volume 6c14b290-55cd-4a3f-9751-df213a476767 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:17:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-aa41de4f-7707-4989-9901-2ad5b5e2b492 tempest-VolumesGetTest-543965088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:17:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-aa41de4f-7707-4989-9901-2ad5b5e2b492 tempest-VolumesGetTest-543965088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:17:52 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-aa41de4f-7707-4989-9901-2ad5b5e2b492 tempest-VolumesGetTest-543965088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:17:52 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-aa41de4f-7707-4989-9901-2ad5b5e2b492 tempest-VolumesGetTest-543965088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:17:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-aa41de4f-7707-4989-9901-2ad5b5e2b492 tempest-VolumesGetTest-543965088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:17:52 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-aa41de4f-7707-4989-9901-2ad5b5e2b492 tempest-VolumesGetTest-543965088 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:17:52 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-aa41de4f-7707-4989-9901-2ad5b5e2b492 tempest-VolumesGetTest-543965088 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:17:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-aa41de4f-7707-4989-9901-2ad5b5e2b492 tempest-VolumesGetTest-543965088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6c14b290-55cd-4a3f-9751-df213a476767 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-85e8b7d3-2f4e-4356-ba74-3562209bdb80 tempest-VolumesExtendTest-251807362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c82f9215-9b26-4124-97d9-964be4c70e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1185db6-73b2-4f31-9aa0-4a8ff24087c7', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:17:52 devstack sudo[95759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6c14b290-55cd-4a3f-9751-df213a476767 1073741824 Nov 04 12:17:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-85e8b7d3-2f4e-4356-ba74-3562209bdb80 tempest-VolumesExtendTest-251807362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3751a47-40f9-4439-875e-14ec22988d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:17:52 devstack sudo[95759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:52 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-85e8b7d3-2f4e-4356-ba74-3562209bdb80 tempest-VolumesExtendTest-251807362 None] Volume volume-f1185db6-73b2-4f31-9aa0-4a8ff24087c7 (f1185db6-73b2-4f31-9aa0-4a8ff24087c7): created successfully Nov 04 12:17:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-85e8b7d3-2f4e-4356-ba74-3562209bdb80 tempest-VolumesExtendTest-251807362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3751a47-40f9-4439-875e-14ec22988d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:17:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-85e8b7d3-2f4e-4356-ba74-3562209bdb80 tempest-VolumesExtendTest-251807362 None] Flow 'volume_create_manager' (196d0a69-c0e5-4e6d-9b7c-66bcab44af0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:17:52 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-85e8b7d3-2f4e-4356-ba74-3562209bdb80 tempest-VolumesExtendTest-251807362 None] Created volume successfully. Nov 04 12:17:53 devstack sudo[95759]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-aa41de4f-7707-4989-9901-2ad5b5e2b492 tempest-VolumesGetTest-543965088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6c14b290-55cd-4a3f-9751-df213a476767 1073741824" returned: 0 in 0.624s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-aa41de4f-7707-4989-9901-2ad5b5e2b492 tempest-VolumesGetTest-543965088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6c14b290-55cd-4a3f-9751-df213a476767 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:53 devstack sudo[95767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6c14b290-55cd-4a3f-9751-df213a476767 Nov 04 12:17:53 devstack sudo[95767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:53 devstack sudo[95767]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-aa41de4f-7707-4989-9901-2ad5b5e2b492 tempest-VolumesGetTest-543965088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6c14b290-55cd-4a3f-9751-df213a476767" returned: 0 in 0.582s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:53 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-aa41de4f-7707-4989-9901-2ad5b5e2b492 tempest-VolumesGetTest-543965088 None] <== create_volume: return (1283ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:17:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-aa41de4f-7707-4989-9901-2ad5b5e2b492 tempest-VolumesGetTest-543965088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.296s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:17:53 devstack cinder-volume[87095]: DEBUG cinder.volume.volume_utils [None req-aa41de4f-7707-4989-9901-2ad5b5e2b492 tempest-VolumesGetTest-543965088 None] Attempting download of b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af ((None, [{'url': 'file:///opt/stack/data/glance/images/b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af', 'metadata': {}}])) to volume 6c14b290-55cd-4a3f-9751-df213a476767. {{(pid=87095) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 04 12:17:53 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[8777fdac-6b6f-44d9-aa0b-7fca4a2e7568]: (4, 'raw') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:17:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-aa41de4f-7707-4989-9901-2ad5b5e2b492 tempest-VolumesGetTest-543965088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_f48lsysm {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:54 devstack sudo[95889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_f48lsysm Nov 04 12:17:54 devstack sudo[95889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-389be252-dcca-4b8a-9797-f0424f4bf206 tempest-VolumesExtendTest-251807362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:17:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-389be252-dcca-4b8a-9797-f0424f4bf206 tempest-VolumesExtendTest-251807362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:17:54 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-389be252-dcca-4b8a-9797-f0424f4bf206 tempest-VolumesExtendTest-251807362 None] Creating offline snapshot 722dda03-f29c-4f70-ae9e-400f90f447fb of volume f1185db6-73b2-4f31-9aa0-4a8ff24087c7 {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 12:17:54 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b577da5-d21c-41bd-b023-63c5c592724a]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:17:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-389be252-dcca-4b8a-9797-f0424f4bf206 tempest-VolumesExtendTest-251807362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f1185db6-73b2-4f31-9aa0-4a8ff24087c7 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:54 devstack sudo[95915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f1185db6-73b2-4f31-9aa0-4a8ff24087c7 Nov 04 12:17:54 devstack sudo[95915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:54 devstack sudo[95889]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-aa41de4f-7707-4989-9901-2ad5b5e2b492 tempest-VolumesGetTest-543965088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_f48lsysm" returned: 0 in 0.594s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-aa41de4f-7707-4989-9901-2ad5b5e2b492 tempest-VolumesGetTest-543965088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_f48lsysm {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:54 devstack sudo[95920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_f48lsysm Nov 04 12:17:54 devstack sudo[95920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:54 devstack sudo[95915]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-389be252-dcca-4b8a-9797-f0424f4bf206 tempest-VolumesExtendTest-251807362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f1185db6-73b2-4f31-9aa0-4a8ff24087c7" returned: 0 in 0.455s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-389be252-dcca-4b8a-9797-f0424f4bf206 tempest-VolumesExtendTest-251807362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f1185db6-73b2-4f31-9aa0-4a8ff24087c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f1185db6-73b2-4f31-9aa0-4a8ff24087c7.722dda03-f29c-4f70-ae9e-400f90f447fb 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:54 devstack sudo[95934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f1185db6-73b2-4f31-9aa0-4a8ff24087c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f1185db6-73b2-4f31-9aa0-4a8ff24087c7.722dda03-f29c-4f70-ae9e-400f90f447fb 1G Nov 04 12:17:54 devstack sudo[95934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:55 devstack sudo[95920]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-aa41de4f-7707-4989-9901-2ad5b5e2b492 tempest-VolumesGetTest-543965088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_f48lsysm" returned: 1 in 0.448s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-aa41de4f-7707-4989-9901-2ad5b5e2b492 tempest-VolumesGetTest-543965088 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_f48lsysm' failed. Not Retrying. {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 12:17:55 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9624daba-33cc-4b99-aec7-8e56ebb8c3cf]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:17:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-aa41de4f-7707-4989-9901-2ad5b5e2b492 tempest-VolumesGetTest-543965088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_oudvi8uudevstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:55 devstack sudo[95942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_oudvi8uudevstack@QuobyteHD Nov 04 12:17:55 devstack sudo[95942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:55 devstack sudo[95942]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-aa41de4f-7707-4989-9901-2ad5b5e2b492 tempest-VolumesGetTest-543965088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_oudvi8uudevstack@QuobyteHD" returned: 0 in 0.575s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:55 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-aa41de4f-7707-4989-9901-2ad5b5e2b492 tempest-VolumesGetTest-543965088 None] b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af was qcow2, converting to qcow2 {{(pid=87095) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 04 12:17:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-aa41de4f-7707-4989-9901-2ad5b5e2b492 tempest-VolumesGetTest-543965088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_oudvi8uudevstack@QuobyteHD /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6c14b290-55cd-4a3f-9751-df213a476767 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:55 devstack sudo[96287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_oudvi8uudevstack@QuobyteHD /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6c14b290-55cd-4a3f-9751-df213a476767 Nov 04 12:17:55 devstack sudo[96287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:55 devstack sudo[95934]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-389be252-dcca-4b8a-9797-f0424f4bf206 tempest-VolumesExtendTest-251807362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f1185db6-73b2-4f31-9aa0-4a8ff24087c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f1185db6-73b2-4f31-9aa0-4a8ff24087c7.722dda03-f29c-4f70-ae9e-400f90f447fb 1G" returned: 0 in 0.909s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-389be252-dcca-4b8a-9797-f0424f4bf206 tempest-VolumesExtendTest-251807362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1185db6-73b2-4f31-9aa0-4a8ff24087c7 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f1185db6-73b2-4f31-9aa0-4a8ff24087c7.722dda03-f29c-4f70-ae9e-400f90f447fb {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:55 devstack sudo[96302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1185db6-73b2-4f31-9aa0-4a8ff24087c7 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f1185db6-73b2-4f31-9aa0-4a8ff24087c7.722dda03-f29c-4f70-ae9e-400f90f447fb Nov 04 12:17:55 devstack sudo[96302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-aef78e6c-14c8-4f86-85fa-f5cc32dec7d1 req-27d48b4c-4981-4075-af86-93a6f7c3ee90 tempest-TestInstancesWithCinderVolumes-2035661098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:17:56 devstack sudo[96302]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-389be252-dcca-4b8a-9797-f0424f4bf206 tempest-VolumesExtendTest-251807362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1185db6-73b2-4f31-9aa0-4a8ff24087c7 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f1185db6-73b2-4f31-9aa0-4a8ff24087c7.722dda03-f29c-4f70-ae9e-400f90f447fb" returned: 0 in 0.733s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:56 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-389be252-dcca-4b8a-9797-f0424f4bf206 tempest-VolumesExtendTest-251807362 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f1185db6-73b2-4f31-9aa0-4a8ff24087c7.722dda03-f29c-4f70-ae9e-400f90f447fb is being set with open permissions: ugo+rw Nov 04 12:17:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-389be252-dcca-4b8a-9797-f0424f4bf206 tempest-VolumesExtendTest-251807362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f1185db6-73b2-4f31-9aa0-4a8ff24087c7.722dda03-f29c-4f70-ae9e-400f90f447fb {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:56 devstack sudo[96345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f1185db6-73b2-4f31-9aa0-4a8ff24087c7.722dda03-f29c-4f70-ae9e-400f90f447fb Nov 04 12:17:56 devstack sudo[96345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:57 devstack sudo[96345]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-389be252-dcca-4b8a-9797-f0424f4bf206 tempest-VolumesExtendTest-251807362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f1185db6-73b2-4f31-9aa0-4a8ff24087c7.722dda03-f29c-4f70-ae9e-400f90f447fb" returned: 0 in 0.570s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-389be252-dcca-4b8a-9797-f0424f4bf206 tempest-VolumesExtendTest-251807362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f1185db6-73b2-4f31-9aa0-4a8ff24087c7.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:57 devstack sudo[96360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f1185db6-73b2-4f31-9aa0-4a8ff24087c7.info Nov 04 12:17:57 devstack sudo[96360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:57 devstack sudo[96360]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-389be252-dcca-4b8a-9797-f0424f4bf206 tempest-VolumesExtendTest-251807362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f1185db6-73b2-4f31-9aa0-4a8ff24087c7.info" returned: 0 in 0.481s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:57 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-389be252-dcca-4b8a-9797-f0424f4bf206 tempest-VolumesExtendTest-251807362 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f1185db6-73b2-4f31-9aa0-4a8ff24087c7.info is being set with open permissions: ugo+rw Nov 04 12:17:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-389be252-dcca-4b8a-9797-f0424f4bf206 tempest-VolumesExtendTest-251807362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f1185db6-73b2-4f31-9aa0-4a8ff24087c7.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:57 devstack sudo[96365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f1185db6-73b2-4f31-9aa0-4a8ff24087c7.info Nov 04 12:17:57 devstack sudo[96365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:58 devstack sudo[96365]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-389be252-dcca-4b8a-9797-f0424f4bf206 tempest-VolumesExtendTest-251807362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f1185db6-73b2-4f31-9aa0-4a8ff24087c7.info" returned: 0 in 0.547s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-389be252-dcca-4b8a-9797-f0424f4bf206 tempest-VolumesExtendTest-251807362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.865s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:17:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-aef78e6c-14c8-4f86-85fa-f5cc32dec7d1 req-27d48b4c-4981-4075-af86-93a6f7c3ee90 tempest-TestInstancesWithCinderVolumes-2035661098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.715s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:17:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-aef78e6c-14c8-4f86-85fa-f5cc32dec7d1 req-27d48b4c-4981-4075-af86-93a6f7c3ee90 tempest-TestInstancesWithCinderVolumes-2035661098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:17:58 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-389be252-dcca-4b8a-9797-f0424f4bf206 tempest-VolumesExtendTest-251807362 None] Create snapshot completed successfully Nov 04 12:17:58 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-aef78e6c-14c8-4f86-85fa-f5cc32dec7d1 req-27d48b4c-4981-4075-af86-93a6f7c3ee90 tempest-TestInstancesWithCinderVolumes-2035661098 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784', 'name': 'volume-9d58d6b3-adf2-4b46-94f2-7f39a50f8f9b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ef903268-d69f-47c1-97a8-695fe7ad53f9', 'enforce_multipath': True} {{(pid=87095) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 12:17:58 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-aef78e6c-14c8-4f86-85fa-f5cc32dec7d1 req-27d48b4c-4981-4075-af86-93a6f7c3ee90 tempest-TestInstancesWithCinderVolumes-2035661098 None] attachment_update completed successfully. Nov 04 12:17:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-72e9125c-cd87-4181-8c8f-a74f8ef037d2 tempest-VolumesExtendTest-251807362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:17:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-72e9125c-cd87-4181-8c8f-a74f8ef037d2 tempest-VolumesExtendTest-251807362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:17:58 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[165481b1-39fe-43a4-8e36-60ccd744f812]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:17:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-72e9125c-cd87-4181-8c8f-a74f8ef037d2 tempest-VolumesExtendTest-251807362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f1185db6-73b2-4f31-9aa0-4a8ff24087c7 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:59 devstack sudo[96369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f1185db6-73b2-4f31-9aa0-4a8ff24087c7 Nov 04 12:17:59 devstack sudo[96369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:59 devstack sudo[96287]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-aa41de4f-7707-4989-9901-2ad5b5e2b492 tempest-VolumesGetTest-543965088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_oudvi8uudevstack@QuobyteHD /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6c14b290-55cd-4a3f-9751-df213a476767" returned: 0 in 3.631s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:59 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-aa41de4f-7707-4989-9901-2ad5b5e2b492 tempest-VolumesGetTest-543965088 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_oudvi8uudevstack@QuobyteHD, size 112.00 MB, duration 3.63 sec, destination /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6c14b290-55cd-4a3f-9751-df213a476767 {{(pid=87095) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 12:17:59 devstack cinder-volume[87095]: INFO cinder.image.image_utils [None req-aa41de4f-7707-4989-9901-2ad5b5e2b492 tempest-VolumesGetTest-543965088 None] Converted 112.00 MB image at 30.83 MB/s Nov 04 12:17:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-aa41de4f-7707-4989-9901-2ad5b5e2b492 tempest-VolumesGetTest-543965088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6c14b290-55cd-4a3f-9751-df213a476767 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:59 devstack sudo[96371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6c14b290-55cd-4a3f-9751-df213a476767 1G Nov 04 12:17:59 devstack sudo[96371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:17:59 devstack sudo[96369]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-72e9125c-cd87-4181-8c8f-a74f8ef037d2 tempest-VolumesExtendTest-251807362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f1185db6-73b2-4f31-9aa0-4a8ff24087c7" returned: 0 in 0.741s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-72e9125c-cd87-4181-8c8f-a74f8ef037d2 tempest-VolumesExtendTest-251807362 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f1185db6-73b2-4f31-9aa0-4a8ff24087c7.722dda03-f29c-4f70-ae9e-400f90f447fb 2G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:17:59 devstack sudo[96371]: pam_unix(sudo:session): session closed for user root Nov 04 12:17:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-aa41de4f-7707-4989-9901-2ad5b5e2b492 tempest-VolumesGetTest-543965088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6c14b290-55cd-4a3f-9751-df213a476767 1G" returned: 0 in 0.547s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:59 devstack cinder-volume[87095]: DEBUG cinder.volume.volume_utils [None req-aa41de4f-7707-4989-9901-2ad5b5e2b492 tempest-VolumesGetTest-543965088 None] Downloaded image b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af ((None, [{'url': 'file:///opt/stack/data/glance/images/b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af', 'metadata': {}}])) to volume 6c14b290-55cd-4a3f-9751-df213a476767 successfully. {{(pid=87095) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 04 12:17:59 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-aa41de4f-7707-4989-9901-2ad5b5e2b492 tempest-VolumesGetTest-543965088 None] Temporary image b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af for user 916d8be431be4dab84c49f86dfb5372e is deleted. {{(pid=87095) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 04 12:17:59 devstack cinder-volume[87095]: DEBUG cinder.volume.volume_utils [None req-aa41de4f-7707-4989-9901-2ad5b5e2b492 tempest-VolumesGetTest-543965088 None] Marking volume 6c14b290-55cd-4a3f-9751-df213a476767 as bootable. {{(pid=87095) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 04 12:17:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-72e9125c-cd87-4181-8c8f-a74f8ef037d2 tempest-VolumesExtendTest-251807362 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f1185db6-73b2-4f31-9aa0-4a8ff24087c7.722dda03-f29c-4f70-ae9e-400f90f447fb 2G" returned: 0 in 0.243s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:17:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-72e9125c-cd87-4181-8c8f-a74f8ef037d2 tempest-VolumesExtendTest-251807362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.051s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:17:59 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa41de4f-7707-4989-9901-2ad5b5e2b492 tempest-VolumesGetTest-543965088 None] Copying metadata from image b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af to 6c14b290-55cd-4a3f-9751-df213a476767. {{(pid=87095) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 04 12:17:59 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa41de4f-7707-4989-9901-2ad5b5e2b492 tempest-VolumesGetTest-543965088 None] Creating volume glance metadata for volume 6c14b290-55cd-4a3f-9751-df213a476767 backed by image b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87095) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 04 12:17:59 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-72e9125c-cd87-4181-8c8f-a74f8ef037d2 tempest-VolumesExtendTest-251807362 None] Extend volume completed successfully. Nov 04 12:18:00 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-aa41de4f-7707-4989-9901-2ad5b5e2b492 tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89eccae7-f4d0-42ea-9764-653753210b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c14b290-55cd-4a3f-9751-df213a476767', 'volume_size': 1, 'image_id': 'b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '021c36f8b23249aabf2d5e363bccb8bc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af', 'created_at': datetime.datetime(2026, 11, 4, 11, 4, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 11, 4, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:18:00 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-aa41de4f-7707-4989-9901-2ad5b5e2b492 tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75c05180-efbe-4df9-8af7-b9997a479677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:18:00 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-aa41de4f-7707-4989-9901-2ad5b5e2b492 tempest-VolumesGetTest-543965088 None] Volume volume-6c14b290-55cd-4a3f-9751-df213a476767 (6c14b290-55cd-4a3f-9751-df213a476767): created successfully Nov 04 12:18:00 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-aa41de4f-7707-4989-9901-2ad5b5e2b492 tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75c05180-efbe-4df9-8af7-b9997a479677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:18:00 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-aa41de4f-7707-4989-9901-2ad5b5e2b492 tempest-VolumesGetTest-543965088 None] Flow 'volume_create_manager' (f7f5389f-c0f2-404e-a603-6f5be7ed2902) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:18:00 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-aa41de4f-7707-4989-9901-2ad5b5e2b492 tempest-VolumesGetTest-543965088 None] Created volume successfully. Nov 04 12:18:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-5dc1b771-188c-4ceb-8b8c-012bc5f483c0 tempest-VolumesExtendTest-251807362 None] Acquiring lock "cinder-722dda03-f29c-4f70-ae9e-400f90f447fb-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:18:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-5dc1b771-188c-4ceb-8b8c-012bc5f483c0 tempest-VolumesExtendTest-251807362 None] Lock "cinder-722dda03-f29c-4f70-ae9e-400f90f447fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:18:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-5dc1b771-188c-4ceb-8b8c-012bc5f483c0 tempest-VolumesExtendTest-251807362 None] Acquiring lock "cinder-quobyte-f1185db6-73b2-4f31-9aa0-4a8ff24087c7" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:18:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-5dc1b771-188c-4ceb-8b8c-012bc5f483c0 tempest-VolumesExtendTest-251807362 None] Lock "cinder-quobyte-f1185db6-73b2-4f31-9aa0-4a8ff24087c7" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:18:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-5dc1b771-188c-4ceb-8b8c-012bc5f483c0 tempest-VolumesExtendTest-251807362 None] Acquiring lock "cinder-quobyte-722dda03-f29c-4f70-ae9e-400f90f447fb" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:18:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-5dc1b771-188c-4ceb-8b8c-012bc5f483c0 tempest-VolumesExtendTest-251807362 None] Lock "cinder-quobyte-722dda03-f29c-4f70-ae9e-400f90f447fb" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:18:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-5dc1b771-188c-4ceb-8b8c-012bc5f483c0 tempest-VolumesExtendTest-251807362 None] Deleting offline snapshot 722dda03-f29c-4f70-ae9e-400f90f447fb of volume f1185db6-73b2-4f31-9aa0-4a8ff24087c7 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 12:18:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-5dc1b771-188c-4ceb-8b8c-012bc5f483c0 tempest-VolumesExtendTest-251807362 None] snapshot_file for this snap is: volume-f1185db6-73b2-4f31-9aa0-4a8ff24087c7.722dda03-f29c-4f70-ae9e-400f90f447fb {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 12:18:01 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 12:18:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:18:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:18:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:18:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:18:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:18:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:18:01 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d9d2b49-f9b0-4c5c-a1d2-8c4a799b6443]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:18:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5dc1b771-188c-4ceb-8b8c-012bc5f483c0 tempest-VolumesExtendTest-251807362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f1185db6-73b2-4f31-9aa0-4a8ff24087c7.722dda03-f29c-4f70-ae9e-400f90f447fb {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:18:01 devstack sudo[96442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:18:01 devstack sudo[96442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:18:02 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e545ab6-a34f-418c-8ab9-fb0803202e1b tempest-VolumesGetTest-543965088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:18:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5e545ab6-a34f-418c-8ab9-fb0803202e1b tempest-VolumesGetTest-543965088 None] Flow 'volume_create_manager' (f428bc32-f250-4abd-a1d3-2c429e915c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:18:02 devstack sudo[96443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f1185db6-73b2-4f31-9aa0-4a8ff24087c7.722dda03-f29c-4f70-ae9e-400f90f447fb Nov 04 12:18:02 devstack sudo[96443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:18:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5e545ab6-a34f-418c-8ab9-fb0803202e1b tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acb552fa-55ec-433b-a40f-075d76b4bce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:18:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5e545ab6-a34f-418c-8ab9-fb0803202e1b tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acb552fa-55ec-433b-a40f-075d76b4bce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:18:01Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1023389023',display_name='tempest-VolumesGetTest-Volume-438842923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e29e8a2-46cb-4894-a143-df7d314e9811,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49933e1eef4b45629df206d9a70d2739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:18:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:18:02Z,use_quota=True,user_id='916d8be431be4dab84c49f86dfb5372e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:18:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5e545ab6-a34f-418c-8ab9-fb0803202e1b tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3390954e-5419-45f5-a093-26f57e9dfa61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:18:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5e545ab6-a34f-418c-8ab9-fb0803202e1b tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3390954e-5419-45f5-a093-26f57e9dfa61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:18:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5e545ab6-a34f-418c-8ab9-fb0803202e1b tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf09772b-a214-42f6-a277-e9b0ff7e69ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:18:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5e545ab6-a34f-418c-8ab9-fb0803202e1b tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf09772b-a214-42f6-a277-e9b0ff7e69ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e29e8a2-46cb-4894-a143-df7d314e9811', 'volume_name': 'volume-0e29e8a2-46cb-4894-a143-df7d314e9811', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:18:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5e545ab6-a34f-418c-8ab9-fb0803202e1b tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (771760c6-e397-417c-9d6c-cde1f45ab06a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:18:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5e545ab6-a34f-418c-8ab9-fb0803202e1b tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (771760c6-e397-417c-9d6c-cde1f45ab06a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:18:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5e545ab6-a34f-418c-8ab9-fb0803202e1b tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6919ac38-0db0-4c4c-aebe-f19427bd981b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:18:02 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-5e545ab6-a34f-418c-8ab9-fb0803202e1b tempest-VolumesGetTest-543965088 None] Volume 0e29e8a2-46cb-4894-a143-df7d314e9811: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e29e8a2-46cb-4894-a143-df7d314e9811', 'volume_size': 1} Nov 04 12:18:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5e545ab6-a34f-418c-8ab9-fb0803202e1b tempest-VolumesGetTest-543965088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:18:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5e545ab6-a34f-418c-8ab9-fb0803202e1b tempest-VolumesGetTest-543965088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:18:02 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-5e545ab6-a34f-418c-8ab9-fb0803202e1b tempest-VolumesGetTest-543965088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:18:01Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1023389023',display_name='tempest-VolumesGetTest-Volume-438842923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e29e8a2-46cb-4894-a143-df7d314e9811,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49933e1eef4b45629df206d9a70d2739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:18:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:18:02Z,use_quota=True,user_id='916d8be431be4dab84c49f86dfb5372e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:18:02 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-5e545ab6-a34f-418c-8ab9-fb0803202e1b tempest-VolumesGetTest-543965088 None] Creating volume 0e29e8a2-46cb-4894-a143-df7d314e9811 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:18:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5e545ab6-a34f-418c-8ab9-fb0803202e1b tempest-VolumesGetTest-543965088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:18:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5e545ab6-a34f-418c-8ab9-fb0803202e1b tempest-VolumesGetTest-543965088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:18:02 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-5e545ab6-a34f-418c-8ab9-fb0803202e1b tempest-VolumesGetTest-543965088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:18:02 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-5e545ab6-a34f-418c-8ab9-fb0803202e1b tempest-VolumesGetTest-543965088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:18:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5e545ab6-a34f-418c-8ab9-fb0803202e1b tempest-VolumesGetTest-543965088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:18:02 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-5e545ab6-a34f-418c-8ab9-fb0803202e1b tempest-VolumesGetTest-543965088 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:18:02 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-5e545ab6-a34f-418c-8ab9-fb0803202e1b tempest-VolumesGetTest-543965088 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:18:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5e545ab6-a34f-418c-8ab9-fb0803202e1b tempest-VolumesGetTest-543965088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0e29e8a2-46cb-4894-a143-df7d314e9811 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:18:02 devstack sudo[96442]: pam_unix(sudo:session): session closed for user root Nov 04 12:18:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.712s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:18:02 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:18:02 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Running periodic task VolumeManager._thread_info {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 12:18:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] thread count: 28 {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 12:18:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] thread info: [<_MainThread(MainThread, started 140610387472512)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 12:18:02 devstack sudo[96454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0e29e8a2-46cb-4894-a143-df7d314e9811 1073741824 Nov 04 12:18:02 devstack sudo[96454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:18:02 devstack sudo[96443]: pam_unix(sudo:session): session closed for user root Nov 04 12:18:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5dc1b771-188c-4ceb-8b8c-012bc5f483c0 tempest-VolumesExtendTest-251807362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f1185db6-73b2-4f31-9aa0-4a8ff24087c7.722dda03-f29c-4f70-ae9e-400f90f447fb" returned: 0 in 0.988s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:18:02 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-5dc1b771-188c-4ceb-8b8c-012bc5f483c0 tempest-VolumesExtendTest-251807362 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1185db6-73b2-4f31-9aa0-4a8ff24087c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 12:18:02 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7521241-79cc-4138-b808-b7aa5b415286]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:18:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5dc1b771-188c-4ceb-8b8c-012bc5f483c0 tempest-VolumesExtendTest-251807362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f1185db6-73b2-4f31-9aa0-4a8ff24087c7 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:18:03 devstack sudo[96463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f1185db6-73b2-4f31-9aa0-4a8ff24087c7 Nov 04 12:18:03 devstack sudo[96463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:18:03 devstack sudo[96454]: pam_unix(sudo:session): session closed for user root Nov 04 12:18:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5e545ab6-a34f-418c-8ab9-fb0803202e1b tempest-VolumesGetTest-543965088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0e29e8a2-46cb-4894-a143-df7d314e9811 1073741824" returned: 0 in 0.905s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:18:03 devstack sudo[96463]: pam_unix(sudo:session): session closed for user root Nov 04 12:18:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5dc1b771-188c-4ceb-8b8c-012bc5f483c0 tempest-VolumesExtendTest-251807362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f1185db6-73b2-4f31-9aa0-4a8ff24087c7" returned: 0 in 0.564s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:18:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5dc1b771-188c-4ceb-8b8c-012bc5f483c0 tempest-VolumesExtendTest-251807362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f1185db6-73b2-4f31-9aa0-4a8ff24087c7.722dda03-f29c-4f70-ae9e-400f90f447fb {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:18:03 devstack sudo[96474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f1185db6-73b2-4f31-9aa0-4a8ff24087c7.722dda03-f29c-4f70-ae9e-400f90f447fb Nov 04 12:18:03 devstack sudo[96474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:18:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5e545ab6-a34f-418c-8ab9-fb0803202e1b tempest-VolumesGetTest-543965088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0e29e8a2-46cb-4894-a143-df7d314e9811 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:18:03 devstack sudo[96476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0e29e8a2-46cb-4894-a143-df7d314e9811 Nov 04 12:18:03 devstack sudo[96476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:18:03 devstack sudo[96476]: pam_unix(sudo:session): session closed for user root Nov 04 12:18:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5e545ab6-a34f-418c-8ab9-fb0803202e1b tempest-VolumesGetTest-543965088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0e29e8a2-46cb-4894-a143-df7d314e9811" returned: 0 in 0.426s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:18:03 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-5e545ab6-a34f-418c-8ab9-fb0803202e1b tempest-VolumesGetTest-543965088 None] <== create_volume: return (1479ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:18:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5e545ab6-a34f-418c-8ab9-fb0803202e1b tempest-VolumesGetTest-543965088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.491s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:18:03 devstack sudo[96474]: pam_unix(sudo:session): session closed for user root Nov 04 12:18:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5dc1b771-188c-4ceb-8b8c-012bc5f483c0 tempest-VolumesExtendTest-251807362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f1185db6-73b2-4f31-9aa0-4a8ff24087c7.722dda03-f29c-4f70-ae9e-400f90f447fb" returned: 0 in 0.524s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:18:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5dc1b771-188c-4ceb-8b8c-012bc5f483c0 tempest-VolumesExtendTest-251807362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f1185db6-73b2-4f31-9aa0-4a8ff24087c7.722dda03-f29c-4f70-ae9e-400f90f447fb {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:18:03 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5e545ab6-a34f-418c-8ab9-fb0803202e1b tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6919ac38-0db0-4c4c-aebe-f19427bd981b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e29e8a2-46cb-4894-a143-df7d314e9811', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:18:04 devstack sudo[96483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f1185db6-73b2-4f31-9aa0-4a8ff24087c7.722dda03-f29c-4f70-ae9e-400f90f447fb Nov 04 12:18:04 devstack sudo[96483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:18:04 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5e545ab6-a34f-418c-8ab9-fb0803202e1b tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28018f82-6402-4063-ac84-07d9576424ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:18:04 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-5e545ab6-a34f-418c-8ab9-fb0803202e1b tempest-VolumesGetTest-543965088 None] Volume volume-0e29e8a2-46cb-4894-a143-df7d314e9811 (0e29e8a2-46cb-4894-a143-df7d314e9811): created successfully Nov 04 12:18:04 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5e545ab6-a34f-418c-8ab9-fb0803202e1b tempest-VolumesGetTest-543965088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28018f82-6402-4063-ac84-07d9576424ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:18:04 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5e545ab6-a34f-418c-8ab9-fb0803202e1b tempest-VolumesGetTest-543965088 None] Flow 'volume_create_manager' (f428bc32-f250-4abd-a1d3-2c429e915c82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:18:04 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-5e545ab6-a34f-418c-8ab9-fb0803202e1b tempest-VolumesGetTest-543965088 None] Created volume successfully. Nov 04 12:18:04 devstack sudo[96483]: pam_unix(sudo:session): session closed for user root Nov 04 12:18:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5dc1b771-188c-4ceb-8b8c-012bc5f483c0 tempest-VolumesExtendTest-251807362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f1185db6-73b2-4f31-9aa0-4a8ff24087c7.722dda03-f29c-4f70-ae9e-400f90f447fb" returned: 0 in 0.298s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:18:04 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-5dc1b771-188c-4ceb-8b8c-012bc5f483c0 tempest-VolumesExtendTest-251807362 None] Lock "cinder-quobyte-722dda03-f29c-4f70-ae9e-400f90f447fb" released by "_delete_snapshot" :: held 2.709s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:18:04 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-5dc1b771-188c-4ceb-8b8c-012bc5f483c0 tempest-VolumesExtendTest-251807362 None] Lock "cinder-quobyte-f1185db6-73b2-4f31-9aa0-4a8ff24087c7" released by "delete_snapshot" :: held 2.765s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:18:04 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-5dc1b771-188c-4ceb-8b8c-012bc5f483c0 tempest-VolumesExtendTest-251807362 None] Created reservations ['d95d150b-eb38-44fd-b667-3f299c0270b2', 'd68899ee-4f65-4a57-ad65-21ede51bbfd7', 'ae5cda40-2acd-42d1-851d-25a76da3159a', '9ea2b853-84a9-48f9-a8a4-618af789b74d'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:18:04 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-5dc1b771-188c-4ceb-8b8c-012bc5f483c0 tempest-VolumesExtendTest-251807362 None] Delete snapshot completed successfully. Nov 04 12:18:04 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-5dc1b771-188c-4ceb-8b8c-012bc5f483c0 tempest-VolumesExtendTest-251807362 None] Lock "cinder-722dda03-f29c-4f70-ae9e-400f90f447fb-delete_snapshot" released by "delete_snapshot" :: held 2.990s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:18:05 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ae7d2b5b-164d-4fbd-917d-ad86293fdd6f tempest-VolumesExtendTest-251807362 None] Acquiring lock "cinder-f1185db6-73b2-4f31-9aa0-4a8ff24087c7-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:18:05 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ae7d2b5b-164d-4fbd-917d-ad86293fdd6f tempest-VolumesExtendTest-251807362 None] Lock "cinder-f1185db6-73b2-4f31-9aa0-4a8ff24087c7-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:18:05 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ae7d2b5b-164d-4fbd-917d-ad86293fdd6f tempest-VolumesExtendTest-251807362 None] Acquiring lock "cinder-quobyte-f1185db6-73b2-4f31-9aa0-4a8ff24087c7" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:18:05 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ae7d2b5b-164d-4fbd-917d-ad86293fdd6f tempest-VolumesExtendTest-251807362 None] Lock "cinder-quobyte-f1185db6-73b2-4f31-9aa0-4a8ff24087c7" acquired by "delete_volume" :: waited 0.025s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:18:05 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b44f973-5863-4a84-b147-2381b4f23b63]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:18:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ae7d2b5b-164d-4fbd-917d-ad86293fdd6f tempest-VolumesExtendTest-251807362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f1185db6-73b2-4f31-9aa0-4a8ff24087c7 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:18:05 devstack sudo[96486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f1185db6-73b2-4f31-9aa0-4a8ff24087c7 Nov 04 12:18:05 devstack sudo[96486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:18:05 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-4d433e8b-e22e-4e25-92ac-f4f1afa124fa tempest-VolumesGetTest-543965088 None] Acquiring lock "cinder-0e29e8a2-46cb-4894-a143-df7d314e9811-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:18:05 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-4d433e8b-e22e-4e25-92ac-f4f1afa124fa tempest-VolumesGetTest-543965088 None] Lock "cinder-0e29e8a2-46cb-4894-a143-df7d314e9811-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:18:05 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=125,cinder:UPDATE=152,cinder:INSERT=42,cinder:DELETE=11 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 12:18:05 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:UPDATE=128,cinder:DELETE=14,cinder:SELECT=124,cinder:INSERT=51 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 12:18:05 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-4d433e8b-e22e-4e25-92ac-f4f1afa124fa tempest-VolumesGetTest-543965088 None] Acquiring lock "cinder-quobyte-0e29e8a2-46cb-4894-a143-df7d314e9811" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:18:05 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-4d433e8b-e22e-4e25-92ac-f4f1afa124fa tempest-VolumesGetTest-543965088 None] Lock "cinder-quobyte-0e29e8a2-46cb-4894-a143-df7d314e9811" acquired by "delete_volume" :: waited 0.053s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:18:05 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb19fe8-20d5-4c3e-9d11-ec2e8102b806]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:18:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4d433e8b-e22e-4e25-92ac-f4f1afa124fa tempest-VolumesGetTest-543965088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0e29e8a2-46cb-4894-a143-df7d314e9811 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:18:06 devstack sudo[96488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0e29e8a2-46cb-4894-a143-df7d314e9811 Nov 04 12:18:06 devstack sudo[96488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:18:06 devstack sudo[96486]: pam_unix(sudo:session): session closed for user root Nov 04 12:18:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ae7d2b5b-164d-4fbd-917d-ad86293fdd6f tempest-VolumesExtendTest-251807362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f1185db6-73b2-4f31-9aa0-4a8ff24087c7" returned: 0 in 0.834s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:18:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ae7d2b5b-164d-4fbd-917d-ad86293fdd6f tempest-VolumesExtendTest-251807362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f1185db6-73b2-4f31-9aa0-4a8ff24087c7 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:18:06 devstack sudo[96493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f1185db6-73b2-4f31-9aa0-4a8ff24087c7 Nov 04 12:18:06 devstack sudo[96493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:18:06 devstack sudo[96488]: pam_unix(sudo:session): session closed for user root Nov 04 12:18:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4d433e8b-e22e-4e25-92ac-f4f1afa124fa tempest-VolumesGetTest-543965088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0e29e8a2-46cb-4894-a143-df7d314e9811" returned: 0 in 0.802s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:18:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4d433e8b-e22e-4e25-92ac-f4f1afa124fa tempest-VolumesGetTest-543965088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0e29e8a2-46cb-4894-a143-df7d314e9811 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:18:06 devstack sudo[96498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0e29e8a2-46cb-4894-a143-df7d314e9811 Nov 04 12:18:06 devstack sudo[96498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:18:06 devstack sudo[96493]: pam_unix(sudo:session): session closed for user root Nov 04 12:18:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ae7d2b5b-164d-4fbd-917d-ad86293fdd6f tempest-VolumesExtendTest-251807362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f1185db6-73b2-4f31-9aa0-4a8ff24087c7" returned: 0 in 0.690s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:18:06 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ae7d2b5b-164d-4fbd-917d-ad86293fdd6f tempest-VolumesExtendTest-251807362 None] Lock "cinder-quobyte-f1185db6-73b2-4f31-9aa0-4a8ff24087c7" released by "delete_volume" :: held 1.677s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:18:06 devstack sudo[96498]: pam_unix(sudo:session): session closed for user root Nov 04 12:18:07 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-ae7d2b5b-164d-4fbd-917d-ad86293fdd6f tempest-VolumesExtendTest-251807362 None] Created reservations ['eb5931b8-9c38-4ca0-a4fb-5523516508b3', '7dd8e166-7704-4290-baa7-5e0474f8b923', '11edcac1-6728-45f6-87f1-77f5f0fd6e67', 'f77ac1f1-0b7c-4d44-a232-38878f8a5b29'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:18:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4d433e8b-e22e-4e25-92ac-f4f1afa124fa tempest-VolumesGetTest-543965088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0e29e8a2-46cb-4894-a143-df7d314e9811" returned: 0 in 0.407s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:18:07 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-4d433e8b-e22e-4e25-92ac-f4f1afa124fa tempest-VolumesGetTest-543965088 None] Lock "cinder-quobyte-0e29e8a2-46cb-4894-a143-df7d314e9811" released by "delete_volume" :: held 1.297s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:18:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ae7d2b5b-164d-4fbd-917d-ad86293fdd6f tempest-VolumesExtendTest-251807362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:18:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ae7d2b5b-164d-4fbd-917d-ad86293fdd6f tempest-VolumesExtendTest-251807362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:18:07 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ae7d2b5b-164d-4fbd-917d-ad86293fdd6f tempest-VolumesExtendTest-251807362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:18:07 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ae7d2b5b-164d-4fbd-917d-ad86293fdd6f tempest-VolumesExtendTest-251807362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:18:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ae7d2b5b-164d-4fbd-917d-ad86293fdd6f tempest-VolumesExtendTest-251807362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:18:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ae7d2b5b-164d-4fbd-917d-ad86293fdd6f tempest-VolumesExtendTest-251807362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:18:07 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-4d433e8b-e22e-4e25-92ac-f4f1afa124fa tempest-VolumesGetTest-543965088 None] Created reservations ['bf17b69a-1efc-437e-9965-e870ce2f542f', 'def6e9c9-7695-450d-b79d-f7aa47e5578a', '47788dc5-6950-4eeb-b03b-4925ad806113', 'dc050e40-5274-4a67-8272-07bfcd1b612b'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:18:07 devstack sudo[96502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:18:07 devstack sudo[96502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:18:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4d433e8b-e22e-4e25-92ac-f4f1afa124fa tempest-VolumesGetTest-543965088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:18:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4d433e8b-e22e-4e25-92ac-f4f1afa124fa tempest-VolumesGetTest-543965088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:18:07 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4d433e8b-e22e-4e25-92ac-f4f1afa124fa tempest-VolumesGetTest-543965088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:18:07 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4d433e8b-e22e-4e25-92ac-f4f1afa124fa tempest-VolumesGetTest-543965088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:18:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4d433e8b-e22e-4e25-92ac-f4f1afa124fa tempest-VolumesGetTest-543965088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:18:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4d433e8b-e22e-4e25-92ac-f4f1afa124fa tempest-VolumesGetTest-543965088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:18:07 devstack sudo[96504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:18:07 devstack sudo[96504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:18:07 devstack sudo[96502]: pam_unix(sudo:session): session closed for user root Nov 04 12:18:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ae7d2b5b-164d-4fbd-917d-ad86293fdd6f tempest-VolumesExtendTest-251807362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.565s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:18:07 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-ae7d2b5b-164d-4fbd-917d-ad86293fdd6f tempest-VolumesExtendTest-251807362 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:18:07 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-ae7d2b5b-164d-4fbd-917d-ad86293fdd6f tempest-VolumesExtendTest-251807362 None] Deleted volume successfully. Nov 04 12:18:07 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ae7d2b5b-164d-4fbd-917d-ad86293fdd6f tempest-VolumesExtendTest-251807362 None] Lock "cinder-f1185db6-73b2-4f31-9aa0-4a8ff24087c7-delete_volume" released by "delete_volume" :: held 2.718s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:18:08 devstack sudo[96504]: pam_unix(sudo:session): session closed for user root Nov 04 12:18:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4d433e8b-e22e-4e25-92ac-f4f1afa124fa tempest-VolumesGetTest-543965088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.559s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:18:08 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-4d433e8b-e22e-4e25-92ac-f4f1afa124fa tempest-VolumesGetTest-543965088 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:18:08 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-4d433e8b-e22e-4e25-92ac-f4f1afa124fa tempest-VolumesGetTest-543965088 None] Deleted volume successfully. Nov 04 12:18:08 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-4d433e8b-e22e-4e25-92ac-f4f1afa124fa tempest-VolumesGetTest-543965088 None] Lock "cinder-0e29e8a2-46cb-4894-a143-df7d314e9811-delete_volume" released by "delete_volume" :: held 2.470s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:18:08 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-69e8fa1e-78ef-4638-bdbd-d1cab237ba46 tempest-VolumesGetTest-543965088 None] Acquiring lock "cinder-6c14b290-55cd-4a3f-9751-df213a476767-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:18:08 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-69e8fa1e-78ef-4638-bdbd-d1cab237ba46 tempest-VolumesGetTest-543965088 None] Lock "cinder-6c14b290-55cd-4a3f-9751-df213a476767-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:18:08 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-69e8fa1e-78ef-4638-bdbd-d1cab237ba46 tempest-VolumesGetTest-543965088 None] Acquiring lock "cinder-quobyte-6c14b290-55cd-4a3f-9751-df213a476767" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:18:08 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-69e8fa1e-78ef-4638-bdbd-d1cab237ba46 tempest-VolumesGetTest-543965088 None] Lock "cinder-quobyte-6c14b290-55cd-4a3f-9751-df213a476767" acquired by "delete_volume" :: waited 0.027s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:18:08 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[8603595e-f02a-4a3f-b859-3bd18dc56af8]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:18:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-69e8fa1e-78ef-4638-bdbd-d1cab237ba46 tempest-VolumesGetTest-543965088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6c14b290-55cd-4a3f-9751-df213a476767 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:18:08 devstack sudo[96509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6c14b290-55cd-4a3f-9751-df213a476767 Nov 04 12:18:08 devstack sudo[96509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:18:09 devstack sudo[96509]: pam_unix(sudo:session): session closed for user root Nov 04 12:18:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-69e8fa1e-78ef-4638-bdbd-d1cab237ba46 tempest-VolumesGetTest-543965088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6c14b290-55cd-4a3f-9751-df213a476767" returned: 0 in 0.773s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:18:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-69e8fa1e-78ef-4638-bdbd-d1cab237ba46 tempest-VolumesGetTest-543965088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6c14b290-55cd-4a3f-9751-df213a476767 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:18:09 devstack sudo[96515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6c14b290-55cd-4a3f-9751-df213a476767 Nov 04 12:18:09 devstack sudo[96515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:18:10 devstack sudo[96515]: pam_unix(sudo:session): session closed for user root Nov 04 12:18:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-69e8fa1e-78ef-4638-bdbd-d1cab237ba46 tempest-VolumesGetTest-543965088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6c14b290-55cd-4a3f-9751-df213a476767" returned: 0 in 0.793s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:18:10 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-69e8fa1e-78ef-4638-bdbd-d1cab237ba46 tempest-VolumesGetTest-543965088 None] Lock "cinder-quobyte-6c14b290-55cd-4a3f-9751-df213a476767" released by "delete_volume" :: held 1.671s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:18:10 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-69e8fa1e-78ef-4638-bdbd-d1cab237ba46 tempest-VolumesGetTest-543965088 None] Created reservations ['5f16337e-3580-4a76-ba25-0a906ef00e0d', '91b1f67f-f617-482b-babf-ad9251503b21', '08114b92-9797-4ac5-a1a9-49907b956df8', '8262c156-411c-4ddb-805d-c3b4ac7af00a'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:18:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-69e8fa1e-78ef-4638-bdbd-d1cab237ba46 tempest-VolumesGetTest-543965088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:18:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-69e8fa1e-78ef-4638-bdbd-d1cab237ba46 tempest-VolumesGetTest-543965088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:18:10 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-69e8fa1e-78ef-4638-bdbd-d1cab237ba46 tempest-VolumesGetTest-543965088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:18:10 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-69e8fa1e-78ef-4638-bdbd-d1cab237ba46 tempest-VolumesGetTest-543965088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:18:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-69e8fa1e-78ef-4638-bdbd-d1cab237ba46 tempest-VolumesGetTest-543965088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:18:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-69e8fa1e-78ef-4638-bdbd-d1cab237ba46 tempest-VolumesGetTest-543965088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:18:10 devstack sudo[96518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:18:10 devstack sudo[96518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:18:11 devstack sudo[96518]: pam_unix(sudo:session): session closed for user root Nov 04 12:18:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-69e8fa1e-78ef-4638-bdbd-d1cab237ba46 tempest-VolumesGetTest-543965088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.758s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:18:11 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-69e8fa1e-78ef-4638-bdbd-d1cab237ba46 tempest-VolumesGetTest-543965088 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:18:11 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-69e8fa1e-78ef-4638-bdbd-d1cab237ba46 tempest-VolumesGetTest-543965088 None] Deleted volume successfully. Nov 04 12:18:11 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-69e8fa1e-78ef-4638-bdbd-d1cab237ba46 tempest-VolumesGetTest-543965088 None] Lock "cinder-6c14b290-55cd-4a3f-9751-df213a476767-delete_volume" released by "delete_volume" :: held 2.994s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:18:17 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e0fd5d6-8ddb-4651-8fd8-00437391ac8e tempest-VolumesNegativeTest-291586464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:18:17 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0e0fd5d6-8ddb-4651-8fd8-00437391ac8e tempest-VolumesNegativeTest-291586464 None] Flow 'volume_create_manager' (9351fde1-d4cd-4a68-b30e-089670958dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:18:17 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0e0fd5d6-8ddb-4651-8fd8-00437391ac8e tempest-VolumesNegativeTest-291586464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86fb19ca-dea3-42b8-ba71-9fa462613778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:18:17 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0e0fd5d6-8ddb-4651-8fd8-00437391ac8e tempest-VolumesNegativeTest-291586464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86fb19ca-dea3-42b8-ba71-9fa462613778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:18:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1703750793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53ad204c-490b-4774-a417-f6f6f9271074,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72372b1e3a704d4c88927804b6f82b75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:18:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:18:17Z,use_quota=True,user_id='bbf15ab7993043eeb92f5585cc98f99a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:18:17 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0e0fd5d6-8ddb-4651-8fd8-00437391ac8e tempest-VolumesNegativeTest-291586464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b30dda13-22c1-44ea-a425-df4fe5e7c091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:18:17 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0e0fd5d6-8ddb-4651-8fd8-00437391ac8e tempest-VolumesNegativeTest-291586464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b30dda13-22c1-44ea-a425-df4fe5e7c091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:18:17 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0e0fd5d6-8ddb-4651-8fd8-00437391ac8e tempest-VolumesNegativeTest-291586464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14585a81-df30-400f-b3fd-b52290ea75f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:18:17 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0e0fd5d6-8ddb-4651-8fd8-00437391ac8e tempest-VolumesNegativeTest-291586464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14585a81-df30-400f-b3fd-b52290ea75f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53ad204c-490b-4774-a417-f6f6f9271074', 'volume_name': 'volume-53ad204c-490b-4774-a417-f6f6f9271074', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:18:17 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0e0fd5d6-8ddb-4651-8fd8-00437391ac8e tempest-VolumesNegativeTest-291586464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (268a0f83-c74e-4c0d-9572-340362287177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:18:17 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0e0fd5d6-8ddb-4651-8fd8-00437391ac8e tempest-VolumesNegativeTest-291586464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (268a0f83-c74e-4c0d-9572-340362287177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:18:17 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0e0fd5d6-8ddb-4651-8fd8-00437391ac8e tempest-VolumesNegativeTest-291586464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e15bf36-3c84-4fc3-9725-506c8c6a6d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:18:17 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-0e0fd5d6-8ddb-4651-8fd8-00437391ac8e tempest-VolumesNegativeTest-291586464 None] Volume 53ad204c-490b-4774-a417-f6f6f9271074: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53ad204c-490b-4774-a417-f6f6f9271074', 'volume_size': 1} Nov 04 12:18:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0e0fd5d6-8ddb-4651-8fd8-00437391ac8e tempest-VolumesNegativeTest-291586464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:18:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0e0fd5d6-8ddb-4651-8fd8-00437391ac8e tempest-VolumesNegativeTest-291586464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:18:17 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0e0fd5d6-8ddb-4651-8fd8-00437391ac8e tempest-VolumesNegativeTest-291586464 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:18:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1703750793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53ad204c-490b-4774-a417-f6f6f9271074,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72372b1e3a704d4c88927804b6f82b75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:18:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:18:17Z,use_quota=True,user_id='bbf15ab7993043eeb92f5585cc98f99a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:18:17 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-0e0fd5d6-8ddb-4651-8fd8-00437391ac8e tempest-VolumesNegativeTest-291586464 None] Creating volume 53ad204c-490b-4774-a417-f6f6f9271074 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:18:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0e0fd5d6-8ddb-4651-8fd8-00437391ac8e tempest-VolumesNegativeTest-291586464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:18:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0e0fd5d6-8ddb-4651-8fd8-00437391ac8e tempest-VolumesNegativeTest-291586464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:18:17 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0e0fd5d6-8ddb-4651-8fd8-00437391ac8e tempest-VolumesNegativeTest-291586464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:18:17 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0e0fd5d6-8ddb-4651-8fd8-00437391ac8e tempest-VolumesNegativeTest-291586464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:18:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0e0fd5d6-8ddb-4651-8fd8-00437391ac8e tempest-VolumesNegativeTest-291586464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:18:17 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0e0fd5d6-8ddb-4651-8fd8-00437391ac8e tempest-VolumesNegativeTest-291586464 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:18:17 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-0e0fd5d6-8ddb-4651-8fd8-00437391ac8e tempest-VolumesNegativeTest-291586464 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:18:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0e0fd5d6-8ddb-4651-8fd8-00437391ac8e tempest-VolumesNegativeTest-291586464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-53ad204c-490b-4774-a417-f6f6f9271074 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:18:17 devstack sudo[96559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-53ad204c-490b-4774-a417-f6f6f9271074 1073741824 Nov 04 12:18:17 devstack sudo[96559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:18:17 devstack sudo[96559]: pam_unix(sudo:session): session closed for user root Nov 04 12:18:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0e0fd5d6-8ddb-4651-8fd8-00437391ac8e tempest-VolumesNegativeTest-291586464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-53ad204c-490b-4774-a417-f6f6f9271074 1073741824" returned: 0 in 0.553s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:18:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0e0fd5d6-8ddb-4651-8fd8-00437391ac8e tempest-VolumesNegativeTest-291586464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-53ad204c-490b-4774-a417-f6f6f9271074 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:18:17 devstack sudo[96565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-53ad204c-490b-4774-a417-f6f6f9271074 Nov 04 12:18:17 devstack sudo[96565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:18:18 devstack sudo[96565]: pam_unix(sudo:session): session closed for user root Nov 04 12:18:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0e0fd5d6-8ddb-4651-8fd8-00437391ac8e tempest-VolumesNegativeTest-291586464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-53ad204c-490b-4774-a417-f6f6f9271074" returned: 0 in 0.273s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:18:18 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0e0fd5d6-8ddb-4651-8fd8-00437391ac8e tempest-VolumesNegativeTest-291586464 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:18:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0e0fd5d6-8ddb-4651-8fd8-00437391ac8e tempest-VolumesNegativeTest-291586464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:18:18 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0e0fd5d6-8ddb-4651-8fd8-00437391ac8e tempest-VolumesNegativeTest-291586464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e15bf36-3c84-4fc3-9725-506c8c6a6d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53ad204c-490b-4774-a417-f6f6f9271074', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:18:18 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0e0fd5d6-8ddb-4651-8fd8-00437391ac8e tempest-VolumesNegativeTest-291586464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f711dbcf-c607-489b-9aa4-f9320dee9d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:18:18 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-0e0fd5d6-8ddb-4651-8fd8-00437391ac8e tempest-VolumesNegativeTest-291586464 None] Volume volume-53ad204c-490b-4774-a417-f6f6f9271074 (53ad204c-490b-4774-a417-f6f6f9271074): created successfully Nov 04 12:18:18 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0e0fd5d6-8ddb-4651-8fd8-00437391ac8e tempest-VolumesNegativeTest-291586464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f711dbcf-c607-489b-9aa4-f9320dee9d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:18:18 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0e0fd5d6-8ddb-4651-8fd8-00437391ac8e tempest-VolumesNegativeTest-291586464 None] Flow 'volume_create_manager' (9351fde1-d4cd-4a68-b30e-089670958dbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:18:18 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-0e0fd5d6-8ddb-4651-8fd8-00437391ac8e tempest-VolumesNegativeTest-291586464 None] Created volume successfully. Nov 04 12:18:27 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e670491-bbfe-417d-a3ee-e98d6138703b tempest-VolumesSnapshotTestJSON-1532377660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:18:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3e670491-bbfe-417d-a3ee-e98d6138703b tempest-VolumesSnapshotTestJSON-1532377660 None] Flow 'volume_create_manager' (00f79276-548a-47ff-ad9b-2487160af1b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:18:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3e670491-bbfe-417d-a3ee-e98d6138703b tempest-VolumesSnapshotTestJSON-1532377660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7fb0b50-485a-42da-81a8-9c91ee1d8c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:18:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3e670491-bbfe-417d-a3ee-e98d6138703b tempest-VolumesSnapshotTestJSON-1532377660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7fb0b50-485a-42da-81a8-9c91ee1d8c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:18:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-965545117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6898661-3dfc-4c77-9704-fe90d557c7df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b6ff12f94c64268b23516ceb90beeb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:18:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:18:28Z,use_quota=True,user_id='7c05c9967b4e4c459296b4cf8694208e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:18:28 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3e670491-bbfe-417d-a3ee-e98d6138703b tempest-VolumesSnapshotTestJSON-1532377660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bb1cc98-ad42-49ab-b85e-e28cbb596b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:18:28 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3e670491-bbfe-417d-a3ee-e98d6138703b tempest-VolumesSnapshotTestJSON-1532377660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bb1cc98-ad42-49ab-b85e-e28cbb596b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:18:28 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3e670491-bbfe-417d-a3ee-e98d6138703b tempest-VolumesSnapshotTestJSON-1532377660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c0faed6-8c0d-436d-8c55-1917cbb23939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:18:28 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3e670491-bbfe-417d-a3ee-e98d6138703b tempest-VolumesSnapshotTestJSON-1532377660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c0faed6-8c0d-436d-8c55-1917cbb23939) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6898661-3dfc-4c77-9704-fe90d557c7df', 'volume_name': 'volume-b6898661-3dfc-4c77-9704-fe90d557c7df', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:18:28 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3e670491-bbfe-417d-a3ee-e98d6138703b tempest-VolumesSnapshotTestJSON-1532377660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (332e1420-fe19-4ae9-91d9-5cb93a5687a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:18:28 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3e670491-bbfe-417d-a3ee-e98d6138703b tempest-VolumesSnapshotTestJSON-1532377660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (332e1420-fe19-4ae9-91d9-5cb93a5687a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:18:28 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3e670491-bbfe-417d-a3ee-e98d6138703b tempest-VolumesSnapshotTestJSON-1532377660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9da8024-6b58-497b-a0d1-8ff3b67087a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:18:28 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-3e670491-bbfe-417d-a3ee-e98d6138703b tempest-VolumesSnapshotTestJSON-1532377660 None] Volume b6898661-3dfc-4c77-9704-fe90d557c7df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6898661-3dfc-4c77-9704-fe90d557c7df', 'volume_size': 1} Nov 04 12:18:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3e670491-bbfe-417d-a3ee-e98d6138703b tempest-VolumesSnapshotTestJSON-1532377660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:18:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3e670491-bbfe-417d-a3ee-e98d6138703b tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:18:28 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3e670491-bbfe-417d-a3ee-e98d6138703b tempest-VolumesSnapshotTestJSON-1532377660 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:18:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-965545117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6898661-3dfc-4c77-9704-fe90d557c7df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b6ff12f94c64268b23516ceb90beeb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:18:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:18:28Z,use_quota=True,user_id='7c05c9967b4e4c459296b4cf8694208e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:18:28 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-3e670491-bbfe-417d-a3ee-e98d6138703b tempest-VolumesSnapshotTestJSON-1532377660 None] Creating volume b6898661-3dfc-4c77-9704-fe90d557c7df {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:18:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3e670491-bbfe-417d-a3ee-e98d6138703b tempest-VolumesSnapshotTestJSON-1532377660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:18:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3e670491-bbfe-417d-a3ee-e98d6138703b tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:18:28 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3e670491-bbfe-417d-a3ee-e98d6138703b tempest-VolumesSnapshotTestJSON-1532377660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:18:28 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3e670491-bbfe-417d-a3ee-e98d6138703b tempest-VolumesSnapshotTestJSON-1532377660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:18:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3e670491-bbfe-417d-a3ee-e98d6138703b tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:18:28 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3e670491-bbfe-417d-a3ee-e98d6138703b tempest-VolumesSnapshotTestJSON-1532377660 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:18:28 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-3e670491-bbfe-417d-a3ee-e98d6138703b tempest-VolumesSnapshotTestJSON-1532377660 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:18:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3e670491-bbfe-417d-a3ee-e98d6138703b tempest-VolumesSnapshotTestJSON-1532377660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b6898661-3dfc-4c77-9704-fe90d557c7df 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:18:28 devstack sudo[96709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b6898661-3dfc-4c77-9704-fe90d557c7df 1073741824 Nov 04 12:18:28 devstack sudo[96709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:18:28 devstack sudo[96709]: pam_unix(sudo:session): session closed for user root Nov 04 12:18:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3e670491-bbfe-417d-a3ee-e98d6138703b tempest-VolumesSnapshotTestJSON-1532377660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b6898661-3dfc-4c77-9704-fe90d557c7df 1073741824" returned: 0 in 0.839s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:18:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3e670491-bbfe-417d-a3ee-e98d6138703b tempest-VolumesSnapshotTestJSON-1532377660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b6898661-3dfc-4c77-9704-fe90d557c7df {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:18:29 devstack sudo[96736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b6898661-3dfc-4c77-9704-fe90d557c7df Nov 04 12:18:29 devstack sudo[96736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:18:29 devstack sudo[96736]: pam_unix(sudo:session): session closed for user root Nov 04 12:18:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3e670491-bbfe-417d-a3ee-e98d6138703b tempest-VolumesSnapshotTestJSON-1532377660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b6898661-3dfc-4c77-9704-fe90d557c7df" returned: 0 in 0.373s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:18:29 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3e670491-bbfe-417d-a3ee-e98d6138703b tempest-VolumesSnapshotTestJSON-1532377660 None] <== create_volume: return (1317ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:18:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3e670491-bbfe-417d-a3ee-e98d6138703b tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.326s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:18:29 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3e670491-bbfe-417d-a3ee-e98d6138703b tempest-VolumesSnapshotTestJSON-1532377660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9da8024-6b58-497b-a0d1-8ff3b67087a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6898661-3dfc-4c77-9704-fe90d557c7df', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:18:29 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3e670491-bbfe-417d-a3ee-e98d6138703b tempest-VolumesSnapshotTestJSON-1532377660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (102341f8-f303-4165-9c9f-237c2fb1638b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:18:29 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-3e670491-bbfe-417d-a3ee-e98d6138703b tempest-VolumesSnapshotTestJSON-1532377660 None] Volume volume-b6898661-3dfc-4c77-9704-fe90d557c7df (b6898661-3dfc-4c77-9704-fe90d557c7df): created successfully Nov 04 12:18:29 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3e670491-bbfe-417d-a3ee-e98d6138703b tempest-VolumesSnapshotTestJSON-1532377660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (102341f8-f303-4165-9c9f-237c2fb1638b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:18:29 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3e670491-bbfe-417d-a3ee-e98d6138703b tempest-VolumesSnapshotTestJSON-1532377660 None] Flow 'volume_create_manager' (00f79276-548a-47ff-ad9b-2487160af1b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:18:29 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-3e670491-bbfe-417d-a3ee-e98d6138703b tempest-VolumesSnapshotTestJSON-1532377660 None] Created volume successfully. Nov 04 12:18:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9a2678bf-8193-43c1-b3bf-8e067ebc6409 tempest-VolumesSnapshotTestJSON-1532377660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:18:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9a2678bf-8193-43c1-b3bf-8e067ebc6409 tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:18:30 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-9a2678bf-8193-43c1-b3bf-8e067ebc6409 tempest-VolumesSnapshotTestJSON-1532377660 None] Creating offline snapshot 64d7da85-3865-4f18-93a7-90065c842350 of volume b6898661-3dfc-4c77-9704-fe90d557c7df {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 12:18:30 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf575d4-a11e-49f8-a647-3af007edf0d6]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:18:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9a2678bf-8193-43c1-b3bf-8e067ebc6409 tempest-VolumesSnapshotTestJSON-1532377660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b6898661-3dfc-4c77-9704-fe90d557c7df {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:18:30 devstack sudo[96739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b6898661-3dfc-4c77-9704-fe90d557c7df Nov 04 12:18:30 devstack sudo[96739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:18:30 devstack sudo[96739]: pam_unix(sudo:session): session closed for user root Nov 04 12:18:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9a2678bf-8193-43c1-b3bf-8e067ebc6409 tempest-VolumesSnapshotTestJSON-1532377660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b6898661-3dfc-4c77-9704-fe90d557c7df" returned: 0 in 0.673s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:18:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9a2678bf-8193-43c1-b3bf-8e067ebc6409 tempest-VolumesSnapshotTestJSON-1532377660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b6898661-3dfc-4c77-9704-fe90d557c7df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b6898661-3dfc-4c77-9704-fe90d557c7df.64d7da85-3865-4f18-93a7-90065c842350 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:18:31 devstack sudo[96745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b6898661-3dfc-4c77-9704-fe90d557c7df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b6898661-3dfc-4c77-9704-fe90d557c7df.64d7da85-3865-4f18-93a7-90065c842350 1G Nov 04 12:18:31 devstack sudo[96745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:18:31 devstack sudo[96745]: pam_unix(sudo:session): session closed for user root Nov 04 12:18:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9a2678bf-8193-43c1-b3bf-8e067ebc6409 tempest-VolumesSnapshotTestJSON-1532377660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b6898661-3dfc-4c77-9704-fe90d557c7df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b6898661-3dfc-4c77-9704-fe90d557c7df.64d7da85-3865-4f18-93a7-90065c842350 1G" returned: 0 in 0.667s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:18:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9a2678bf-8193-43c1-b3bf-8e067ebc6409 tempest-VolumesSnapshotTestJSON-1532377660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6898661-3dfc-4c77-9704-fe90d557c7df -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b6898661-3dfc-4c77-9704-fe90d557c7df.64d7da85-3865-4f18-93a7-90065c842350 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:18:31 devstack sudo[96772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6898661-3dfc-4c77-9704-fe90d557c7df -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b6898661-3dfc-4c77-9704-fe90d557c7df.64d7da85-3865-4f18-93a7-90065c842350 Nov 04 12:18:31 devstack sudo[96772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:18:32 devstack sudo[96772]: pam_unix(sudo:session): session closed for user root Nov 04 12:18:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9a2678bf-8193-43c1-b3bf-8e067ebc6409 tempest-VolumesSnapshotTestJSON-1532377660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6898661-3dfc-4c77-9704-fe90d557c7df -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b6898661-3dfc-4c77-9704-fe90d557c7df.64d7da85-3865-4f18-93a7-90065c842350" returned: 0 in 0.371s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:18:32 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-9a2678bf-8193-43c1-b3bf-8e067ebc6409 tempest-VolumesSnapshotTestJSON-1532377660 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b6898661-3dfc-4c77-9704-fe90d557c7df.64d7da85-3865-4f18-93a7-90065c842350 is being set with open permissions: ugo+rw Nov 04 12:18:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9a2678bf-8193-43c1-b3bf-8e067ebc6409 tempest-VolumesSnapshotTestJSON-1532377660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b6898661-3dfc-4c77-9704-fe90d557c7df.64d7da85-3865-4f18-93a7-90065c842350 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:18:32 devstack sudo[96778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b6898661-3dfc-4c77-9704-fe90d557c7df.64d7da85-3865-4f18-93a7-90065c842350 Nov 04 12:18:32 devstack sudo[96778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:18:32 devstack sudo[96778]: pam_unix(sudo:session): session closed for user root Nov 04 12:18:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9a2678bf-8193-43c1-b3bf-8e067ebc6409 tempest-VolumesSnapshotTestJSON-1532377660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b6898661-3dfc-4c77-9704-fe90d557c7df.64d7da85-3865-4f18-93a7-90065c842350" returned: 0 in 0.430s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:18:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9a2678bf-8193-43c1-b3bf-8e067ebc6409 tempest-VolumesSnapshotTestJSON-1532377660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b6898661-3dfc-4c77-9704-fe90d557c7df.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:18:32 devstack sudo[96783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b6898661-3dfc-4c77-9704-fe90d557c7df.info Nov 04 12:18:32 devstack sudo[96783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:18:32 devstack sudo[96783]: pam_unix(sudo:session): session closed for user root Nov 04 12:18:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9a2678bf-8193-43c1-b3bf-8e067ebc6409 tempest-VolumesSnapshotTestJSON-1532377660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b6898661-3dfc-4c77-9704-fe90d557c7df.info" returned: 0 in 0.304s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:18:32 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-9a2678bf-8193-43c1-b3bf-8e067ebc6409 tempest-VolumesSnapshotTestJSON-1532377660 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b6898661-3dfc-4c77-9704-fe90d557c7df.info is being set with open permissions: ugo+rw Nov 04 12:18:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9a2678bf-8193-43c1-b3bf-8e067ebc6409 tempest-VolumesSnapshotTestJSON-1532377660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b6898661-3dfc-4c77-9704-fe90d557c7df.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:18:32 devstack sudo[96787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b6898661-3dfc-4c77-9704-fe90d557c7df.info Nov 04 12:18:32 devstack sudo[96787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:18:33 devstack sudo[96787]: pam_unix(sudo:session): session closed for user root Nov 04 12:18:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9a2678bf-8193-43c1-b3bf-8e067ebc6409 tempest-VolumesSnapshotTestJSON-1532377660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b6898661-3dfc-4c77-9704-fe90d557c7df.info" returned: 0 in 0.268s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:18:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9a2678bf-8193-43c1-b3bf-8e067ebc6409 tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.864s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:18:33 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-9a2678bf-8193-43c1-b3bf-8e067ebc6409 tempest-VolumesSnapshotTestJSON-1532377660 None] Create snapshot completed successfully Nov 04 12:18:33 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-692b557d-0f4c-4792-b35b-f258eb539f5b tempest-VolumesSnapshotTestJSON-1532377660 None] Acquiring lock "cinder-64d7da85-3865-4f18-93a7-90065c842350-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:18:33 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-692b557d-0f4c-4792-b35b-f258eb539f5b tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "cinder-64d7da85-3865-4f18-93a7-90065c842350-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:18:33 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-692b557d-0f4c-4792-b35b-f258eb539f5b tempest-VolumesSnapshotTestJSON-1532377660 None] Acquiring lock "cinder-quobyte-b6898661-3dfc-4c77-9704-fe90d557c7df" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:18:33 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-692b557d-0f4c-4792-b35b-f258eb539f5b tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "cinder-quobyte-b6898661-3dfc-4c77-9704-fe90d557c7df" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:18:33 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-692b557d-0f4c-4792-b35b-f258eb539f5b tempest-VolumesSnapshotTestJSON-1532377660 None] Acquiring lock "cinder-quobyte-64d7da85-3865-4f18-93a7-90065c842350" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:18:33 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-692b557d-0f4c-4792-b35b-f258eb539f5b tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "cinder-quobyte-64d7da85-3865-4f18-93a7-90065c842350" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:18:33 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-692b557d-0f4c-4792-b35b-f258eb539f5b tempest-VolumesSnapshotTestJSON-1532377660 None] Deleting offline snapshot 64d7da85-3865-4f18-93a7-90065c842350 of volume b6898661-3dfc-4c77-9704-fe90d557c7df {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 12:18:33 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-692b557d-0f4c-4792-b35b-f258eb539f5b tempest-VolumesSnapshotTestJSON-1532377660 None] snapshot_file for this snap is: volume-b6898661-3dfc-4c77-9704-fe90d557c7df.64d7da85-3865-4f18-93a7-90065c842350 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 12:18:33 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[937565c5-12b5-4a08-a4c8-392bc1f7d53e]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:18:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-692b557d-0f4c-4792-b35b-f258eb539f5b tempest-VolumesSnapshotTestJSON-1532377660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b6898661-3dfc-4c77-9704-fe90d557c7df.64d7da85-3865-4f18-93a7-90065c842350 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:18:33 devstack sudo[96794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b6898661-3dfc-4c77-9704-fe90d557c7df.64d7da85-3865-4f18-93a7-90065c842350 Nov 04 12:18:33 devstack sudo[96794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:18:34 devstack sudo[96794]: pam_unix(sudo:session): session closed for user root Nov 04 12:18:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-692b557d-0f4c-4792-b35b-f258eb539f5b tempest-VolumesSnapshotTestJSON-1532377660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b6898661-3dfc-4c77-9704-fe90d557c7df.64d7da85-3865-4f18-93a7-90065c842350" returned: 0 in 0.418s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:18:34 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-692b557d-0f4c-4792-b35b-f258eb539f5b tempest-VolumesSnapshotTestJSON-1532377660 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6898661-3dfc-4c77-9704-fe90d557c7df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 12:18:34 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[983c4811-e07e-4cbb-9401-7d368858cec9]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:18:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-692b557d-0f4c-4792-b35b-f258eb539f5b tempest-VolumesSnapshotTestJSON-1532377660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b6898661-3dfc-4c77-9704-fe90d557c7df {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:18:34 devstack sudo[96799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b6898661-3dfc-4c77-9704-fe90d557c7df Nov 04 12:18:34 devstack sudo[96799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:18:34 devstack sudo[96799]: pam_unix(sudo:session): session closed for user root Nov 04 12:18:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-692b557d-0f4c-4792-b35b-f258eb539f5b tempest-VolumesSnapshotTestJSON-1532377660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b6898661-3dfc-4c77-9704-fe90d557c7df" returned: 0 in 0.384s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:18:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-692b557d-0f4c-4792-b35b-f258eb539f5b tempest-VolumesSnapshotTestJSON-1532377660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b6898661-3dfc-4c77-9704-fe90d557c7df.64d7da85-3865-4f18-93a7-90065c842350 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:18:34 devstack sudo[96804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b6898661-3dfc-4c77-9704-fe90d557c7df.64d7da85-3865-4f18-93a7-90065c842350 Nov 04 12:18:34 devstack sudo[96804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:18:34 devstack sudo[96804]: pam_unix(sudo:session): session closed for user root Nov 04 12:18:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-692b557d-0f4c-4792-b35b-f258eb539f5b tempest-VolumesSnapshotTestJSON-1532377660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b6898661-3dfc-4c77-9704-fe90d557c7df.64d7da85-3865-4f18-93a7-90065c842350" returned: 0 in 0.336s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:18:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-692b557d-0f4c-4792-b35b-f258eb539f5b tempest-VolumesSnapshotTestJSON-1532377660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b6898661-3dfc-4c77-9704-fe90d557c7df.64d7da85-3865-4f18-93a7-90065c842350 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:18:35 devstack sudo[96809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b6898661-3dfc-4c77-9704-fe90d557c7df.64d7da85-3865-4f18-93a7-90065c842350 Nov 04 12:18:35 devstack sudo[96809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:18:35 devstack sudo[96809]: pam_unix(sudo:session): session closed for user root Nov 04 12:18:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-692b557d-0f4c-4792-b35b-f258eb539f5b tempest-VolumesSnapshotTestJSON-1532377660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b6898661-3dfc-4c77-9704-fe90d557c7df.64d7da85-3865-4f18-93a7-90065c842350" returned: 0 in 0.258s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:18:35 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-692b557d-0f4c-4792-b35b-f258eb539f5b tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "cinder-quobyte-64d7da85-3865-4f18-93a7-90065c842350" released by "_delete_snapshot" :: held 1.534s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:18:35 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-692b557d-0f4c-4792-b35b-f258eb539f5b tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "cinder-quobyte-b6898661-3dfc-4c77-9704-fe90d557c7df" released by "delete_snapshot" :: held 1.561s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:18:35 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-692b557d-0f4c-4792-b35b-f258eb539f5b tempest-VolumesSnapshotTestJSON-1532377660 None] Created reservations ['8bdf7467-9d4a-49d3-8274-2096ab1cd600', '5131309b-9117-4d89-b2f6-86d587dc3993', '79301500-00ea-4a94-907d-71159025f4a7', '95e079ea-1cba-4cc5-8fa1-fc3408cfcb89'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:18:35 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-692b557d-0f4c-4792-b35b-f258eb539f5b tempest-VolumesSnapshotTestJSON-1532377660 None] Delete snapshot completed successfully. Nov 04 12:18:35 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-692b557d-0f4c-4792-b35b-f258eb539f5b tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "cinder-64d7da85-3865-4f18-93a7-90065c842350-delete_snapshot" released by "delete_snapshot" :: held 1.798s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:18:36 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-5215bfb2-e60f-46c6-9fe6-d726f224a2e3 req-3774b0e7-438c-44c5-a6b6-8731aa19453a tempest-AttachVolumeTestJSON-1999482404 None] Terminate volume connection completed successfully. Nov 04 12:18:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-5215bfb2-e60f-46c6-9fe6-d726f224a2e3 req-3774b0e7-438c-44c5-a6b6-8731aa19453a tempest-AttachVolumeTestJSON-1999482404 None] Deleting attachment 445e14fb-ee75-4364-a7f5-c4154805da06. {{(pid=87095) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 12:18:36 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-a96d949e-2a1c-4ecf-9f5d-67e06bb546a9 tempest-VolumesSnapshotTestJSON-1532377660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:18:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a96d949e-2a1c-4ecf-9f5d-67e06bb546a9 tempest-VolumesSnapshotTestJSON-1532377660 None] Flow 'volume_create_manager' (e134fa65-ecd1-4a79-a71b-4d323809e335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:18:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a96d949e-2a1c-4ecf-9f5d-67e06bb546a9 tempest-VolumesSnapshotTestJSON-1532377660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65cb0a4c-d371-4ac1-8409-967a9576726e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:18:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a96d949e-2a1c-4ecf-9f5d-67e06bb546a9 tempest-VolumesSnapshotTestJSON-1532377660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65cb0a4c-d371-4ac1-8409-967a9576726e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:18:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-914915904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0162a1cb-9e07-46af-b905-2a158321439b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b6ff12f94c64268b23516ceb90beeb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:18:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:18:37Z,use_quota=True,user_id='7c05c9967b4e4c459296b4cf8694208e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:18:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a96d949e-2a1c-4ecf-9f5d-67e06bb546a9 tempest-VolumesSnapshotTestJSON-1532377660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70e3703f-0acf-4aed-9686-d3c61cf9e48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:18:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a96d949e-2a1c-4ecf-9f5d-67e06bb546a9 tempest-VolumesSnapshotTestJSON-1532377660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70e3703f-0acf-4aed-9686-d3c61cf9e48d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:18:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a96d949e-2a1c-4ecf-9f5d-67e06bb546a9 tempest-VolumesSnapshotTestJSON-1532377660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c72a84a-06e8-4f56-9322-18fb6fd6c72e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:18:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a96d949e-2a1c-4ecf-9f5d-67e06bb546a9 tempest-VolumesSnapshotTestJSON-1532377660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c72a84a-06e8-4f56-9322-18fb6fd6c72e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0162a1cb-9e07-46af-b905-2a158321439b', 'volume_name': 'volume-0162a1cb-9e07-46af-b905-2a158321439b', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:18:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a96d949e-2a1c-4ecf-9f5d-67e06bb546a9 tempest-VolumesSnapshotTestJSON-1532377660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e58219e8-4fd5-4f77-bd60-d09b888d7e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:18:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a96d949e-2a1c-4ecf-9f5d-67e06bb546a9 tempest-VolumesSnapshotTestJSON-1532377660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e58219e8-4fd5-4f77-bd60-d09b888d7e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:18:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a96d949e-2a1c-4ecf-9f5d-67e06bb546a9 tempest-VolumesSnapshotTestJSON-1532377660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2248a0fb-bd09-449e-bfa5-2a455844b937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:18:36 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-a96d949e-2a1c-4ecf-9f5d-67e06bb546a9 tempest-VolumesSnapshotTestJSON-1532377660 None] Volume 0162a1cb-9e07-46af-b905-2a158321439b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0162a1cb-9e07-46af-b905-2a158321439b', 'volume_size': 1} Nov 04 12:18:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a96d949e-2a1c-4ecf-9f5d-67e06bb546a9 tempest-VolumesSnapshotTestJSON-1532377660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:18:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a96d949e-2a1c-4ecf-9f5d-67e06bb546a9 tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:18:36 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a96d949e-2a1c-4ecf-9f5d-67e06bb546a9 tempest-VolumesSnapshotTestJSON-1532377660 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:18:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-914915904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0162a1cb-9e07-46af-b905-2a158321439b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b6ff12f94c64268b23516ceb90beeb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:18:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:18:37Z,use_quota=True,user_id='7c05c9967b4e4c459296b4cf8694208e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:18:36 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-a96d949e-2a1c-4ecf-9f5d-67e06bb546a9 tempest-VolumesSnapshotTestJSON-1532377660 None] Creating volume 0162a1cb-9e07-46af-b905-2a158321439b {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:18:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a96d949e-2a1c-4ecf-9f5d-67e06bb546a9 tempest-VolumesSnapshotTestJSON-1532377660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:18:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a96d949e-2a1c-4ecf-9f5d-67e06bb546a9 tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:18:36 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a96d949e-2a1c-4ecf-9f5d-67e06bb546a9 tempest-VolumesSnapshotTestJSON-1532377660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:18:36 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a96d949e-2a1c-4ecf-9f5d-67e06bb546a9 tempest-VolumesSnapshotTestJSON-1532377660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:18:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a96d949e-2a1c-4ecf-9f5d-67e06bb546a9 tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:18:36 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a96d949e-2a1c-4ecf-9f5d-67e06bb546a9 tempest-VolumesSnapshotTestJSON-1532377660 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:18:36 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-a96d949e-2a1c-4ecf-9f5d-67e06bb546a9 tempest-VolumesSnapshotTestJSON-1532377660 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:18:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a96d949e-2a1c-4ecf-9f5d-67e06bb546a9 tempest-VolumesSnapshotTestJSON-1532377660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0162a1cb-9e07-46af-b905-2a158321439b 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:18:36 devstack sudo[96836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0162a1cb-9e07-46af-b905-2a158321439b 1073741824 Nov 04 12:18:36 devstack sudo[96836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:18:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-9a3ade0e-4e49-4c3d-87d5-eec2488d755c req-0a153464-d85a-4667-a0b8-9379d431a7e9 tempest-TestInstancesWithCinderVolumes-2035661098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:18:37 devstack sudo[96836]: pam_unix(sudo:session): session closed for user root Nov 04 12:18:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a96d949e-2a1c-4ecf-9f5d-67e06bb546a9 tempest-VolumesSnapshotTestJSON-1532377660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0162a1cb-9e07-46af-b905-2a158321439b 1073741824" returned: 0 in 0.619s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:18:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a96d949e-2a1c-4ecf-9f5d-67e06bb546a9 tempest-VolumesSnapshotTestJSON-1532377660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0162a1cb-9e07-46af-b905-2a158321439b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:18:37 devstack sudo[96849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0162a1cb-9e07-46af-b905-2a158321439b Nov 04 12:18:37 devstack sudo[96849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:18:37 devstack sudo[96849]: pam_unix(sudo:session): session closed for user root Nov 04 12:18:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a96d949e-2a1c-4ecf-9f5d-67e06bb546a9 tempest-VolumesSnapshotTestJSON-1532377660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0162a1cb-9e07-46af-b905-2a158321439b" returned: 0 in 0.249s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:18:37 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a96d949e-2a1c-4ecf-9f5d-67e06bb546a9 tempest-VolumesSnapshotTestJSON-1532377660 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:18:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a96d949e-2a1c-4ecf-9f5d-67e06bb546a9 tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:18:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-9a3ade0e-4e49-4c3d-87d5-eec2488d755c req-0a153464-d85a-4667-a0b8-9379d431a7e9 tempest-TestInstancesWithCinderVolumes-2035661098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.838s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:18:37 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a96d949e-2a1c-4ecf-9f5d-67e06bb546a9 tempest-VolumesSnapshotTestJSON-1532377660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2248a0fb-bd09-449e-bfa5-2a455844b937) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0162a1cb-9e07-46af-b905-2a158321439b', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:18:37 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a96d949e-2a1c-4ecf-9f5d-67e06bb546a9 tempest-VolumesSnapshotTestJSON-1532377660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e293484-81c2-4a4d-9054-48147106b3d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:18:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-9a3ade0e-4e49-4c3d-87d5-eec2488d755c req-0a153464-d85a-4667-a0b8-9379d431a7e9 tempest-TestInstancesWithCinderVolumes-2035661098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:18:37 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-a96d949e-2a1c-4ecf-9f5d-67e06bb546a9 tempest-VolumesSnapshotTestJSON-1532377660 None] Volume volume-0162a1cb-9e07-46af-b905-2a158321439b (0162a1cb-9e07-46af-b905-2a158321439b): created successfully Nov 04 12:18:37 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a96d949e-2a1c-4ecf-9f5d-67e06bb546a9 tempest-VolumesSnapshotTestJSON-1532377660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e293484-81c2-4a4d-9054-48147106b3d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:18:37 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a96d949e-2a1c-4ecf-9f5d-67e06bb546a9 tempest-VolumesSnapshotTestJSON-1532377660 None] Flow 'volume_create_manager' (e134fa65-ecd1-4a79-a71b-4d323809e335) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:18:37 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-a96d949e-2a1c-4ecf-9f5d-67e06bb546a9 tempest-VolumesSnapshotTestJSON-1532377660 None] Created volume successfully. Nov 04 12:18:37 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-9a3ade0e-4e49-4c3d-87d5-eec2488d755c req-0a153464-d85a-4667-a0b8-9379d431a7e9 tempest-TestInstancesWithCinderVolumes-2035661098 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784', 'name': 'volume-cc9f4232-f950-42f6-aeb4-52431867740c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '03b63bbe-828a-4d32-9ed8-654545fffc8a', 'enforce_multipath': True} {{(pid=87095) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 12:18:37 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-9a3ade0e-4e49-4c3d-87d5-eec2488d755c req-0a153464-d85a-4667-a0b8-9379d431a7e9 tempest-TestInstancesWithCinderVolumes-2035661098 None] attachment_update completed successfully. Nov 04 12:18:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ee1b126d-8251-4c8c-b445-5388f7f2a677 tempest-VolumesSnapshotTestJSON-1532377660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:18:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ee1b126d-8251-4c8c-b445-5388f7f2a677 tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:18:39 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-ee1b126d-8251-4c8c-b445-5388f7f2a677 tempest-VolumesSnapshotTestJSON-1532377660 None] Creating offline snapshot 72afd6a7-f3fd-45df-a334-b88a8fd288d5 of volume 0162a1cb-9e07-46af-b905-2a158321439b {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 12:18:39 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[efff18ac-10b9-475d-a4ee-450e72bb403c]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:18:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ee1b126d-8251-4c8c-b445-5388f7f2a677 tempest-VolumesSnapshotTestJSON-1532377660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0162a1cb-9e07-46af-b905-2a158321439b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:18:39 devstack sudo[96859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0162a1cb-9e07-46af-b905-2a158321439b Nov 04 12:18:39 devstack sudo[96859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:18:39 devstack sudo[96859]: pam_unix(sudo:session): session closed for user root Nov 04 12:18:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ee1b126d-8251-4c8c-b445-5388f7f2a677 tempest-VolumesSnapshotTestJSON-1532377660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0162a1cb-9e07-46af-b905-2a158321439b" returned: 0 in 0.534s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:18:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ee1b126d-8251-4c8c-b445-5388f7f2a677 tempest-VolumesSnapshotTestJSON-1532377660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0162a1cb-9e07-46af-b905-2a158321439b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0162a1cb-9e07-46af-b905-2a158321439b.72afd6a7-f3fd-45df-a334-b88a8fd288d5 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:18:39 devstack sudo[96870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0162a1cb-9e07-46af-b905-2a158321439b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0162a1cb-9e07-46af-b905-2a158321439b.72afd6a7-f3fd-45df-a334-b88a8fd288d5 1G Nov 04 12:18:39 devstack sudo[96870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:18:40 devstack sudo[96870]: pam_unix(sudo:session): session closed for user root Nov 04 12:18:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ee1b126d-8251-4c8c-b445-5388f7f2a677 tempest-VolumesSnapshotTestJSON-1532377660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0162a1cb-9e07-46af-b905-2a158321439b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0162a1cb-9e07-46af-b905-2a158321439b.72afd6a7-f3fd-45df-a334-b88a8fd288d5 1G" returned: 0 in 0.849s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:18:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ee1b126d-8251-4c8c-b445-5388f7f2a677 tempest-VolumesSnapshotTestJSON-1532377660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0162a1cb-9e07-46af-b905-2a158321439b -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0162a1cb-9e07-46af-b905-2a158321439b.72afd6a7-f3fd-45df-a334-b88a8fd288d5 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:18:40 devstack sudo[96902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0162a1cb-9e07-46af-b905-2a158321439b -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0162a1cb-9e07-46af-b905-2a158321439b.72afd6a7-f3fd-45df-a334-b88a8fd288d5 Nov 04 12:18:40 devstack sudo[96902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:18:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-f614353e-cda7-405b-b4d8-d8623ae379f2 req-49159321-4ead-4438-8003-31f8c6fce328 tempest-TestInstancesWithCinderVolumes-2035661098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:18:40 devstack sudo[96902]: pam_unix(sudo:session): session closed for user root Nov 04 12:18:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ee1b126d-8251-4c8c-b445-5388f7f2a677 tempest-VolumesSnapshotTestJSON-1532377660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0162a1cb-9e07-46af-b905-2a158321439b -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0162a1cb-9e07-46af-b905-2a158321439b.72afd6a7-f3fd-45df-a334-b88a8fd288d5" returned: 0 in 0.512s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:18:40 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-ee1b126d-8251-4c8c-b445-5388f7f2a677 tempest-VolumesSnapshotTestJSON-1532377660 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0162a1cb-9e07-46af-b905-2a158321439b.72afd6a7-f3fd-45df-a334-b88a8fd288d5 is being set with open permissions: ugo+rw Nov 04 12:18:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ee1b126d-8251-4c8c-b445-5388f7f2a677 tempest-VolumesSnapshotTestJSON-1532377660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0162a1cb-9e07-46af-b905-2a158321439b.72afd6a7-f3fd-45df-a334-b88a8fd288d5 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:18:41 devstack sudo[96923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0162a1cb-9e07-46af-b905-2a158321439b.72afd6a7-f3fd-45df-a334-b88a8fd288d5 Nov 04 12:18:41 devstack sudo[96923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:18:41 devstack sudo[96923]: pam_unix(sudo:session): session closed for user root Nov 04 12:18:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ee1b126d-8251-4c8c-b445-5388f7f2a677 tempest-VolumesSnapshotTestJSON-1532377660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0162a1cb-9e07-46af-b905-2a158321439b.72afd6a7-f3fd-45df-a334-b88a8fd288d5" returned: 0 in 0.460s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:18:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ee1b126d-8251-4c8c-b445-5388f7f2a677 tempest-VolumesSnapshotTestJSON-1532377660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0162a1cb-9e07-46af-b905-2a158321439b.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:18:41 devstack sudo[96965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0162a1cb-9e07-46af-b905-2a158321439b.info Nov 04 12:18:41 devstack sudo[96965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:18:41 devstack sudo[96965]: pam_unix(sudo:session): session closed for user root Nov 04 12:18:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ee1b126d-8251-4c8c-b445-5388f7f2a677 tempest-VolumesSnapshotTestJSON-1532377660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0162a1cb-9e07-46af-b905-2a158321439b.info" returned: 0 in 0.468s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:18:41 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-ee1b126d-8251-4c8c-b445-5388f7f2a677 tempest-VolumesSnapshotTestJSON-1532377660 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0162a1cb-9e07-46af-b905-2a158321439b.info is being set with open permissions: ugo+rw Nov 04 12:18:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ee1b126d-8251-4c8c-b445-5388f7f2a677 tempest-VolumesSnapshotTestJSON-1532377660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0162a1cb-9e07-46af-b905-2a158321439b.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:18:42 devstack sudo[96992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0162a1cb-9e07-46af-b905-2a158321439b.info Nov 04 12:18:42 devstack sudo[96992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:18:42 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b776f89a-0241-4ed0-9c41-4fdbaceedec2 tempest-VolumesNegativeTest-291586464 None] Acquiring lock "cinder-53ad204c-490b-4774-a417-f6f6f9271074-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:18:42 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b776f89a-0241-4ed0-9c41-4fdbaceedec2 tempest-VolumesNegativeTest-291586464 None] Lock "cinder-53ad204c-490b-4774-a417-f6f6f9271074-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:18:42 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b776f89a-0241-4ed0-9c41-4fdbaceedec2 tempest-VolumesNegativeTest-291586464 None] Acquiring lock "cinder-quobyte-53ad204c-490b-4774-a417-f6f6f9271074" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:18:42 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b776f89a-0241-4ed0-9c41-4fdbaceedec2 tempest-VolumesNegativeTest-291586464 None] Lock "cinder-quobyte-53ad204c-490b-4774-a417-f6f6f9271074" acquired by "delete_volume" :: waited 0.023s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:18:42 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f2f63f8-0251-43ba-a4a8-afc20311662b]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:18:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b776f89a-0241-4ed0-9c41-4fdbaceedec2 tempest-VolumesNegativeTest-291586464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-53ad204c-490b-4774-a417-f6f6f9271074 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:18:42 devstack sudo[96992]: pam_unix(sudo:session): session closed for user root Nov 04 12:18:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ee1b126d-8251-4c8c-b445-5388f7f2a677 tempest-VolumesSnapshotTestJSON-1532377660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0162a1cb-9e07-46af-b905-2a158321439b.info" returned: 0 in 0.525s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:18:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ee1b126d-8251-4c8c-b445-5388f7f2a677 tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.533s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:18:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-f614353e-cda7-405b-b4d8-d8623ae379f2 req-49159321-4ead-4438-8003-31f8c6fce328 tempest-TestInstancesWithCinderVolumes-2035661098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.905s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:18:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-f614353e-cda7-405b-b4d8-d8623ae379f2 req-49159321-4ead-4438-8003-31f8c6fce328 tempest-TestInstancesWithCinderVolumes-2035661098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.050s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:18:42 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-ee1b126d-8251-4c8c-b445-5388f7f2a677 tempest-VolumesSnapshotTestJSON-1532377660 None] Create snapshot completed successfully Nov 04 12:18:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-f614353e-cda7-405b-b4d8-d8623ae379f2 req-49159321-4ead-4438-8003-31f8c6fce328 tempest-TestInstancesWithCinderVolumes-2035661098 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784', 'name': 'volume-1af736e2-760b-435a-94d5-cc7f61f23fe4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1adc2ba0-c0e5-429c-bf4d-da25f73d71f0', 'enforce_multipath': True} {{(pid=87095) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 12:18:42 devstack sudo[97000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-53ad204c-490b-4774-a417-f6f6f9271074 Nov 04 12:18:42 devstack sudo[97000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:18:42 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-f614353e-cda7-405b-b4d8-d8623ae379f2 req-49159321-4ead-4438-8003-31f8c6fce328 tempest-TestInstancesWithCinderVolumes-2035661098 None] attachment_update completed successfully. Nov 04 12:18:43 devstack sudo[97000]: pam_unix(sudo:session): session closed for user root Nov 04 12:18:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b776f89a-0241-4ed0-9c41-4fdbaceedec2 tempest-VolumesNegativeTest-291586464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-53ad204c-490b-4774-a417-f6f6f9271074" returned: 0 in 0.560s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:18:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b776f89a-0241-4ed0-9c41-4fdbaceedec2 tempest-VolumesNegativeTest-291586464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-53ad204c-490b-4774-a417-f6f6f9271074 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:18:43 devstack sudo[97011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-53ad204c-490b-4774-a417-f6f6f9271074 Nov 04 12:18:43 devstack sudo[97011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:18:43 devstack sudo[97011]: pam_unix(sudo:session): session closed for user root Nov 04 12:18:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b776f89a-0241-4ed0-9c41-4fdbaceedec2 tempest-VolumesNegativeTest-291586464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-53ad204c-490b-4774-a417-f6f6f9271074" returned: 0 in 0.355s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:18:43 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b776f89a-0241-4ed0-9c41-4fdbaceedec2 tempest-VolumesNegativeTest-291586464 None] Lock "cinder-quobyte-53ad204c-490b-4774-a417-f6f6f9271074" released by "delete_volume" :: held 0.998s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:18:43 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-b776f89a-0241-4ed0-9c41-4fdbaceedec2 tempest-VolumesNegativeTest-291586464 None] Created reservations ['44933e44-a2ca-414f-bb33-e216e76f4b50', 'a59fee4e-8a1e-44ef-930f-6b83702bef87', '9266d14a-2858-484e-a654-542038a9fb31', 'e34142e9-afe2-4492-8a60-1f7c4db71917'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:18:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b776f89a-0241-4ed0-9c41-4fdbaceedec2 tempest-VolumesNegativeTest-291586464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:18:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b776f89a-0241-4ed0-9c41-4fdbaceedec2 tempest-VolumesNegativeTest-291586464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:18:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b776f89a-0241-4ed0-9c41-4fdbaceedec2 tempest-VolumesNegativeTest-291586464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:18:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b776f89a-0241-4ed0-9c41-4fdbaceedec2 tempest-VolumesNegativeTest-291586464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:18:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b776f89a-0241-4ed0-9c41-4fdbaceedec2 tempest-VolumesNegativeTest-291586464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:18:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b776f89a-0241-4ed0-9c41-4fdbaceedec2 tempest-VolumesNegativeTest-291586464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:18:43 devstack sudo[97018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:18:43 devstack sudo[97018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:18:44 devstack sudo[97018]: pam_unix(sudo:session): session closed for user root Nov 04 12:18:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b776f89a-0241-4ed0-9c41-4fdbaceedec2 tempest-VolumesNegativeTest-291586464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.481s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:18:44 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-b776f89a-0241-4ed0-9c41-4fdbaceedec2 tempest-VolumesNegativeTest-291586464 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:18:44 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-b776f89a-0241-4ed0-9c41-4fdbaceedec2 tempest-VolumesNegativeTest-291586464 None] Deleted volume successfully. Nov 04 12:18:44 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b776f89a-0241-4ed0-9c41-4fdbaceedec2 tempest-VolumesNegativeTest-291586464 None] Lock "cinder-53ad204c-490b-4774-a417-f6f6f9271074-delete_volume" released by "delete_volume" :: held 1.968s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:18:44 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-204fbb63-cc48-415f-be2f-07d17c36cb94 tempest-VolumesSnapshotTestJSON-1532377660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:18:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-204fbb63-cc48-415f-be2f-07d17c36cb94 tempest-VolumesSnapshotTestJSON-1532377660 None] Flow 'volume_create_manager' (eb522b1a-7365-4cc8-b19a-32f76feb293f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:18:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-204fbb63-cc48-415f-be2f-07d17c36cb94 tempest-VolumesSnapshotTestJSON-1532377660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fae6fa02-18fe-45c7-bca6-53caaec88c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:18:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-204fbb63-cc48-415f-be2f-07d17c36cb94 tempest-VolumesSnapshotTestJSON-1532377660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fae6fa02-18fe-45c7-bca6-53caaec88c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:18:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1300533701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32d0390f-ddfc-4635-b137-d6c58ce27423,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b6ff12f94c64268b23516ceb90beeb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:18:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=72afd6a7-f3fd-45df-a334-b88a8fd288d5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:18:45Z,use_quota=True,user_id='7c05c9967b4e4c459296b4cf8694208e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:18:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-204fbb63-cc48-415f-be2f-07d17c36cb94 tempest-VolumesSnapshotTestJSON-1532377660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c348a7be-c201-470e-9a68-a85224c15948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:18:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-204fbb63-cc48-415f-be2f-07d17c36cb94 tempest-VolumesSnapshotTestJSON-1532377660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c348a7be-c201-470e-9a68-a85224c15948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:18:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-204fbb63-cc48-415f-be2f-07d17c36cb94 tempest-VolumesSnapshotTestJSON-1532377660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8275d02d-2299-4aad-9555-ede6bf1f70ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:18:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-204fbb63-cc48-415f-be2f-07d17c36cb94 tempest-VolumesSnapshotTestJSON-1532377660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8275d02d-2299-4aad-9555-ede6bf1f70ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '32d0390f-ddfc-4635-b137-d6c58ce27423', 'volume_name': 'volume-32d0390f-ddfc-4635-b137-d6c58ce27423', 'volume_size': 2, 'snapshot_id': '72afd6a7-f3fd-45df-a334-b88a8fd288d5'}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:18:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-204fbb63-cc48-415f-be2f-07d17c36cb94 tempest-VolumesSnapshotTestJSON-1532377660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e078a61-727a-44f4-b137-b487818bd45f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:18:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-204fbb63-cc48-415f-be2f-07d17c36cb94 tempest-VolumesSnapshotTestJSON-1532377660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e078a61-727a-44f4-b137-b487818bd45f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:18:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-204fbb63-cc48-415f-be2f-07d17c36cb94 tempest-VolumesSnapshotTestJSON-1532377660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49633106-64c0-4c83-b209-5ffacbec1a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:18:44 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-204fbb63-cc48-415f-be2f-07d17c36cb94 tempest-VolumesSnapshotTestJSON-1532377660 None] Volume 32d0390f-ddfc-4635-b137-d6c58ce27423: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-32d0390f-ddfc-4635-b137-d6c58ce27423', 'volume_size': 2, 'snapshot_id': '72afd6a7-f3fd-45df-a334-b88a8fd288d5'} Nov 04 12:18:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-204fbb63-cc48-415f-be2f-07d17c36cb94 tempest-VolumesSnapshotTestJSON-1532377660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:18:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-204fbb63-cc48-415f-be2f-07d17c36cb94 tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:18:44 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-204fbb63-cc48-415f-be2f-07d17c36cb94 tempest-VolumesSnapshotTestJSON-1532377660 None] Acquiring lock "cinder-quobyte-72afd6a7-f3fd-45df-a334-b88a8fd288d5-32d0390f-ddfc-4635-b137-d6c58ce27423" by "_create_volume_from_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:18:44 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-204fbb63-cc48-415f-be2f-07d17c36cb94 tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "cinder-quobyte-72afd6a7-f3fd-45df-a334-b88a8fd288d5-32d0390f-ddfc-4635-b137-d6c58ce27423" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:18:44 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-204fbb63-cc48-415f-be2f-07d17c36cb94 tempest-VolumesSnapshotTestJSON-1532377660 None] Creating volume 32d0390f-ddfc-4635-b137-d6c58ce27423 from snapshot 72afd6a7-f3fd-45df-a334-b88a8fd288d5 {{(pid=87095) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 04 12:18:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-204fbb63-cc48-415f-be2f-07d17c36cb94 tempest-VolumesSnapshotTestJSON-1532377660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:18:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-204fbb63-cc48-415f-be2f-07d17c36cb94 tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:18:44 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-204fbb63-cc48-415f-be2f-07d17c36cb94 tempest-VolumesSnapshotTestJSON-1532377660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:18:44 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-204fbb63-cc48-415f-be2f-07d17c36cb94 tempest-VolumesSnapshotTestJSON-1532377660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:18:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-204fbb63-cc48-415f-be2f-07d17c36cb94 tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:18:44 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-204fbb63-cc48-415f-be2f-07d17c36cb94 tempest-VolumesSnapshotTestJSON-1532377660 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:18:44 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-204fbb63-cc48-415f-be2f-07d17c36cb94 tempest-VolumesSnapshotTestJSON-1532377660 None] Acquiring lock "cinder-quobyte-32d0390f-ddfc-4635-b137-d6c58ce27423" by "_copy_volume_from_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:18:44 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-204fbb63-cc48-415f-be2f-07d17c36cb94 tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "cinder-quobyte-32d0390f-ddfc-4635-b137-d6c58ce27423" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:18:44 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-204fbb63-cc48-415f-be2f-07d17c36cb94 tempest-VolumesSnapshotTestJSON-1532377660 None] snapshot: 72afd6a7-f3fd-45df-a334-b88a8fd288d5, volume: 32d0390f-ddfc-4635-b137-d6c58ce27423, {{(pid=87095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 12:18:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-204fbb63-cc48-415f-be2f-07d17c36cb94 tempest-VolumesSnapshotTestJSON-1532377660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:18:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-204fbb63-cc48-415f-be2f-07d17c36cb94 tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:18:44 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-204fbb63-cc48-415f-be2f-07d17c36cb94 tempest-VolumesSnapshotTestJSON-1532377660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:18:44 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-204fbb63-cc48-415f-be2f-07d17c36cb94 tempest-VolumesSnapshotTestJSON-1532377660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:18:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-204fbb63-cc48-415f-be2f-07d17c36cb94 tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:18:44 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e634bbc-185d-435d-bfc3-479f75446ac6]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:18:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-204fbb63-cc48-415f-be2f-07d17c36cb94 tempest-VolumesSnapshotTestJSON-1532377660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0162a1cb-9e07-46af-b905-2a158321439b.72afd6a7-f3fd-45df-a334-b88a8fd288d5 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:18:45 devstack sudo[97025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0162a1cb-9e07-46af-b905-2a158321439b.72afd6a7-f3fd-45df-a334-b88a8fd288d5 Nov 04 12:18:45 devstack sudo[97025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:18:45 devstack sudo[97025]: pam_unix(sudo:session): session closed for user root Nov 04 12:18:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-204fbb63-cc48-415f-be2f-07d17c36cb94 tempest-VolumesSnapshotTestJSON-1532377660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0162a1cb-9e07-46af-b905-2a158321439b.72afd6a7-f3fd-45df-a334-b88a8fd288d5" returned: 0 in 0.439s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:18:45 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-204fbb63-cc48-415f-be2f-07d17c36cb94 tempest-VolumesSnapshotTestJSON-1532377660 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0162a1cb-9e07-46af-b905-2a158321439b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 12:18:45 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed95aaf5-7d32-4a97-9356-49ecc75569e6]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:18:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-204fbb63-cc48-415f-be2f-07d17c36cb94 tempest-VolumesSnapshotTestJSON-1532377660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0162a1cb-9e07-46af-b905-2a158321439b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:18:45 devstack sudo[97030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0162a1cb-9e07-46af-b905-2a158321439b Nov 04 12:18:45 devstack sudo[97030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:18:45 devstack sudo[97030]: pam_unix(sudo:session): session closed for user root Nov 04 12:18:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-204fbb63-cc48-415f-be2f-07d17c36cb94 tempest-VolumesSnapshotTestJSON-1532377660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0162a1cb-9e07-46af-b905-2a158321439b" returned: 0 in 0.458s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:18:45 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-204fbb63-cc48-415f-be2f-07d17c36cb94 tempest-VolumesSnapshotTestJSON-1532377660 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0162a1cb-9e07-46af-b905-2a158321439b {{(pid=87095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 12:18:45 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-204fbb63-cc48-415f-be2f-07d17c36cb94 tempest-VolumesSnapshotTestJSON-1532377660 None] Creating direct copy from snapshot {{(pid=87095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 12:18:45 devstack cinder-volume[87095]: DEBUG cinder.utils [None req-204fbb63-cc48-415f-be2f-07d17c36cb94 tempest-VolumesSnapshotTestJSON-1532377660 None] Path /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-32d0390f-ddfc-4635-b137-d6c58ce27423 not found in is_blk_device check {{(pid=87095) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 04 12:18:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-204fbb63-cc48-415f-be2f-07d17c36cb94 tempest-VolumesSnapshotTestJSON-1532377660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0162a1cb-9e07-46af-b905-2a158321439b /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-32d0390f-ddfc-4635-b137-d6c58ce27423 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:18:45 devstack sudo[97036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0162a1cb-9e07-46af-b905-2a158321439b /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-32d0390f-ddfc-4635-b137-d6c58ce27423 Nov 04 12:18:45 devstack sudo[97036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:18:49 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-945d6b54-0d82-4a0d-b6eb-fee433af53cf req-0b64e786-8bb0-4972-8f9a-af47c391a65c tempest-TestInstancesWithCinderVolumes-2035661098 None] Terminate volume connection completed successfully. Nov 04 12:18:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-945d6b54-0d82-4a0d-b6eb-fee433af53cf req-0b64e786-8bb0-4972-8f9a-af47c391a65c tempest-TestInstancesWithCinderVolumes-2035661098 None] Deleting attachment 03b63bbe-828a-4d32-9ed8-654545fffc8a. {{(pid=87095) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 12:18:50 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-15213ec1-216f-4485-96a7-37cb79c5e3ad tempest-VolumesSnapshotListTestJSON-229292204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:18:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-15213ec1-216f-4485-96a7-37cb79c5e3ad tempest-VolumesSnapshotListTestJSON-229292204 None] Flow 'volume_create_manager' (fe147aa4-3a97-4e52-9c95-6966366030d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:18:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-15213ec1-216f-4485-96a7-37cb79c5e3ad tempest-VolumesSnapshotListTestJSON-229292204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93fe424c-a864-4f60-9742-1a6552bb5937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:18:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-15213ec1-216f-4485-96a7-37cb79c5e3ad tempest-VolumesSnapshotListTestJSON-229292204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93fe424c-a864-4f60-9742-1a6552bb5937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:18:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-917598421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d78e7673-199d-4f89-b206-71c5249ddf37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80f8c2ec14ca42b1b45304243867b7a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:18:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:18:50Z,use_quota=True,user_id='dd2d9db213d046b0b03ab19bdda7b5f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:18:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-15213ec1-216f-4485-96a7-37cb79c5e3ad tempest-VolumesSnapshotListTestJSON-229292204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e635766-d17c-44a3-a3c7-bd6e7c09b950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:18:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-15213ec1-216f-4485-96a7-37cb79c5e3ad tempest-VolumesSnapshotListTestJSON-229292204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e635766-d17c-44a3-a3c7-bd6e7c09b950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:18:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-15213ec1-216f-4485-96a7-37cb79c5e3ad tempest-VolumesSnapshotListTestJSON-229292204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a22129a-a9c1-4e68-bc4e-46b7b0990061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:18:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-15213ec1-216f-4485-96a7-37cb79c5e3ad tempest-VolumesSnapshotListTestJSON-229292204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a22129a-a9c1-4e68-bc4e-46b7b0990061) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd78e7673-199d-4f89-b206-71c5249ddf37', 'volume_name': 'volume-d78e7673-199d-4f89-b206-71c5249ddf37', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:18:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-15213ec1-216f-4485-96a7-37cb79c5e3ad tempest-VolumesSnapshotListTestJSON-229292204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7b44519-431e-4438-8a57-4f6a4932e9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:18:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-15213ec1-216f-4485-96a7-37cb79c5e3ad tempest-VolumesSnapshotListTestJSON-229292204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7b44519-431e-4438-8a57-4f6a4932e9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:18:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-15213ec1-216f-4485-96a7-37cb79c5e3ad tempest-VolumesSnapshotListTestJSON-229292204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4b065b7-7d98-4d3f-bc61-d4b3c42ad9e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:18:50 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-15213ec1-216f-4485-96a7-37cb79c5e3ad tempest-VolumesSnapshotListTestJSON-229292204 None] Volume d78e7673-199d-4f89-b206-71c5249ddf37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d78e7673-199d-4f89-b206-71c5249ddf37', 'volume_size': 1} Nov 04 12:18:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-15213ec1-216f-4485-96a7-37cb79c5e3ad tempest-VolumesSnapshotListTestJSON-229292204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:18:51 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9724f2d8-df53-421c-8400-4870a73ef8e4 tempest-TestInstancesWithCinderVolumes-2035661098 None] Acquiring lock "cinder-cc9f4232-f950-42f6-aeb4-52431867740c-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:18:51 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9724f2d8-df53-421c-8400-4870a73ef8e4 tempest-TestInstancesWithCinderVolumes-2035661098 None] Lock "cinder-cc9f4232-f950-42f6-aeb4-52431867740c-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:18:51 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9724f2d8-df53-421c-8400-4870a73ef8e4 tempest-TestInstancesWithCinderVolumes-2035661098 None] Acquiring lock "cinder-quobyte-cc9f4232-f950-42f6-aeb4-52431867740c" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:18:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9724f2d8-df53-421c-8400-4870a73ef8e4 tempest-TestInstancesWithCinderVolumes-2035661098 None] Lock "cinder-quobyte-cc9f4232-f950-42f6-aeb4-52431867740c" acquired by "delete_volume" :: waited 0.039s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:18:52 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c96fbc-7b9c-4c75-be2f-1619cd013b0a]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:18:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9724f2d8-df53-421c-8400-4870a73ef8e4 tempest-TestInstancesWithCinderVolumes-2035661098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cc9f4232-f950-42f6-aeb4-52431867740c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:18:52 devstack sudo[97079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cc9f4232-f950-42f6-aeb4-52431867740c Nov 04 12:18:52 devstack sudo[97079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:18:53 devstack sudo[97079]: pam_unix(sudo:session): session closed for user root Nov 04 12:18:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9724f2d8-df53-421c-8400-4870a73ef8e4 tempest-TestInstancesWithCinderVolumes-2035661098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cc9f4232-f950-42f6-aeb4-52431867740c" returned: 0 in 1.059s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:18:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9724f2d8-df53-421c-8400-4870a73ef8e4 tempest-TestInstancesWithCinderVolumes-2035661098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cc9f4232-f950-42f6-aeb4-52431867740c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:18:53 devstack sudo[97087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cc9f4232-f950-42f6-aeb4-52431867740c Nov 04 12:18:53 devstack sudo[97087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:18:53 devstack sudo[97087]: pam_unix(sudo:session): session closed for user root Nov 04 12:18:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9724f2d8-df53-421c-8400-4870a73ef8e4 tempest-TestInstancesWithCinderVolumes-2035661098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cc9f4232-f950-42f6-aeb4-52431867740c" returned: 0 in 0.538s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:18:53 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9724f2d8-df53-421c-8400-4870a73ef8e4 tempest-TestInstancesWithCinderVolumes-2035661098 None] Lock "cinder-quobyte-cc9f4232-f950-42f6-aeb4-52431867740c" released by "delete_volume" :: held 1.701s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:18:53 devstack cinder-volume[87095]: WARNING cinder.quota [None req-9724f2d8-df53-421c-8400-4870a73ef8e4 tempest-TestInstancesWithCinderVolumes-2035661098 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-545516480-2073292848 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-545516480-2073292848, it is now deprecated. Please use the default quota class for default quota. Nov 04 12:18:53 devstack cinder-volume[87095]: WARNING cinder.quota [None req-9724f2d8-df53-421c-8400-4870a73ef8e4 tempest-TestInstancesWithCinderVolumes-2035661098 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-545516480-2073292848 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-545516480-2073292848, it is now deprecated. Please use the default quota class for default quota. Nov 04 12:18:53 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-9724f2d8-df53-421c-8400-4870a73ef8e4 tempest-TestInstancesWithCinderVolumes-2035661098 None] Created reservations ['95213a9b-a727-4bc3-a168-434b9aa3cc75', '89293e01-6cbd-40e5-a4ed-0d7a22ed9924', 'ae6471f4-71b0-4659-8322-669fbae69b01', '127a4d3b-ad5d-405c-adbf-aeb4eef2bbd0'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:18:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9724f2d8-df53-421c-8400-4870a73ef8e4 tempest-TestInstancesWithCinderVolumes-2035661098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:18:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9724f2d8-df53-421c-8400-4870a73ef8e4 tempest-TestInstancesWithCinderVolumes-2035661098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:18:54 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9724f2d8-df53-421c-8400-4870a73ef8e4 tempest-TestInstancesWithCinderVolumes-2035661098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:18:54 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9724f2d8-df53-421c-8400-4870a73ef8e4 tempest-TestInstancesWithCinderVolumes-2035661098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:18:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9724f2d8-df53-421c-8400-4870a73ef8e4 tempest-TestInstancesWithCinderVolumes-2035661098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:18:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9724f2d8-df53-421c-8400-4870a73ef8e4 tempest-TestInstancesWithCinderVolumes-2035661098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:18:54 devstack sudo[97090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:18:54 devstack sudo[97090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:18:54 devstack sudo[97090]: pam_unix(sudo:session): session closed for user root Nov 04 12:18:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9724f2d8-df53-421c-8400-4870a73ef8e4 tempest-TestInstancesWithCinderVolumes-2035661098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.499s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:18:54 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-9724f2d8-df53-421c-8400-4870a73ef8e4 tempest-TestInstancesWithCinderVolumes-2035661098 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:18:54 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-9724f2d8-df53-421c-8400-4870a73ef8e4 tempest-TestInstancesWithCinderVolumes-2035661098 None] Deleted volume successfully. Nov 04 12:18:54 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9724f2d8-df53-421c-8400-4870a73ef8e4 tempest-TestInstancesWithCinderVolumes-2035661098 None] Lock "cinder-cc9f4232-f950-42f6-aeb4-52431867740c-delete_volume" released by "delete_volume" :: held 2.747s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:18:55 devstack sudo[97036]: pam_unix(sudo:session): session closed for user root Nov 04 12:18:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-204fbb63-cc48-415f-be2f-07d17c36cb94 tempest-VolumesSnapshotTestJSON-1532377660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0162a1cb-9e07-46af-b905-2a158321439b /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-32d0390f-ddfc-4635-b137-d6c58ce27423" returned: 0 in 9.984s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:18:55 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-204fbb63-cc48-415f-be2f-07d17c36cb94 tempest-VolumesSnapshotTestJSON-1532377660 None] Image conversion details: src /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0162a1cb-9e07-46af-b905-2a158321439b, size 1024.00 MB, duration 9.99 sec, destination /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-32d0390f-ddfc-4635-b137-d6c58ce27423 {{(pid=87095) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 12:18:55 devstack cinder-volume[87095]: INFO cinder.image.image_utils [None req-204fbb63-cc48-415f-be2f-07d17c36cb94 tempest-VolumesSnapshotTestJSON-1532377660 None] Converted 1024.00 MB image at 102.55 MB/s Nov 04 12:18:55 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-204fbb63-cc48-415f-be2f-07d17c36cb94 tempest-VolumesSnapshotTestJSON-1532377660 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-32d0390f-ddfc-4635-b137-d6c58ce27423 is being set with open permissions: ugo+rw Nov 04 12:18:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-204fbb63-cc48-415f-be2f-07d17c36cb94 tempest-VolumesSnapshotTestJSON-1532377660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-32d0390f-ddfc-4635-b137-d6c58ce27423 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:18:55 devstack sudo[97103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-32d0390f-ddfc-4635-b137-d6c58ce27423 Nov 04 12:18:55 devstack sudo[97103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:18:56 devstack sudo[97103]: pam_unix(sudo:session): session closed for user root Nov 04 12:18:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-204fbb63-cc48-415f-be2f-07d17c36cb94 tempest-VolumesSnapshotTestJSON-1532377660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-32d0390f-ddfc-4635-b137-d6c58ce27423" returned: 0 in 0.271s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:18:56 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-204fbb63-cc48-415f-be2f-07d17c36cb94 tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "cinder-quobyte-32d0390f-ddfc-4635-b137-d6c58ce27423" released by "_copy_volume_from_snapshot" :: held 11.268s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:18:56 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-204fbb63-cc48-415f-be2f-07d17c36cb94 tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "cinder-quobyte-72afd6a7-f3fd-45df-a334-b88a8fd288d5-32d0390f-ddfc-4635-b137-d6c58ce27423" released by "_create_volume_from_snapshot" :: held 11.350s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:18:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-204fbb63-cc48-415f-be2f-07d17c36cb94 tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.377s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:18:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-15213ec1-216f-4485-96a7-37cb79c5e3ad tempest-VolumesSnapshotListTestJSON-229292204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.440s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:18:56 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-15213ec1-216f-4485-96a7-37cb79c5e3ad tempest-VolumesSnapshotListTestJSON-229292204 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:18:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-917598421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d78e7673-199d-4f89-b206-71c5249ddf37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80f8c2ec14ca42b1b45304243867b7a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:18:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:18:50Z,use_quota=True,user_id='dd2d9db213d046b0b03ab19bdda7b5f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:18:56 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-15213ec1-216f-4485-96a7-37cb79c5e3ad tempest-VolumesSnapshotListTestJSON-229292204 None] Creating volume d78e7673-199d-4f89-b206-71c5249ddf37 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:18:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-15213ec1-216f-4485-96a7-37cb79c5e3ad tempest-VolumesSnapshotListTestJSON-229292204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:18:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-15213ec1-216f-4485-96a7-37cb79c5e3ad tempest-VolumesSnapshotListTestJSON-229292204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:18:56 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-15213ec1-216f-4485-96a7-37cb79c5e3ad tempest-VolumesSnapshotListTestJSON-229292204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:18:56 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-15213ec1-216f-4485-96a7-37cb79c5e3ad tempest-VolumesSnapshotListTestJSON-229292204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:18:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-15213ec1-216f-4485-96a7-37cb79c5e3ad tempest-VolumesSnapshotListTestJSON-229292204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:18:56 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-15213ec1-216f-4485-96a7-37cb79c5e3ad tempest-VolumesSnapshotListTestJSON-229292204 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:18:56 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-15213ec1-216f-4485-96a7-37cb79c5e3ad tempest-VolumesSnapshotListTestJSON-229292204 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:18:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-15213ec1-216f-4485-96a7-37cb79c5e3ad tempest-VolumesSnapshotListTestJSON-229292204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:18:56 devstack sudo[97112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37 1073741824 Nov 04 12:18:56 devstack sudo[97112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:18:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-204fbb63-cc48-415f-be2f-07d17c36cb94 tempest-VolumesSnapshotTestJSON-1532377660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49633106-64c0-4c83-b209-5ffacbec1a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32d0390f-ddfc-4635-b137-d6c58ce27423', 'volume_size': 2, 'snapshot_id': '72afd6a7-f3fd-45df-a334-b88a8fd288d5'}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:18:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-204fbb63-cc48-415f-be2f-07d17c36cb94 tempest-VolumesSnapshotTestJSON-1532377660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e86e034-1d5e-4637-b622-6d27d22e5e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:18:56 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-204fbb63-cc48-415f-be2f-07d17c36cb94 tempest-VolumesSnapshotTestJSON-1532377660 None] Volume volume-32d0390f-ddfc-4635-b137-d6c58ce27423 (32d0390f-ddfc-4635-b137-d6c58ce27423): created successfully Nov 04 12:18:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-204fbb63-cc48-415f-be2f-07d17c36cb94 tempest-VolumesSnapshotTestJSON-1532377660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e86e034-1d5e-4637-b622-6d27d22e5e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:18:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-204fbb63-cc48-415f-be2f-07d17c36cb94 tempest-VolumesSnapshotTestJSON-1532377660 None] Flow 'volume_create_manager' (eb522b1a-7365-4cc8-b19a-32f76feb293f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:18:56 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-204fbb63-cc48-415f-be2f-07d17c36cb94 tempest-VolumesSnapshotTestJSON-1532377660 None] Created volume successfully. Nov 04 12:18:56 devstack sudo[97112]: pam_unix(sudo:session): session closed for user root Nov 04 12:18:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-15213ec1-216f-4485-96a7-37cb79c5e3ad tempest-VolumesSnapshotListTestJSON-229292204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37 1073741824" returned: 0 in 0.449s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:18:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-15213ec1-216f-4485-96a7-37cb79c5e3ad tempest-VolumesSnapshotListTestJSON-229292204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:18:56 devstack sudo[97125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37 Nov 04 12:18:56 devstack sudo[97125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:18:56 devstack sudo[97125]: pam_unix(sudo:session): session closed for user root Nov 04 12:18:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-15213ec1-216f-4485-96a7-37cb79c5e3ad tempest-VolumesSnapshotListTestJSON-229292204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37" returned: 0 in 0.243s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:18:56 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-15213ec1-216f-4485-96a7-37cb79c5e3ad tempest-VolumesSnapshotListTestJSON-229292204 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:18:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-15213ec1-216f-4485-96a7-37cb79c5e3ad tempest-VolumesSnapshotListTestJSON-229292204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:18:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-15213ec1-216f-4485-96a7-37cb79c5e3ad tempest-VolumesSnapshotListTestJSON-229292204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4b065b7-7d98-4d3f-bc61-d4b3c42ad9e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d78e7673-199d-4f89-b206-71c5249ddf37', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:18:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-15213ec1-216f-4485-96a7-37cb79c5e3ad tempest-VolumesSnapshotListTestJSON-229292204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e993edce-49c5-4138-a71e-f38147e3dfc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:18:56 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-15213ec1-216f-4485-96a7-37cb79c5e3ad tempest-VolumesSnapshotListTestJSON-229292204 None] Volume volume-d78e7673-199d-4f89-b206-71c5249ddf37 (d78e7673-199d-4f89-b206-71c5249ddf37): created successfully Nov 04 12:18:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-15213ec1-216f-4485-96a7-37cb79c5e3ad tempest-VolumesSnapshotListTestJSON-229292204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e993edce-49c5-4138-a71e-f38147e3dfc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:18:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-15213ec1-216f-4485-96a7-37cb79c5e3ad tempest-VolumesSnapshotListTestJSON-229292204 None] Flow 'volume_create_manager' (fe147aa4-3a97-4e52-9c95-6966366030d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:18:56 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-15213ec1-216f-4485-96a7-37cb79c5e3ad tempest-VolumesSnapshotListTestJSON-229292204 None] Created volume successfully. Nov 04 12:18:57 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3969a47b-f83b-4bc3-a250-a40895c535fe tempest-VolumesSnapshotTestJSON-1532377660 None] Acquiring lock "cinder-32d0390f-ddfc-4635-b137-d6c58ce27423-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:18:57 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3969a47b-f83b-4bc3-a250-a40895c535fe tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "cinder-32d0390f-ddfc-4635-b137-d6c58ce27423-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:18:57 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3969a47b-f83b-4bc3-a250-a40895c535fe tempest-VolumesSnapshotTestJSON-1532377660 None] Acquiring lock "cinder-quobyte-32d0390f-ddfc-4635-b137-d6c58ce27423" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:18:57 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3969a47b-f83b-4bc3-a250-a40895c535fe tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "cinder-quobyte-32d0390f-ddfc-4635-b137-d6c58ce27423" acquired by "delete_volume" :: waited 0.016s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:18:57 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[80652e2b-4bf5-48a6-9e6f-6c09153e6f49]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:18:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3969a47b-f83b-4bc3-a250-a40895c535fe tempest-VolumesSnapshotTestJSON-1532377660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-32d0390f-ddfc-4635-b137-d6c58ce27423 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:18:57 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-957ac2e6-193d-4912-aee2-ac9fcf672394 req-f5ff5775-1e4d-4a2f-8c3c-fb9b93bf21db tempest-TestInstancesWithCinderVolumes-2035661098 None] Terminate volume connection completed successfully. Nov 04 12:18:57 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-957ac2e6-193d-4912-aee2-ac9fcf672394 req-f5ff5775-1e4d-4a2f-8c3c-fb9b93bf21db tempest-TestInstancesWithCinderVolumes-2035661098 None] Deleting attachment 1adc2ba0-c0e5-429c-bf4d-da25f73d71f0. {{(pid=87095) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 12:18:57 devstack sudo[97131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-32d0390f-ddfc-4635-b137-d6c58ce27423 Nov 04 12:18:57 devstack sudo[97131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:18:57 devstack sudo[97131]: pam_unix(sudo:session): session closed for user root Nov 04 12:18:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3969a47b-f83b-4bc3-a250-a40895c535fe tempest-VolumesSnapshotTestJSON-1532377660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-32d0390f-ddfc-4635-b137-d6c58ce27423" returned: 0 in 0.371s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:18:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3969a47b-f83b-4bc3-a250-a40895c535fe tempest-VolumesSnapshotTestJSON-1532377660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-32d0390f-ddfc-4635-b137-d6c58ce27423 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:18:57 devstack sudo[97136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-32d0390f-ddfc-4635-b137-d6c58ce27423 Nov 04 12:18:57 devstack sudo[97136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:18:57 devstack sudo[97136]: pam_unix(sudo:session): session closed for user root Nov 04 12:18:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3969a47b-f83b-4bc3-a250-a40895c535fe tempest-VolumesSnapshotTestJSON-1532377660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-32d0390f-ddfc-4635-b137-d6c58ce27423" returned: 0 in 0.266s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:18:57 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3969a47b-f83b-4bc3-a250-a40895c535fe tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "cinder-quobyte-32d0390f-ddfc-4635-b137-d6c58ce27423" released by "delete_volume" :: held 0.686s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:18:58 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-3969a47b-f83b-4bc3-a250-a40895c535fe tempest-VolumesSnapshotTestJSON-1532377660 None] Created reservations ['48c76739-4a12-473c-aa7c-1beaacb665e9', 'db887cb9-16f7-475c-9917-1355b1be6750', '51ced1f0-4dab-40d3-9769-0df488dc3851', '42f422ca-3fd1-4de0-a52c-6cea0b39184a'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:18:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3969a47b-f83b-4bc3-a250-a40895c535fe tempest-VolumesSnapshotTestJSON-1532377660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:18:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3969a47b-f83b-4bc3-a250-a40895c535fe tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:18:58 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3969a47b-f83b-4bc3-a250-a40895c535fe tempest-VolumesSnapshotTestJSON-1532377660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:18:58 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3969a47b-f83b-4bc3-a250-a40895c535fe tempest-VolumesSnapshotTestJSON-1532377660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:18:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3969a47b-f83b-4bc3-a250-a40895c535fe tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:18:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3969a47b-f83b-4bc3-a250-a40895c535fe tempest-VolumesSnapshotTestJSON-1532377660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:18:58 devstack sudo[97139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:18:58 devstack sudo[97139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:18:58 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-4fd9f189-8d28-4062-952f-c0eb018bb173 tempest-TestInstancesWithCinderVolumes-2035661098 None] Acquiring lock "cinder-1af736e2-760b-435a-94d5-cc7f61f23fe4-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:18:58 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-4fd9f189-8d28-4062-952f-c0eb018bb173 tempest-TestInstancesWithCinderVolumes-2035661098 None] Lock "cinder-1af736e2-760b-435a-94d5-cc7f61f23fe4-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:18:58 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-4fd9f189-8d28-4062-952f-c0eb018bb173 tempest-TestInstancesWithCinderVolumes-2035661098 None] Acquiring lock "cinder-quobyte-1af736e2-760b-435a-94d5-cc7f61f23fe4" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:18:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3f76362a-49a4-49b0-b353-bb5d1988ce3b tempest-VolumesSnapshotListTestJSON-229292204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:18:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3f76362a-49a4-49b0-b353-bb5d1988ce3b tempest-VolumesSnapshotListTestJSON-229292204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:18:58 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-4fd9f189-8d28-4062-952f-c0eb018bb173 tempest-TestInstancesWithCinderVolumes-2035661098 None] Lock "cinder-quobyte-1af736e2-760b-435a-94d5-cc7f61f23fe4" acquired by "delete_volume" :: waited 0.034s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:18:58 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-3f76362a-49a4-49b0-b353-bb5d1988ce3b tempest-VolumesSnapshotListTestJSON-229292204 None] Creating offline snapshot 3575ce7a-6803-44dd-a836-e02ede0407b2 of volume d78e7673-199d-4f89-b206-71c5249ddf37 {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 12:18:58 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a04f5e0-69ab-4345-a408-b3c7ebf27fa4]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:18:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4fd9f189-8d28-4062-952f-c0eb018bb173 tempest-TestInstancesWithCinderVolumes-2035661098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1af736e2-760b-435a-94d5-cc7f61f23fe4 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:18:58 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[859ce686-b736-4c15-9c50-29ccd425d946]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:18:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3f76362a-49a4-49b0-b353-bb5d1988ce3b tempest-VolumesSnapshotListTestJSON-229292204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:18:58 devstack sudo[97139]: pam_unix(sudo:session): session closed for user root Nov 04 12:18:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3969a47b-f83b-4bc3-a250-a40895c535fe tempest-VolumesSnapshotTestJSON-1532377660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.312s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:18:58 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-3969a47b-f83b-4bc3-a250-a40895c535fe tempest-VolumesSnapshotTestJSON-1532377660 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:18:58 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-3969a47b-f83b-4bc3-a250-a40895c535fe tempest-VolumesSnapshotTestJSON-1532377660 None] Deleted volume successfully. Nov 04 12:18:58 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3969a47b-f83b-4bc3-a250-a40895c535fe tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "cinder-32d0390f-ddfc-4635-b137-d6c58ce27423-delete_volume" released by "delete_volume" :: held 1.261s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:18:58 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-486ef466-a0df-4f11-8af7-9e595f4b05a6 tempest-VolumesSnapshotTestJSON-1532377660 None] Acquiring lock "cinder-72afd6a7-f3fd-45df-a334-b88a8fd288d5-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:18:58 devstack sudo[97141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1af736e2-760b-435a-94d5-cc7f61f23fe4 Nov 04 12:18:58 devstack sudo[97141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:18:58 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-486ef466-a0df-4f11-8af7-9e595f4b05a6 tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "cinder-72afd6a7-f3fd-45df-a334-b88a8fd288d5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:18:58 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-486ef466-a0df-4f11-8af7-9e595f4b05a6 tempest-VolumesSnapshotTestJSON-1532377660 None] Acquiring lock "cinder-quobyte-0162a1cb-9e07-46af-b905-2a158321439b" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:18:58 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-486ef466-a0df-4f11-8af7-9e595f4b05a6 tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "cinder-quobyte-0162a1cb-9e07-46af-b905-2a158321439b" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:18:58 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-486ef466-a0df-4f11-8af7-9e595f4b05a6 tempest-VolumesSnapshotTestJSON-1532377660 None] Acquiring lock "cinder-quobyte-72afd6a7-f3fd-45df-a334-b88a8fd288d5" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:18:58 devstack sudo[97143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37 Nov 04 12:18:58 devstack sudo[97143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:18:58 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-486ef466-a0df-4f11-8af7-9e595f4b05a6 tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "cinder-quobyte-72afd6a7-f3fd-45df-a334-b88a8fd288d5" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:18:58 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-486ef466-a0df-4f11-8af7-9e595f4b05a6 tempest-VolumesSnapshotTestJSON-1532377660 None] Deleting offline snapshot 72afd6a7-f3fd-45df-a334-b88a8fd288d5 of volume 0162a1cb-9e07-46af-b905-2a158321439b {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 12:18:58 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-486ef466-a0df-4f11-8af7-9e595f4b05a6 tempest-VolumesSnapshotTestJSON-1532377660 None] snapshot_file for this snap is: volume-0162a1cb-9e07-46af-b905-2a158321439b.72afd6a7-f3fd-45df-a334-b88a8fd288d5 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 12:18:58 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[11908d76-de60-4da4-be4c-ce05a6741357]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:18:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-486ef466-a0df-4f11-8af7-9e595f4b05a6 tempest-VolumesSnapshotTestJSON-1532377660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0162a1cb-9e07-46af-b905-2a158321439b.72afd6a7-f3fd-45df-a334-b88a8fd288d5 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:18:58 devstack sudo[97146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0162a1cb-9e07-46af-b905-2a158321439b.72afd6a7-f3fd-45df-a334-b88a8fd288d5 Nov 04 12:18:58 devstack sudo[97146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:18:58 devstack sudo[97141]: pam_unix(sudo:session): session closed for user root Nov 04 12:18:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4fd9f189-8d28-4062-952f-c0eb018bb173 tempest-TestInstancesWithCinderVolumes-2035661098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1af736e2-760b-435a-94d5-cc7f61f23fe4" returned: 0 in 0.490s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:18:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4fd9f189-8d28-4062-952f-c0eb018bb173 tempest-TestInstancesWithCinderVolumes-2035661098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1af736e2-760b-435a-94d5-cc7f61f23fe4 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:18:58 devstack sudo[97154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1af736e2-760b-435a-94d5-cc7f61f23fe4 Nov 04 12:18:58 devstack sudo[97154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:18:58 devstack sudo[97143]: pam_unix(sudo:session): session closed for user root Nov 04 12:18:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3f76362a-49a4-49b0-b353-bb5d1988ce3b tempest-VolumesSnapshotListTestJSON-229292204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37" returned: 0 in 0.509s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:18:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3f76362a-49a4-49b0-b353-bb5d1988ce3b tempest-VolumesSnapshotListTestJSON-229292204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.3575ce7a-6803-44dd-a836-e02ede0407b2 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:18:58 devstack sudo[97156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.3575ce7a-6803-44dd-a836-e02ede0407b2 1G Nov 04 12:18:58 devstack sudo[97156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:18:59 devstack sudo[97146]: pam_unix(sudo:session): session closed for user root Nov 04 12:18:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-486ef466-a0df-4f11-8af7-9e595f4b05a6 tempest-VolumesSnapshotTestJSON-1532377660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0162a1cb-9e07-46af-b905-2a158321439b.72afd6a7-f3fd-45df-a334-b88a8fd288d5" returned: 0 in 0.451s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:18:59 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-486ef466-a0df-4f11-8af7-9e595f4b05a6 tempest-VolumesSnapshotTestJSON-1532377660 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0162a1cb-9e07-46af-b905-2a158321439b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 12:18:59 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2039d11f-c9f4-4fd6-8a89-1abad79db600]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:18:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-486ef466-a0df-4f11-8af7-9e595f4b05a6 tempest-VolumesSnapshotTestJSON-1532377660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0162a1cb-9e07-46af-b905-2a158321439b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:18:59 devstack sudo[97154]: pam_unix(sudo:session): session closed for user root Nov 04 12:18:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4fd9f189-8d28-4062-952f-c0eb018bb173 tempest-TestInstancesWithCinderVolumes-2035661098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1af736e2-760b-435a-94d5-cc7f61f23fe4" returned: 0 in 0.312s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:18:59 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-4fd9f189-8d28-4062-952f-c0eb018bb173 tempest-TestInstancesWithCinderVolumes-2035661098 None] Lock "cinder-quobyte-1af736e2-760b-435a-94d5-cc7f61f23fe4" released by "delete_volume" :: held 0.894s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:18:59 devstack cinder-volume[87095]: WARNING cinder.quota [None req-4fd9f189-8d28-4062-952f-c0eb018bb173 tempest-TestInstancesWithCinderVolumes-2035661098 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1290513648-2114741933 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1290513648-2114741933, it is now deprecated. Please use the default quota class for default quota. Nov 04 12:18:59 devstack cinder-volume[87095]: WARNING cinder.quota [None req-4fd9f189-8d28-4062-952f-c0eb018bb173 tempest-TestInstancesWithCinderVolumes-2035661098 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1290513648-2114741933 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1290513648-2114741933, it is now deprecated. Please use the default quota class for default quota. Nov 04 12:18:59 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-4fd9f189-8d28-4062-952f-c0eb018bb173 tempest-TestInstancesWithCinderVolumes-2035661098 None] Created reservations ['39bfdfd4-e18c-418b-8af9-31561bef18d9', 'ba0ed7f6-a8d2-4d3e-98f0-b1f49c94e450', 'd9c78c31-67df-46ec-b7e2-58bd5f49b539', 'be460dae-46cc-4ffe-9e51-28e9796698f4'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:18:59 devstack sudo[97164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0162a1cb-9e07-46af-b905-2a158321439b Nov 04 12:18:59 devstack sudo[97164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:18:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4fd9f189-8d28-4062-952f-c0eb018bb173 tempest-TestInstancesWithCinderVolumes-2035661098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:18:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4fd9f189-8d28-4062-952f-c0eb018bb173 tempest-TestInstancesWithCinderVolumes-2035661098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:18:59 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4fd9f189-8d28-4062-952f-c0eb018bb173 tempest-TestInstancesWithCinderVolumes-2035661098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:18:59 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4fd9f189-8d28-4062-952f-c0eb018bb173 tempest-TestInstancesWithCinderVolumes-2035661098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:18:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4fd9f189-8d28-4062-952f-c0eb018bb173 tempest-TestInstancesWithCinderVolumes-2035661098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:18:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4fd9f189-8d28-4062-952f-c0eb018bb173 tempest-TestInstancesWithCinderVolumes-2035661098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:18:59 devstack sudo[97168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:18:59 devstack sudo[97168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:18:59 devstack sudo[97156]: pam_unix(sudo:session): session closed for user root Nov 04 12:18:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3f76362a-49a4-49b0-b353-bb5d1988ce3b tempest-VolumesSnapshotListTestJSON-229292204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.3575ce7a-6803-44dd-a836-e02ede0407b2 1G" returned: 0 in 0.560s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:18:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3f76362a-49a4-49b0-b353-bb5d1988ce3b tempest-VolumesSnapshotListTestJSON-229292204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d78e7673-199d-4f89-b206-71c5249ddf37 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.3575ce7a-6803-44dd-a836-e02ede0407b2 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:18:59 devstack sudo[97171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d78e7673-199d-4f89-b206-71c5249ddf37 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.3575ce7a-6803-44dd-a836-e02ede0407b2 Nov 04 12:18:59 devstack sudo[97171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:18:59 devstack sudo[97168]: pam_unix(sudo:session): session closed for user root Nov 04 12:18:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4fd9f189-8d28-4062-952f-c0eb018bb173 tempest-TestInstancesWithCinderVolumes-2035661098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.321s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:18:59 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-4fd9f189-8d28-4062-952f-c0eb018bb173 tempest-TestInstancesWithCinderVolumes-2035661098 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:18:59 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-4fd9f189-8d28-4062-952f-c0eb018bb173 tempest-TestInstancesWithCinderVolumes-2035661098 None] Deleted volume successfully. Nov 04 12:18:59 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-4fd9f189-8d28-4062-952f-c0eb018bb173 tempest-TestInstancesWithCinderVolumes-2035661098 None] Lock "cinder-1af736e2-760b-435a-94d5-cc7f61f23fe4-delete_volume" released by "delete_volume" :: held 1.548s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:18:59 devstack sudo[97171]: pam_unix(sudo:session): session closed for user root Nov 04 12:18:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3f76362a-49a4-49b0-b353-bb5d1988ce3b tempest-VolumesSnapshotListTestJSON-229292204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d78e7673-199d-4f89-b206-71c5249ddf37 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.3575ce7a-6803-44dd-a836-e02ede0407b2" returned: 0 in 0.365s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:18:59 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-3f76362a-49a4-49b0-b353-bb5d1988ce3b tempest-VolumesSnapshotListTestJSON-229292204 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.3575ce7a-6803-44dd-a836-e02ede0407b2 is being set with open permissions: ugo+rw Nov 04 12:18:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3f76362a-49a4-49b0-b353-bb5d1988ce3b tempest-VolumesSnapshotListTestJSON-229292204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.3575ce7a-6803-44dd-a836-e02ede0407b2 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:18:59 devstack sudo[97164]: pam_unix(sudo:session): session closed for user root Nov 04 12:18:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-486ef466-a0df-4f11-8af7-9e595f4b05a6 tempest-VolumesSnapshotTestJSON-1532377660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0162a1cb-9e07-46af-b905-2a158321439b" returned: 0 in 0.730s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:18:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-486ef466-a0df-4f11-8af7-9e595f4b05a6 tempest-VolumesSnapshotTestJSON-1532377660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0162a1cb-9e07-46af-b905-2a158321439b.72afd6a7-f3fd-45df-a334-b88a8fd288d5 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:18:59 devstack sudo[97181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.3575ce7a-6803-44dd-a836-e02ede0407b2 Nov 04 12:18:59 devstack sudo[97181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:18:59 devstack sudo[97182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0162a1cb-9e07-46af-b905-2a158321439b.72afd6a7-f3fd-45df-a334-b88a8fd288d5 Nov 04 12:18:59 devstack sudo[97182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:19:00 devstack sudo[97181]: pam_unix(sudo:session): session closed for user root Nov 04 12:19:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3f76362a-49a4-49b0-b353-bb5d1988ce3b tempest-VolumesSnapshotListTestJSON-229292204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.3575ce7a-6803-44dd-a836-e02ede0407b2" returned: 0 in 0.340s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:19:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3f76362a-49a4-49b0-b353-bb5d1988ce3b tempest-VolumesSnapshotListTestJSON-229292204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:19:00 devstack sudo[97189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.info Nov 04 12:19:00 devstack sudo[97189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:19:00 devstack sudo[97182]: pam_unix(sudo:session): session closed for user root Nov 04 12:19:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-486ef466-a0df-4f11-8af7-9e595f4b05a6 tempest-VolumesSnapshotTestJSON-1532377660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0162a1cb-9e07-46af-b905-2a158321439b.72afd6a7-f3fd-45df-a334-b88a8fd288d5" returned: 0 in 0.435s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:19:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-486ef466-a0df-4f11-8af7-9e595f4b05a6 tempest-VolumesSnapshotTestJSON-1532377660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0162a1cb-9e07-46af-b905-2a158321439b.72afd6a7-f3fd-45df-a334-b88a8fd288d5 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:19:00 devstack sudo[97191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0162a1cb-9e07-46af-b905-2a158321439b.72afd6a7-f3fd-45df-a334-b88a8fd288d5 Nov 04 12:19:00 devstack sudo[97191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:19:00 devstack sudo[97189]: pam_unix(sudo:session): session closed for user root Nov 04 12:19:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3f76362a-49a4-49b0-b353-bb5d1988ce3b tempest-VolumesSnapshotListTestJSON-229292204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.info" returned: 0 in 0.294s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:19:00 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-3f76362a-49a4-49b0-b353-bb5d1988ce3b tempest-VolumesSnapshotListTestJSON-229292204 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.info is being set with open permissions: ugo+rw Nov 04 12:19:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3f76362a-49a4-49b0-b353-bb5d1988ce3b tempest-VolumesSnapshotListTestJSON-229292204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:19:00 devstack sudo[97194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.info Nov 04 12:19:00 devstack sudo[97194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:19:00 devstack sudo[97191]: pam_unix(sudo:session): session closed for user root Nov 04 12:19:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-486ef466-a0df-4f11-8af7-9e595f4b05a6 tempest-VolumesSnapshotTestJSON-1532377660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0162a1cb-9e07-46af-b905-2a158321439b.72afd6a7-f3fd-45df-a334-b88a8fd288d5" returned: 0 in 0.270s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:19:00 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-486ef466-a0df-4f11-8af7-9e595f4b05a6 tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "cinder-quobyte-72afd6a7-f3fd-45df-a334-b88a8fd288d5" released by "_delete_snapshot" :: held 2.022s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:19:00 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-486ef466-a0df-4f11-8af7-9e595f4b05a6 tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "cinder-quobyte-0162a1cb-9e07-46af-b905-2a158321439b" released by "delete_snapshot" :: held 2.056s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:19:00 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-486ef466-a0df-4f11-8af7-9e595f4b05a6 tempest-VolumesSnapshotTestJSON-1532377660 None] Created reservations ['b50ef581-413b-4fd4-ad53-e100fac646ad', '84380812-344e-45f9-8206-ebc7bd44b41a', '3a79bd8c-3421-4171-8bde-f9607115479b', '8c4da479-afd5-468d-af36-8f616588d4cc'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:19:00 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-486ef466-a0df-4f11-8af7-9e595f4b05a6 tempest-VolumesSnapshotTestJSON-1532377660 None] Delete snapshot completed successfully. Nov 04 12:19:00 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-486ef466-a0df-4f11-8af7-9e595f4b05a6 tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "cinder-72afd6a7-f3fd-45df-a334-b88a8fd288d5-delete_snapshot" released by "delete_snapshot" :: held 2.218s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:19:00 devstack sudo[97194]: pam_unix(sudo:session): session closed for user root Nov 04 12:19:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3f76362a-49a4-49b0-b353-bb5d1988ce3b tempest-VolumesSnapshotListTestJSON-229292204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.info" returned: 0 in 0.270s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:19:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3f76362a-49a4-49b0-b353-bb5d1988ce3b tempest-VolumesSnapshotListTestJSON-229292204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.512s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:19:00 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-3f76362a-49a4-49b0-b353-bb5d1988ce3b tempest-VolumesSnapshotListTestJSON-229292204 None] Create snapshot completed successfully Nov 04 12:19:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-16662bca-45e6-47e1-9035-c51aaab3c355 tempest-VolumesSnapshotListTestJSON-229292204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:19:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-16662bca-45e6-47e1-9035-c51aaab3c355 tempest-VolumesSnapshotListTestJSON-229292204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:19:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-16662bca-45e6-47e1-9035-c51aaab3c355 tempest-VolumesSnapshotListTestJSON-229292204 None] Creating offline snapshot 605b09f1-3b08-43a8-857f-01e86333fd83 of volume d78e7673-199d-4f89-b206-71c5249ddf37 {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 12:19:01 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 12:19:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:19:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:19:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:19:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:19:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:19:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:19:01 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d07a911f-125f-4e33-a42a-58d7e8748e9d]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:19:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-16662bca-45e6-47e1-9035-c51aaab3c355 tempest-VolumesSnapshotListTestJSON-229292204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.3575ce7a-6803-44dd-a836-e02ede0407b2 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:19:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f236e399-8d17-4961-a422-e821d987223a tempest-VolumesSnapshotTestJSON-1532377660 None] Acquiring lock "cinder-0162a1cb-9e07-46af-b905-2a158321439b-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:19:01 devstack sudo[97201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:19:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f236e399-8d17-4961-a422-e821d987223a tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "cinder-0162a1cb-9e07-46af-b905-2a158321439b-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:19:01 devstack sudo[97201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:19:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f236e399-8d17-4961-a422-e821d987223a tempest-VolumesSnapshotTestJSON-1532377660 None] Acquiring lock "cinder-quobyte-0162a1cb-9e07-46af-b905-2a158321439b" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:19:02 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f236e399-8d17-4961-a422-e821d987223a tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "cinder-quobyte-0162a1cb-9e07-46af-b905-2a158321439b" acquired by "delete_volume" :: waited 0.023s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:19:02 devstack sudo[97202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.3575ce7a-6803-44dd-a836-e02ede0407b2 Nov 04 12:19:02 devstack sudo[97202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:19:02 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc7f8b9-0dd1-4f74-83fe-a154daf3d2cc]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:19:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f236e399-8d17-4961-a422-e821d987223a tempest-VolumesSnapshotTestJSON-1532377660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0162a1cb-9e07-46af-b905-2a158321439b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:19:02 devstack sudo[97207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0162a1cb-9e07-46af-b905-2a158321439b Nov 04 12:19:02 devstack sudo[97207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:19:02 devstack sudo[97201]: pam_unix(sudo:session): session closed for user root Nov 04 12:19:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.590s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:19:02 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:19:02 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Running periodic task VolumeManager._thread_info {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 12:19:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] thread count: 28 {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 12:19:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] thread info: [<_MainThread(MainThread, started 140610387472512)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 12:19:02 devstack sudo[97202]: pam_unix(sudo:session): session closed for user root Nov 04 12:19:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-16662bca-45e6-47e1-9035-c51aaab3c355 tempest-VolumesSnapshotListTestJSON-229292204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.3575ce7a-6803-44dd-a836-e02ede0407b2" returned: 0 in 0.909s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:19:02 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-16662bca-45e6-47e1-9035-c51aaab3c355 tempest-VolumesSnapshotListTestJSON-229292204 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d78e7673-199d-4f89-b206-71c5249ddf37(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 12:19:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-16662bca-45e6-47e1-9035-c51aaab3c355 tempest-VolumesSnapshotListTestJSON-229292204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.3575ce7a-6803-44dd-a836-e02ede0407b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.605b09f1-3b08-43a8-857f-01e86333fd83 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:19:02 devstack sudo[97236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.3575ce7a-6803-44dd-a836-e02ede0407b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.605b09f1-3b08-43a8-857f-01e86333fd83 1G Nov 04 12:19:02 devstack sudo[97236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:19:02 devstack sudo[97207]: pam_unix(sudo:session): session closed for user root Nov 04 12:19:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f236e399-8d17-4961-a422-e821d987223a tempest-VolumesSnapshotTestJSON-1532377660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0162a1cb-9e07-46af-b905-2a158321439b" returned: 0 in 0.723s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:19:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f236e399-8d17-4961-a422-e821d987223a tempest-VolumesSnapshotTestJSON-1532377660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0162a1cb-9e07-46af-b905-2a158321439b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:19:02 devstack sudo[97238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0162a1cb-9e07-46af-b905-2a158321439b Nov 04 12:19:02 devstack sudo[97238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:19:03 devstack sudo[97238]: pam_unix(sudo:session): session closed for user root Nov 04 12:19:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f236e399-8d17-4961-a422-e821d987223a tempest-VolumesSnapshotTestJSON-1532377660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-0162a1cb-9e07-46af-b905-2a158321439b" returned: 0 in 0.362s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:19:03 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f236e399-8d17-4961-a422-e821d987223a tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "cinder-quobyte-0162a1cb-9e07-46af-b905-2a158321439b" released by "delete_volume" :: held 1.214s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:19:03 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-f236e399-8d17-4961-a422-e821d987223a tempest-VolumesSnapshotTestJSON-1532377660 None] Created reservations ['81aff10a-5743-4996-8ed7-62f473488343', 'a709b164-5760-474a-a189-a2e4003b230a', '9a5081e1-d84b-4188-82f2-cfc6d16a1945', 'a2060162-d880-419f-8a0d-dd2a44358ab4'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:19:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f236e399-8d17-4961-a422-e821d987223a tempest-VolumesSnapshotTestJSON-1532377660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:19:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f236e399-8d17-4961-a422-e821d987223a tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:19:03 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f236e399-8d17-4961-a422-e821d987223a tempest-VolumesSnapshotTestJSON-1532377660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:19:03 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f236e399-8d17-4961-a422-e821d987223a tempest-VolumesSnapshotTestJSON-1532377660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:19:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f236e399-8d17-4961-a422-e821d987223a tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:19:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f236e399-8d17-4961-a422-e821d987223a tempest-VolumesSnapshotTestJSON-1532377660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:19:03 devstack sudo[97247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:19:03 devstack sudo[97247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:19:03 devstack sudo[97236]: pam_unix(sudo:session): session closed for user root Nov 04 12:19:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-16662bca-45e6-47e1-9035-c51aaab3c355 tempest-VolumesSnapshotListTestJSON-229292204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.3575ce7a-6803-44dd-a836-e02ede0407b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.605b09f1-3b08-43a8-857f-01e86333fd83 1G" returned: 0 in 1.160s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:19:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-16662bca-45e6-47e1-9035-c51aaab3c355 tempest-VolumesSnapshotListTestJSON-229292204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d78e7673-199d-4f89-b206-71c5249ddf37.3575ce7a-6803-44dd-a836-e02ede0407b2 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.605b09f1-3b08-43a8-857f-01e86333fd83 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:19:03 devstack sudo[97251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d78e7673-199d-4f89-b206-71c5249ddf37.3575ce7a-6803-44dd-a836-e02ede0407b2 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.605b09f1-3b08-43a8-857f-01e86333fd83 Nov 04 12:19:03 devstack sudo[97251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:19:04 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-e5659dc9-f6dc-4c87-b48e-178b233632c0 req-ed591ea2-2c79-46e9-80b8-59ccd274176e tempest-TestInstancesWithCinderVolumes-2035661098 None] Terminate volume connection completed successfully. Nov 04 12:19:04 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-e5659dc9-f6dc-4c87-b48e-178b233632c0 req-ed591ea2-2c79-46e9-80b8-59ccd274176e tempest-TestInstancesWithCinderVolumes-2035661098 None] Deleting attachment ef903268-d69f-47c1-97a8-695fe7ad53f9. {{(pid=87095) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 12:19:04 devstack sudo[97247]: pam_unix(sudo:session): session closed for user root Nov 04 12:19:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f236e399-8d17-4961-a422-e821d987223a tempest-VolumesSnapshotTestJSON-1532377660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.625s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:19:04 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-f236e399-8d17-4961-a422-e821d987223a tempest-VolumesSnapshotTestJSON-1532377660 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:19:04 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-f236e399-8d17-4961-a422-e821d987223a tempest-VolumesSnapshotTestJSON-1532377660 None] Deleted volume successfully. Nov 04 12:19:04 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f236e399-8d17-4961-a422-e821d987223a tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "cinder-0162a1cb-9e07-46af-b905-2a158321439b-delete_volume" released by "delete_volume" :: held 2.302s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:19:04 devstack sudo[97251]: pam_unix(sudo:session): session closed for user root Nov 04 12:19:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-16662bca-45e6-47e1-9035-c51aaab3c355 tempest-VolumesSnapshotListTestJSON-229292204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d78e7673-199d-4f89-b206-71c5249ddf37.3575ce7a-6803-44dd-a836-e02ede0407b2 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.605b09f1-3b08-43a8-857f-01e86333fd83" returned: 0 in 0.477s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:19:04 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-16662bca-45e6-47e1-9035-c51aaab3c355 tempest-VolumesSnapshotListTestJSON-229292204 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.605b09f1-3b08-43a8-857f-01e86333fd83 is being set with open permissions: ugo+rw Nov 04 12:19:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-16662bca-45e6-47e1-9035-c51aaab3c355 tempest-VolumesSnapshotListTestJSON-229292204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.605b09f1-3b08-43a8-857f-01e86333fd83 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:19:04 devstack sudo[97258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.605b09f1-3b08-43a8-857f-01e86333fd83 Nov 04 12:19:04 devstack sudo[97258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:19:04 devstack sudo[97258]: pam_unix(sudo:session): session closed for user root Nov 04 12:19:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-16662bca-45e6-47e1-9035-c51aaab3c355 tempest-VolumesSnapshotListTestJSON-229292204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.605b09f1-3b08-43a8-857f-01e86333fd83" returned: 0 in 0.472s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:19:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-16662bca-45e6-47e1-9035-c51aaab3c355 tempest-VolumesSnapshotListTestJSON-229292204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.317s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:19:05 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-16662bca-45e6-47e1-9035-c51aaab3c355 tempest-VolumesSnapshotListTestJSON-229292204 None] Create snapshot completed successfully Nov 04 12:19:05 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9ee27cf-678d-4d31-99ab-c1f9e77090ad tempest-VolumesSnapshotTestJSON-1532377660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:19:05 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c9ee27cf-678d-4d31-99ab-c1f9e77090ad tempest-VolumesSnapshotTestJSON-1532377660 None] Flow 'volume_create_manager' (cbfa063a-1265-48f1-9148-31c41df4d113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:19:05 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c9ee27cf-678d-4d31-99ab-c1f9e77090ad tempest-VolumesSnapshotTestJSON-1532377660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2144bc76-e3a4-4925-8f30-f837f7dbe7d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:19:05 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-381fed87-6675-4df8-ac35-f511ad933b07 tempest-TestInstancesWithCinderVolumes-2035661098 None] Acquiring lock "cinder-9d58d6b3-adf2-4b46-94f2-7f39a50f8f9b-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:19:05 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c9ee27cf-678d-4d31-99ab-c1f9e77090ad tempest-VolumesSnapshotTestJSON-1532377660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2144bc76-e3a4-4925-8f30-f837f7dbe7d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:19:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1050019476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4625301-baf5-4e79-aaab-51260b5b6b84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b6ff12f94c64268b23516ceb90beeb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:19:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:19:05Z,use_quota=True,user_id='7c05c9967b4e4c459296b4cf8694208e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:19:05 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c9ee27cf-678d-4d31-99ab-c1f9e77090ad tempest-VolumesSnapshotTestJSON-1532377660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0a0e591-5a19-456c-bf0a-2eabd647f165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:19:05 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c9ee27cf-678d-4d31-99ab-c1f9e77090ad tempest-VolumesSnapshotTestJSON-1532377660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0a0e591-5a19-456c-bf0a-2eabd647f165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:19:05 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c9ee27cf-678d-4d31-99ab-c1f9e77090ad tempest-VolumesSnapshotTestJSON-1532377660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28257e15-d4f5-4207-84e6-4edef577aa0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:19:05 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c9ee27cf-678d-4d31-99ab-c1f9e77090ad tempest-VolumesSnapshotTestJSON-1532377660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28257e15-d4f5-4207-84e6-4edef577aa0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4625301-baf5-4e79-aaab-51260b5b6b84', 'volume_name': 'volume-d4625301-baf5-4e79-aaab-51260b5b6b84', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:19:05 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c9ee27cf-678d-4d31-99ab-c1f9e77090ad tempest-VolumesSnapshotTestJSON-1532377660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5fa8b52-c9ab-483c-9114-174d69424870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:19:05 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c9ee27cf-678d-4d31-99ab-c1f9e77090ad tempest-VolumesSnapshotTestJSON-1532377660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5fa8b52-c9ab-483c-9114-174d69424870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:19:05 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c9ee27cf-678d-4d31-99ab-c1f9e77090ad tempest-VolumesSnapshotTestJSON-1532377660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0be176f7-79d6-46c4-8ecd-811944aa2af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:19:05 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-c9ee27cf-678d-4d31-99ab-c1f9e77090ad tempest-VolumesSnapshotTestJSON-1532377660 None] Volume d4625301-baf5-4e79-aaab-51260b5b6b84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4625301-baf5-4e79-aaab-51260b5b6b84', 'volume_size': 1} Nov 04 12:19:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c9ee27cf-678d-4d31-99ab-c1f9e77090ad tempest-VolumesSnapshotTestJSON-1532377660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:19:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c9ee27cf-678d-4d31-99ab-c1f9e77090ad tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:19:05 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c9ee27cf-678d-4d31-99ab-c1f9e77090ad tempest-VolumesSnapshotTestJSON-1532377660 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:19:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1050019476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4625301-baf5-4e79-aaab-51260b5b6b84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b6ff12f94c64268b23516ceb90beeb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:19:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:19:05Z,use_quota=True,user_id='7c05c9967b4e4c459296b4cf8694208e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:19:05 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-c9ee27cf-678d-4d31-99ab-c1f9e77090ad tempest-VolumesSnapshotTestJSON-1532377660 None] Creating volume d4625301-baf5-4e79-aaab-51260b5b6b84 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:19:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c9ee27cf-678d-4d31-99ab-c1f9e77090ad tempest-VolumesSnapshotTestJSON-1532377660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:19:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c9ee27cf-678d-4d31-99ab-c1f9e77090ad tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:19:05 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c9ee27cf-678d-4d31-99ab-c1f9e77090ad tempest-VolumesSnapshotTestJSON-1532377660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:19:05 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c9ee27cf-678d-4d31-99ab-c1f9e77090ad tempest-VolumesSnapshotTestJSON-1532377660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:19:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c9ee27cf-678d-4d31-99ab-c1f9e77090ad tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:19:05 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c9ee27cf-678d-4d31-99ab-c1f9e77090ad tempest-VolumesSnapshotTestJSON-1532377660 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:19:05 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-c9ee27cf-678d-4d31-99ab-c1f9e77090ad tempest-VolumesSnapshotTestJSON-1532377660 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:19:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c9ee27cf-678d-4d31-99ab-c1f9e77090ad tempest-VolumesSnapshotTestJSON-1532377660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d4625301-baf5-4e79-aaab-51260b5b6b84 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:19:05 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-381fed87-6675-4df8-ac35-f511ad933b07 tempest-TestInstancesWithCinderVolumes-2035661098 None] Lock "cinder-9d58d6b3-adf2-4b46-94f2-7f39a50f8f9b-delete_volume" acquired by "delete_volume" :: waited 0.100s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:19:05 devstack sudo[97280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d4625301-baf5-4e79-aaab-51260b5b6b84 1073741824 Nov 04 12:19:05 devstack sudo[97280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:19:05 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-381fed87-6675-4df8-ac35-f511ad933b07 tempest-TestInstancesWithCinderVolumes-2035661098 None] Acquiring lock "cinder-quobyte-9d58d6b3-adf2-4b46-94f2-7f39a50f8f9b" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:19:05 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-381fed87-6675-4df8-ac35-f511ad933b07 tempest-TestInstancesWithCinderVolumes-2035661098 None] Lock "cinder-quobyte-9d58d6b3-adf2-4b46-94f2-7f39a50f8f9b" acquired by "delete_volume" :: waited 0.019s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:19:05 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd82b751-4823-4c66-bf5e-533df3759b72]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:19:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-381fed87-6675-4df8-ac35-f511ad933b07 tempest-TestInstancesWithCinderVolumes-2035661098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9d58d6b3-adf2-4b46-94f2-7f39a50f8f9b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:19:05 devstack sudo[97282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9d58d6b3-adf2-4b46-94f2-7f39a50f8f9b Nov 04 12:19:05 devstack sudo[97282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:19:05 devstack sudo[97280]: pam_unix(sudo:session): session closed for user root Nov 04 12:19:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c9ee27cf-678d-4d31-99ab-c1f9e77090ad tempest-VolumesSnapshotTestJSON-1532377660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d4625301-baf5-4e79-aaab-51260b5b6b84 1073741824" returned: 0 in 0.551s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:19:05 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=96,cinder:INSERT=19,cinder:UPDATE=100,cinder:DELETE=9 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 12:19:05 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=103,cinder:INSERT=29,cinder:UPDATE=99,cinder:DELETE=8 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 12:19:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c9ee27cf-678d-4d31-99ab-c1f9e77090ad tempest-VolumesSnapshotTestJSON-1532377660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d4625301-baf5-4e79-aaab-51260b5b6b84 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:19:05 devstack sudo[97292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d4625301-baf5-4e79-aaab-51260b5b6b84 Nov 04 12:19:05 devstack sudo[97292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:19:05 devstack sudo[97282]: pam_unix(sudo:session): session closed for user root Nov 04 12:19:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-381fed87-6675-4df8-ac35-f511ad933b07 tempest-TestInstancesWithCinderVolumes-2035661098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9d58d6b3-adf2-4b46-94f2-7f39a50f8f9b" returned: 0 in 0.540s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:19:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-381fed87-6675-4df8-ac35-f511ad933b07 tempest-TestInstancesWithCinderVolumes-2035661098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9d58d6b3-adf2-4b46-94f2-7f39a50f8f9b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:19:06 devstack sudo[97294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9d58d6b3-adf2-4b46-94f2-7f39a50f8f9b Nov 04 12:19:06 devstack sudo[97294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:19:06 devstack sudo[97294]: pam_unix(sudo:session): session closed for user root Nov 04 12:19:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-381fed87-6675-4df8-ac35-f511ad933b07 tempest-TestInstancesWithCinderVolumes-2035661098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9d58d6b3-adf2-4b46-94f2-7f39a50f8f9b" returned: 0 in 0.408s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:19:06 devstack sudo[97292]: pam_unix(sudo:session): session closed for user root Nov 04 12:19:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c9ee27cf-678d-4d31-99ab-c1f9e77090ad tempest-VolumesSnapshotTestJSON-1532377660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d4625301-baf5-4e79-aaab-51260b5b6b84" returned: 0 in 0.485s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:19:06 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c9ee27cf-678d-4d31-99ab-c1f9e77090ad tempest-VolumesSnapshotTestJSON-1532377660 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:19:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c9ee27cf-678d-4d31-99ab-c1f9e77090ad tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:19:06 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-381fed87-6675-4df8-ac35-f511ad933b07 tempest-TestInstancesWithCinderVolumes-2035661098 None] Lock "cinder-quobyte-9d58d6b3-adf2-4b46-94f2-7f39a50f8f9b" released by "delete_volume" :: held 1.018s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:19:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c9ee27cf-678d-4d31-99ab-c1f9e77090ad tempest-VolumesSnapshotTestJSON-1532377660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0be176f7-79d6-46c4-8ecd-811944aa2af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4625301-baf5-4e79-aaab-51260b5b6b84', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:19:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c9ee27cf-678d-4d31-99ab-c1f9e77090ad tempest-VolumesSnapshotTestJSON-1532377660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a07eff92-7bab-4547-8978-c27782adbd69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:19:06 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-c9ee27cf-678d-4d31-99ab-c1f9e77090ad tempest-VolumesSnapshotTestJSON-1532377660 None] Volume volume-d4625301-baf5-4e79-aaab-51260b5b6b84 (d4625301-baf5-4e79-aaab-51260b5b6b84): created successfully Nov 04 12:19:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c9ee27cf-678d-4d31-99ab-c1f9e77090ad tempest-VolumesSnapshotTestJSON-1532377660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a07eff92-7bab-4547-8978-c27782adbd69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:19:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c9ee27cf-678d-4d31-99ab-c1f9e77090ad tempest-VolumesSnapshotTestJSON-1532377660 None] Flow 'volume_create_manager' (cbfa063a-1265-48f1-9148-31c41df4d113) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:19:06 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-c9ee27cf-678d-4d31-99ab-c1f9e77090ad tempest-VolumesSnapshotTestJSON-1532377660 None] Created volume successfully. Nov 04 12:19:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-57b15326-a428-4dad-8475-5537268a545e tempest-VolumesSnapshotListTestJSON-229292204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:19:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-57b15326-a428-4dad-8475-5537268a545e tempest-VolumesSnapshotListTestJSON-229292204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:19:06 devstack cinder-volume[87095]: WARNING cinder.quota [None req-381fed87-6675-4df8-ac35-f511ad933b07 tempest-TestInstancesWithCinderVolumes-2035661098 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-777980019-701454249 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-777980019-701454249, it is now deprecated. Please use the default quota class for default quota. Nov 04 12:19:06 devstack cinder-volume[87095]: WARNING cinder.quota [None req-381fed87-6675-4df8-ac35-f511ad933b07 tempest-TestInstancesWithCinderVolumes-2035661098 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-777980019-701454249 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-777980019-701454249, it is now deprecated. Please use the default quota class for default quota. Nov 04 12:19:06 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-57b15326-a428-4dad-8475-5537268a545e tempest-VolumesSnapshotListTestJSON-229292204 None] Creating offline snapshot 21e91d7d-5179-45de-9eda-1462d0bf1446 of volume d78e7673-199d-4f89-b206-71c5249ddf37 {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 12:19:06 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[55733c99-2d95-4693-a29b-66b260ee7eda]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:19:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-57b15326-a428-4dad-8475-5537268a545e tempest-VolumesSnapshotListTestJSON-229292204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.605b09f1-3b08-43a8-857f-01e86333fd83 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:19:06 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-381fed87-6675-4df8-ac35-f511ad933b07 tempest-TestInstancesWithCinderVolumes-2035661098 None] Created reservations ['133da497-e399-40f8-a3fe-a6a075e68419', '5b88ad08-6e3b-4049-bbfb-d86561d05eed', 'caa131ce-1680-49eb-91ce-fe873ba3bcf2', '08199618-a3cf-4747-a0e9-70c984265dfd'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:19:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-381fed87-6675-4df8-ac35-f511ad933b07 tempest-TestInstancesWithCinderVolumes-2035661098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:19:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-381fed87-6675-4df8-ac35-f511ad933b07 tempest-TestInstancesWithCinderVolumes-2035661098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:19:06 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-381fed87-6675-4df8-ac35-f511ad933b07 tempest-TestInstancesWithCinderVolumes-2035661098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:19:06 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-381fed87-6675-4df8-ac35-f511ad933b07 tempest-TestInstancesWithCinderVolumes-2035661098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:19:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-381fed87-6675-4df8-ac35-f511ad933b07 tempest-TestInstancesWithCinderVolumes-2035661098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:19:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-381fed87-6675-4df8-ac35-f511ad933b07 tempest-TestInstancesWithCinderVolumes-2035661098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:19:06 devstack sudo[97300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.605b09f1-3b08-43a8-857f-01e86333fd83 Nov 04 12:19:06 devstack sudo[97300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:19:06 devstack sudo[97301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:19:06 devstack sudo[97301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:19:07 devstack sudo[97301]: pam_unix(sudo:session): session closed for user root Nov 04 12:19:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-381fed87-6675-4df8-ac35-f511ad933b07 tempest-TestInstancesWithCinderVolumes-2035661098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.296s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:19:07 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-381fed87-6675-4df8-ac35-f511ad933b07 tempest-TestInstancesWithCinderVolumes-2035661098 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:19:07 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-381fed87-6675-4df8-ac35-f511ad933b07 tempest-TestInstancesWithCinderVolumes-2035661098 None] Deleted volume successfully. Nov 04 12:19:07 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-381fed87-6675-4df8-ac35-f511ad933b07 tempest-TestInstancesWithCinderVolumes-2035661098 None] Lock "cinder-9d58d6b3-adf2-4b46-94f2-7f39a50f8f9b-delete_volume" released by "delete_volume" :: held 1.782s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:19:07 devstack sudo[97300]: pam_unix(sudo:session): session closed for user root Nov 04 12:19:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-57b15326-a428-4dad-8475-5537268a545e tempest-VolumesSnapshotListTestJSON-229292204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.605b09f1-3b08-43a8-857f-01e86333fd83" returned: 0 in 0.485s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:19:07 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-57b15326-a428-4dad-8475-5537268a545e tempest-VolumesSnapshotListTestJSON-229292204 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d78e7673-199d-4f89-b206-71c5249ddf37(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 12:19:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-57b15326-a428-4dad-8475-5537268a545e tempest-VolumesSnapshotListTestJSON-229292204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.605b09f1-3b08-43a8-857f-01e86333fd83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.21e91d7d-5179-45de-9eda-1462d0bf1446 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:19:07 devstack sudo[97308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.605b09f1-3b08-43a8-857f-01e86333fd83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.21e91d7d-5179-45de-9eda-1462d0bf1446 1G Nov 04 12:19:07 devstack sudo[97308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:19:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-02e7a4c7-370e-476d-a30a-093958b963ca tempest-VolumesSnapshotTestJSON-1532377660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:19:07 devstack sudo[97308]: pam_unix(sudo:session): session closed for user root Nov 04 12:19:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-57b15326-a428-4dad-8475-5537268a545e tempest-VolumesSnapshotListTestJSON-229292204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.605b09f1-3b08-43a8-857f-01e86333fd83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.21e91d7d-5179-45de-9eda-1462d0bf1446 1G" returned: 0 in 0.668s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:19:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-57b15326-a428-4dad-8475-5537268a545e tempest-VolumesSnapshotListTestJSON-229292204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d78e7673-199d-4f89-b206-71c5249ddf37.605b09f1-3b08-43a8-857f-01e86333fd83 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.21e91d7d-5179-45de-9eda-1462d0bf1446 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:19:07 devstack sudo[97314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d78e7673-199d-4f89-b206-71c5249ddf37.605b09f1-3b08-43a8-857f-01e86333fd83 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.21e91d7d-5179-45de-9eda-1462d0bf1446 Nov 04 12:19:07 devstack sudo[97314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:19:08 devstack sudo[97314]: pam_unix(sudo:session): session closed for user root Nov 04 12:19:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-57b15326-a428-4dad-8475-5537268a545e tempest-VolumesSnapshotListTestJSON-229292204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d78e7673-199d-4f89-b206-71c5249ddf37.605b09f1-3b08-43a8-857f-01e86333fd83 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.21e91d7d-5179-45de-9eda-1462d0bf1446" returned: 0 in 0.334s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:19:08 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-57b15326-a428-4dad-8475-5537268a545e tempest-VolumesSnapshotListTestJSON-229292204 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.21e91d7d-5179-45de-9eda-1462d0bf1446 is being set with open permissions: ugo+rw Nov 04 12:19:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-57b15326-a428-4dad-8475-5537268a545e tempest-VolumesSnapshotListTestJSON-229292204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.21e91d7d-5179-45de-9eda-1462d0bf1446 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:19:08 devstack sudo[97319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.21e91d7d-5179-45de-9eda-1462d0bf1446 Nov 04 12:19:08 devstack sudo[97319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:19:08 devstack sudo[97319]: pam_unix(sudo:session): session closed for user root Nov 04 12:19:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-57b15326-a428-4dad-8475-5537268a545e tempest-VolumesSnapshotListTestJSON-229292204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.21e91d7d-5179-45de-9eda-1462d0bf1446" returned: 0 in 0.297s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:19:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-57b15326-a428-4dad-8475-5537268a545e tempest-VolumesSnapshotListTestJSON-229292204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.931s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:19:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-02e7a4c7-370e-476d-a30a-093958b963ca tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.825s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:19:08 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-02e7a4c7-370e-476d-a30a-093958b963ca tempest-VolumesSnapshotTestJSON-1532377660 None] Creating offline snapshot 4bee96cc-bc74-427f-8d85-a485ec29d329 of volume d4625301-baf5-4e79-aaab-51260b5b6b84 {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 12:19:08 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-57b15326-a428-4dad-8475-5537268a545e tempest-VolumesSnapshotListTestJSON-229292204 None] Create snapshot completed successfully Nov 04 12:19:08 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4855e77-6f6e-4bca-82ff-3ea4d51d5c3a]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:19:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-02e7a4c7-370e-476d-a30a-093958b963ca tempest-VolumesSnapshotTestJSON-1532377660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d4625301-baf5-4e79-aaab-51260b5b6b84 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:19:08 devstack sudo[97322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d4625301-baf5-4e79-aaab-51260b5b6b84 Nov 04 12:19:08 devstack sudo[97322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:19:09 devstack sudo[97322]: pam_unix(sudo:session): session closed for user root Nov 04 12:19:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-02e7a4c7-370e-476d-a30a-093958b963ca tempest-VolumesSnapshotTestJSON-1532377660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d4625301-baf5-4e79-aaab-51260b5b6b84" returned: 0 in 0.543s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:19:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-02e7a4c7-370e-476d-a30a-093958b963ca tempest-VolumesSnapshotTestJSON-1532377660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d4625301-baf5-4e79-aaab-51260b5b6b84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d4625301-baf5-4e79-aaab-51260b5b6b84.4bee96cc-bc74-427f-8d85-a485ec29d329 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:19:09 devstack sudo[97327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d4625301-baf5-4e79-aaab-51260b5b6b84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d4625301-baf5-4e79-aaab-51260b5b6b84.4bee96cc-bc74-427f-8d85-a485ec29d329 1G Nov 04 12:19:09 devstack sudo[97327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:19:09 devstack sudo[97327]: pam_unix(sudo:session): session closed for user root Nov 04 12:19:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-02e7a4c7-370e-476d-a30a-093958b963ca tempest-VolumesSnapshotTestJSON-1532377660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d4625301-baf5-4e79-aaab-51260b5b6b84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d4625301-baf5-4e79-aaab-51260b5b6b84.4bee96cc-bc74-427f-8d85-a485ec29d329 1G" returned: 0 in 0.716s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:19:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-02e7a4c7-370e-476d-a30a-093958b963ca tempest-VolumesSnapshotTestJSON-1532377660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4625301-baf5-4e79-aaab-51260b5b6b84 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d4625301-baf5-4e79-aaab-51260b5b6b84.4bee96cc-bc74-427f-8d85-a485ec29d329 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:19:09 devstack sudo[97333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4625301-baf5-4e79-aaab-51260b5b6b84 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d4625301-baf5-4e79-aaab-51260b5b6b84.4bee96cc-bc74-427f-8d85-a485ec29d329 Nov 04 12:19:09 devstack sudo[97333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:19:09 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-d7285800-7879-4b6b-a040-d7bf83f6e717 tempest-VolumesSnapshotListTestJSON-229292204 None] Acquiring lock "cinder-21e91d7d-5179-45de-9eda-1462d0bf1446-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:19:09 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-d7285800-7879-4b6b-a040-d7bf83f6e717 tempest-VolumesSnapshotListTestJSON-229292204 None] Lock "cinder-21e91d7d-5179-45de-9eda-1462d0bf1446-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:19:09 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-d7285800-7879-4b6b-a040-d7bf83f6e717 tempest-VolumesSnapshotListTestJSON-229292204 None] Acquiring lock "cinder-quobyte-d78e7673-199d-4f89-b206-71c5249ddf37" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:19:09 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-d7285800-7879-4b6b-a040-d7bf83f6e717 tempest-VolumesSnapshotListTestJSON-229292204 None] Lock "cinder-quobyte-d78e7673-199d-4f89-b206-71c5249ddf37" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:19:09 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-d7285800-7879-4b6b-a040-d7bf83f6e717 tempest-VolumesSnapshotListTestJSON-229292204 None] Acquiring lock "cinder-quobyte-21e91d7d-5179-45de-9eda-1462d0bf1446" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:19:09 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-d7285800-7879-4b6b-a040-d7bf83f6e717 tempest-VolumesSnapshotListTestJSON-229292204 None] Lock "cinder-quobyte-21e91d7d-5179-45de-9eda-1462d0bf1446" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:19:09 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-d7285800-7879-4b6b-a040-d7bf83f6e717 tempest-VolumesSnapshotListTestJSON-229292204 None] Deleting offline snapshot 21e91d7d-5179-45de-9eda-1462d0bf1446 of volume d78e7673-199d-4f89-b206-71c5249ddf37 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 12:19:10 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-d7285800-7879-4b6b-a040-d7bf83f6e717 tempest-VolumesSnapshotListTestJSON-229292204 None] snapshot_file for this snap is: volume-d78e7673-199d-4f89-b206-71c5249ddf37.21e91d7d-5179-45de-9eda-1462d0bf1446 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 12:19:10 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[182e88c9-ad65-4ff6-aca8-df1815ee2782]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:19:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d7285800-7879-4b6b-a040-d7bf83f6e717 tempest-VolumesSnapshotListTestJSON-229292204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.21e91d7d-5179-45de-9eda-1462d0bf1446 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:19:10 devstack sudo[97335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.21e91d7d-5179-45de-9eda-1462d0bf1446 Nov 04 12:19:10 devstack sudo[97335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:19:10 devstack sudo[97333]: pam_unix(sudo:session): session closed for user root Nov 04 12:19:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-02e7a4c7-370e-476d-a30a-093958b963ca tempest-VolumesSnapshotTestJSON-1532377660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4625301-baf5-4e79-aaab-51260b5b6b84 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d4625301-baf5-4e79-aaab-51260b5b6b84.4bee96cc-bc74-427f-8d85-a485ec29d329" returned: 0 in 0.440s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:19:10 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-02e7a4c7-370e-476d-a30a-093958b963ca tempest-VolumesSnapshotTestJSON-1532377660 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d4625301-baf5-4e79-aaab-51260b5b6b84.4bee96cc-bc74-427f-8d85-a485ec29d329 is being set with open permissions: ugo+rw Nov 04 12:19:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-02e7a4c7-370e-476d-a30a-093958b963ca tempest-VolumesSnapshotTestJSON-1532377660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d4625301-baf5-4e79-aaab-51260b5b6b84.4bee96cc-bc74-427f-8d85-a485ec29d329 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:19:10 devstack sudo[97341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d4625301-baf5-4e79-aaab-51260b5b6b84.4bee96cc-bc74-427f-8d85-a485ec29d329 Nov 04 12:19:10 devstack sudo[97341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:19:10 devstack sudo[97335]: pam_unix(sudo:session): session closed for user root Nov 04 12:19:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d7285800-7879-4b6b-a040-d7bf83f6e717 tempest-VolumesSnapshotListTestJSON-229292204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.21e91d7d-5179-45de-9eda-1462d0bf1446" returned: 0 in 0.508s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:19:10 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-d7285800-7879-4b6b-a040-d7bf83f6e717 tempest-VolumesSnapshotListTestJSON-229292204 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d78e7673-199d-4f89-b206-71c5249ddf37(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 12:19:10 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a435ce8b-3426-4ec1-adec-87106004bf4b]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:19:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d7285800-7879-4b6b-a040-d7bf83f6e717 tempest-VolumesSnapshotListTestJSON-229292204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.605b09f1-3b08-43a8-857f-01e86333fd83 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:19:10 devstack sudo[97341]: pam_unix(sudo:session): session closed for user root Nov 04 12:19:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-02e7a4c7-370e-476d-a30a-093958b963ca tempest-VolumesSnapshotTestJSON-1532377660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d4625301-baf5-4e79-aaab-51260b5b6b84.4bee96cc-bc74-427f-8d85-a485ec29d329" returned: 0 in 0.390s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:19:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-02e7a4c7-370e-476d-a30a-093958b963ca tempest-VolumesSnapshotTestJSON-1532377660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d4625301-baf5-4e79-aaab-51260b5b6b84.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:19:10 devstack sudo[97350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d4625301-baf5-4e79-aaab-51260b5b6b84.info Nov 04 12:19:10 devstack sudo[97350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:19:10 devstack sudo[97349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.605b09f1-3b08-43a8-857f-01e86333fd83 Nov 04 12:19:10 devstack sudo[97349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:19:10 devstack sudo[97350]: pam_unix(sudo:session): session closed for user root Nov 04 12:19:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-02e7a4c7-370e-476d-a30a-093958b963ca tempest-VolumesSnapshotTestJSON-1532377660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d4625301-baf5-4e79-aaab-51260b5b6b84.info" returned: 0 in 0.305s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:19:10 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-02e7a4c7-370e-476d-a30a-093958b963ca tempest-VolumesSnapshotTestJSON-1532377660 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d4625301-baf5-4e79-aaab-51260b5b6b84.info is being set with open permissions: ugo+rw Nov 04 12:19:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-02e7a4c7-370e-476d-a30a-093958b963ca tempest-VolumesSnapshotTestJSON-1532377660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d4625301-baf5-4e79-aaab-51260b5b6b84.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:19:10 devstack sudo[97356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d4625301-baf5-4e79-aaab-51260b5b6b84.info Nov 04 12:19:10 devstack sudo[97356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:19:11 devstack sudo[97349]: pam_unix(sudo:session): session closed for user root Nov 04 12:19:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d7285800-7879-4b6b-a040-d7bf83f6e717 tempest-VolumesSnapshotListTestJSON-229292204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.605b09f1-3b08-43a8-857f-01e86333fd83" returned: 0 in 0.465s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:19:11 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-d7285800-7879-4b6b-a040-d7bf83f6e717 tempest-VolumesSnapshotListTestJSON-229292204 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d78e7673-199d-4f89-b206-71c5249ddf37(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 12:19:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d7285800-7879-4b6b-a040-d7bf83f6e717 tempest-VolumesSnapshotListTestJSON-229292204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.21e91d7d-5179-45de-9eda-1462d0bf1446 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:19:11 devstack sudo[97360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.21e91d7d-5179-45de-9eda-1462d0bf1446 Nov 04 12:19:11 devstack sudo[97360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:19:11 devstack sudo[97356]: pam_unix(sudo:session): session closed for user root Nov 04 12:19:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-02e7a4c7-370e-476d-a30a-093958b963ca tempest-VolumesSnapshotTestJSON-1532377660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d4625301-baf5-4e79-aaab-51260b5b6b84.info" returned: 0 in 0.305s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:19:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-02e7a4c7-370e-476d-a30a-093958b963ca tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.840s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:19:11 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-02e7a4c7-370e-476d-a30a-093958b963ca tempest-VolumesSnapshotTestJSON-1532377660 None] Create snapshot completed successfully Nov 04 12:19:11 devstack sudo[97360]: pam_unix(sudo:session): session closed for user root Nov 04 12:19:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d7285800-7879-4b6b-a040-d7bf83f6e717 tempest-VolumesSnapshotListTestJSON-229292204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.21e91d7d-5179-45de-9eda-1462d0bf1446" returned: 0 in 0.549s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:19:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d7285800-7879-4b6b-a040-d7bf83f6e717 tempest-VolumesSnapshotListTestJSON-229292204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.21e91d7d-5179-45de-9eda-1462d0bf1446 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:19:11 devstack sudo[97367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.21e91d7d-5179-45de-9eda-1462d0bf1446 Nov 04 12:19:11 devstack sudo[97367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:19:11 devstack sudo[97367]: pam_unix(sudo:session): session closed for user root Nov 04 12:19:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d7285800-7879-4b6b-a040-d7bf83f6e717 tempest-VolumesSnapshotListTestJSON-229292204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.21e91d7d-5179-45de-9eda-1462d0bf1446" returned: 0 in 0.323s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:19:11 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-d7285800-7879-4b6b-a040-d7bf83f6e717 tempest-VolumesSnapshotListTestJSON-229292204 None] Lock "cinder-quobyte-21e91d7d-5179-45de-9eda-1462d0bf1446" released by "_delete_snapshot" :: held 2.003s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:19:11 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-d7285800-7879-4b6b-a040-d7bf83f6e717 tempest-VolumesSnapshotListTestJSON-229292204 None] Lock "cinder-quobyte-d78e7673-199d-4f89-b206-71c5249ddf37" released by "delete_snapshot" :: held 2.043s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:19:12 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-d7285800-7879-4b6b-a040-d7bf83f6e717 tempest-VolumesSnapshotListTestJSON-229292204 None] Created reservations ['b238f0e9-a99a-4845-adfa-20e2a7aab15b', '3604995d-f1be-4a95-a5df-212086dfc78f', 'acd055eb-52d8-4928-bcd5-d532039194a6', '8e70f745-3db6-4e4a-b916-5e8a7abb04d3'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:19:12 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-d7285800-7879-4b6b-a040-d7bf83f6e717 tempest-VolumesSnapshotListTestJSON-229292204 None] Delete snapshot completed successfully. Nov 04 12:19:12 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-d7285800-7879-4b6b-a040-d7bf83f6e717 tempest-VolumesSnapshotListTestJSON-229292204 None] Lock "cinder-21e91d7d-5179-45de-9eda-1462d0bf1446-delete_snapshot" released by "delete_snapshot" :: held 2.259s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:19:12 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0244110-ba90-4feb-8d83-9539cf926200 tempest-VolumesSnapshotTestJSON-1532377660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:19:12 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f0244110-ba90-4feb-8d83-9539cf926200 tempest-VolumesSnapshotTestJSON-1532377660 None] Flow 'volume_create_manager' (bc3e1f65-409e-4395-bfa3-5a25b857bfde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:19:12 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f0244110-ba90-4feb-8d83-9539cf926200 tempest-VolumesSnapshotTestJSON-1532377660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2172b8c-065c-4f6f-bd0a-ecbbe6bfc176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:19:12 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f0244110-ba90-4feb-8d83-9539cf926200 tempest-VolumesSnapshotTestJSON-1532377660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2172b8c-065c-4f6f-bd0a-ecbbe6bfc176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:19:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-645455893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84ab4bff-e6ff-4d6a-be1e-80a4bf2663c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b6ff12f94c64268b23516ceb90beeb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:19:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4bee96cc-bc74-427f-8d85-a485ec29d329,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:19:13Z,use_quota=True,user_id='7c05c9967b4e4c459296b4cf8694208e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:19:12 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f0244110-ba90-4feb-8d83-9539cf926200 tempest-VolumesSnapshotTestJSON-1532377660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31b23483-0d7b-4a3c-b534-35cd8e47864a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:19:12 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f0244110-ba90-4feb-8d83-9539cf926200 tempest-VolumesSnapshotTestJSON-1532377660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31b23483-0d7b-4a3c-b534-35cd8e47864a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:19:12 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f0244110-ba90-4feb-8d83-9539cf926200 tempest-VolumesSnapshotTestJSON-1532377660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b4c4506-f411-4f14-9126-4fea55eeb524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:19:12 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f0244110-ba90-4feb-8d83-9539cf926200 tempest-VolumesSnapshotTestJSON-1532377660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b4c4506-f411-4f14-9126-4fea55eeb524) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '84ab4bff-e6ff-4d6a-be1e-80a4bf2663c9', 'volume_name': 'volume-84ab4bff-e6ff-4d6a-be1e-80a4bf2663c9', 'volume_size': 1, 'snapshot_id': '4bee96cc-bc74-427f-8d85-a485ec29d329'}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:19:12 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f0244110-ba90-4feb-8d83-9539cf926200 tempest-VolumesSnapshotTestJSON-1532377660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca9df0e7-fb14-421d-8811-777c858cc88f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:19:12 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f0244110-ba90-4feb-8d83-9539cf926200 tempest-VolumesSnapshotTestJSON-1532377660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca9df0e7-fb14-421d-8811-777c858cc88f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:19:12 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f0244110-ba90-4feb-8d83-9539cf926200 tempest-VolumesSnapshotTestJSON-1532377660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20e956e0-90a1-44b7-b7c4-face94ec7357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:19:12 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-f0244110-ba90-4feb-8d83-9539cf926200 tempest-VolumesSnapshotTestJSON-1532377660 None] Volume 84ab4bff-e6ff-4d6a-be1e-80a4bf2663c9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-84ab4bff-e6ff-4d6a-be1e-80a4bf2663c9', 'volume_size': 1, 'snapshot_id': '4bee96cc-bc74-427f-8d85-a485ec29d329'} Nov 04 12:19:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f0244110-ba90-4feb-8d83-9539cf926200 tempest-VolumesSnapshotTestJSON-1532377660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:19:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f0244110-ba90-4feb-8d83-9539cf926200 tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:19:12 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f0244110-ba90-4feb-8d83-9539cf926200 tempest-VolumesSnapshotTestJSON-1532377660 None] Acquiring lock "cinder-quobyte-4bee96cc-bc74-427f-8d85-a485ec29d329-84ab4bff-e6ff-4d6a-be1e-80a4bf2663c9" by "_create_volume_from_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:19:12 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f0244110-ba90-4feb-8d83-9539cf926200 tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "cinder-quobyte-4bee96cc-bc74-427f-8d85-a485ec29d329-84ab4bff-e6ff-4d6a-be1e-80a4bf2663c9" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:19:12 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f0244110-ba90-4feb-8d83-9539cf926200 tempest-VolumesSnapshotTestJSON-1532377660 None] Creating volume 84ab4bff-e6ff-4d6a-be1e-80a4bf2663c9 from snapshot 4bee96cc-bc74-427f-8d85-a485ec29d329 {{(pid=87095) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 04 12:19:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f0244110-ba90-4feb-8d83-9539cf926200 tempest-VolumesSnapshotTestJSON-1532377660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:19:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f0244110-ba90-4feb-8d83-9539cf926200 tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:19:12 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f0244110-ba90-4feb-8d83-9539cf926200 tempest-VolumesSnapshotTestJSON-1532377660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:19:12 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f0244110-ba90-4feb-8d83-9539cf926200 tempest-VolumesSnapshotTestJSON-1532377660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:19:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f0244110-ba90-4feb-8d83-9539cf926200 tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:19:12 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f0244110-ba90-4feb-8d83-9539cf926200 tempest-VolumesSnapshotTestJSON-1532377660 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:19:12 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f0244110-ba90-4feb-8d83-9539cf926200 tempest-VolumesSnapshotTestJSON-1532377660 None] Acquiring lock "cinder-quobyte-84ab4bff-e6ff-4d6a-be1e-80a4bf2663c9" by "_copy_volume_from_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:19:12 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f0244110-ba90-4feb-8d83-9539cf926200 tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "cinder-quobyte-84ab4bff-e6ff-4d6a-be1e-80a4bf2663c9" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:19:12 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f0244110-ba90-4feb-8d83-9539cf926200 tempest-VolumesSnapshotTestJSON-1532377660 None] snapshot: 4bee96cc-bc74-427f-8d85-a485ec29d329, volume: 84ab4bff-e6ff-4d6a-be1e-80a4bf2663c9, {{(pid=87095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 12:19:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f0244110-ba90-4feb-8d83-9539cf926200 tempest-VolumesSnapshotTestJSON-1532377660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:19:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f0244110-ba90-4feb-8d83-9539cf926200 tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:19:12 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f0244110-ba90-4feb-8d83-9539cf926200 tempest-VolumesSnapshotTestJSON-1532377660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:19:12 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f0244110-ba90-4feb-8d83-9539cf926200 tempest-VolumesSnapshotTestJSON-1532377660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:19:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f0244110-ba90-4feb-8d83-9539cf926200 tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:19:12 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d078d5-42cc-47c2-8fcb-0d11ff10b754]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:19:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f0244110-ba90-4feb-8d83-9539cf926200 tempest-VolumesSnapshotTestJSON-1532377660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d4625301-baf5-4e79-aaab-51260b5b6b84.4bee96cc-bc74-427f-8d85-a485ec29d329 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:19:13 devstack sudo[97374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d4625301-baf5-4e79-aaab-51260b5b6b84.4bee96cc-bc74-427f-8d85-a485ec29d329 Nov 04 12:19:13 devstack sudo[97374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:19:13 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ef096693-048f-46fc-8a64-4a678d31bdfc tempest-VolumesSnapshotListTestJSON-229292204 None] Acquiring lock "cinder-605b09f1-3b08-43a8-857f-01e86333fd83-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:19:13 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ef096693-048f-46fc-8a64-4a678d31bdfc tempest-VolumesSnapshotListTestJSON-229292204 None] Lock "cinder-605b09f1-3b08-43a8-857f-01e86333fd83-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:19:13 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ef096693-048f-46fc-8a64-4a678d31bdfc tempest-VolumesSnapshotListTestJSON-229292204 None] Acquiring lock "cinder-quobyte-d78e7673-199d-4f89-b206-71c5249ddf37" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:19:13 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ef096693-048f-46fc-8a64-4a678d31bdfc tempest-VolumesSnapshotListTestJSON-229292204 None] Lock "cinder-quobyte-d78e7673-199d-4f89-b206-71c5249ddf37" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:19:13 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ef096693-048f-46fc-8a64-4a678d31bdfc tempest-VolumesSnapshotListTestJSON-229292204 None] Acquiring lock "cinder-quobyte-605b09f1-3b08-43a8-857f-01e86333fd83" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:19:13 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ef096693-048f-46fc-8a64-4a678d31bdfc tempest-VolumesSnapshotListTestJSON-229292204 None] Lock "cinder-quobyte-605b09f1-3b08-43a8-857f-01e86333fd83" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:19:13 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-ef096693-048f-46fc-8a64-4a678d31bdfc tempest-VolumesSnapshotListTestJSON-229292204 None] Deleting offline snapshot 605b09f1-3b08-43a8-857f-01e86333fd83 of volume d78e7673-199d-4f89-b206-71c5249ddf37 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 12:19:13 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-ef096693-048f-46fc-8a64-4a678d31bdfc tempest-VolumesSnapshotListTestJSON-229292204 None] snapshot_file for this snap is: volume-d78e7673-199d-4f89-b206-71c5249ddf37.605b09f1-3b08-43a8-857f-01e86333fd83 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 12:19:13 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[41722e25-a2a0-4fcf-9f7a-55843f291987]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:19:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ef096693-048f-46fc-8a64-4a678d31bdfc tempest-VolumesSnapshotListTestJSON-229292204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.605b09f1-3b08-43a8-857f-01e86333fd83 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:19:13 devstack sudo[97376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.605b09f1-3b08-43a8-857f-01e86333fd83 Nov 04 12:19:13 devstack sudo[97376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:19:13 devstack sudo[97374]: pam_unix(sudo:session): session closed for user root Nov 04 12:19:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f0244110-ba90-4feb-8d83-9539cf926200 tempest-VolumesSnapshotTestJSON-1532377660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d4625301-baf5-4e79-aaab-51260b5b6b84.4bee96cc-bc74-427f-8d85-a485ec29d329" returned: 0 in 0.624s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:19:13 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-f0244110-ba90-4feb-8d83-9539cf926200 tempest-VolumesSnapshotTestJSON-1532377660 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4625301-baf5-4e79-aaab-51260b5b6b84(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 12:19:13 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4091bda1-fa38-4e79-bc82-68515318e2d0]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:19:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f0244110-ba90-4feb-8d83-9539cf926200 tempest-VolumesSnapshotTestJSON-1532377660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d4625301-baf5-4e79-aaab-51260b5b6b84 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:19:13 devstack sudo[97382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d4625301-baf5-4e79-aaab-51260b5b6b84 Nov 04 12:19:13 devstack sudo[97382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:19:13 devstack sudo[97376]: pam_unix(sudo:session): session closed for user root Nov 04 12:19:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ef096693-048f-46fc-8a64-4a678d31bdfc tempest-VolumesSnapshotListTestJSON-229292204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.605b09f1-3b08-43a8-857f-01e86333fd83" returned: 0 in 0.550s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:19:13 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-ef096693-048f-46fc-8a64-4a678d31bdfc tempest-VolumesSnapshotListTestJSON-229292204 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d78e7673-199d-4f89-b206-71c5249ddf37(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 12:19:13 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e8aa5bb-e00f-4695-91e2-25094fa0c642]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:19:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ef096693-048f-46fc-8a64-4a678d31bdfc tempest-VolumesSnapshotListTestJSON-229292204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.3575ce7a-6803-44dd-a836-e02ede0407b2 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:19:14 devstack sudo[97388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.3575ce7a-6803-44dd-a836-e02ede0407b2 Nov 04 12:19:14 devstack sudo[97388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:19:14 devstack sudo[97382]: pam_unix(sudo:session): session closed for user root Nov 04 12:19:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f0244110-ba90-4feb-8d83-9539cf926200 tempest-VolumesSnapshotTestJSON-1532377660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d4625301-baf5-4e79-aaab-51260b5b6b84" returned: 0 in 0.686s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:19:14 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f0244110-ba90-4feb-8d83-9539cf926200 tempest-VolumesSnapshotTestJSON-1532377660 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d4625301-baf5-4e79-aaab-51260b5b6b84 {{(pid=87095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 12:19:14 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f0244110-ba90-4feb-8d83-9539cf926200 tempest-VolumesSnapshotTestJSON-1532377660 None] Creating direct copy from snapshot {{(pid=87095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 12:19:14 devstack cinder-volume[87095]: DEBUG cinder.utils [None req-f0244110-ba90-4feb-8d83-9539cf926200 tempest-VolumesSnapshotTestJSON-1532377660 None] Path /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-84ab4bff-e6ff-4d6a-be1e-80a4bf2663c9 not found in is_blk_device check {{(pid=87095) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 04 12:19:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f0244110-ba90-4feb-8d83-9539cf926200 tempest-VolumesSnapshotTestJSON-1532377660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d4625301-baf5-4e79-aaab-51260b5b6b84 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-84ab4bff-e6ff-4d6a-be1e-80a4bf2663c9 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:19:14 devstack sudo[97394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d4625301-baf5-4e79-aaab-51260b5b6b84 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-84ab4bff-e6ff-4d6a-be1e-80a4bf2663c9 Nov 04 12:19:14 devstack sudo[97394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:19:14 devstack sudo[97388]: pam_unix(sudo:session): session closed for user root Nov 04 12:19:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ef096693-048f-46fc-8a64-4a678d31bdfc tempest-VolumesSnapshotListTestJSON-229292204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.3575ce7a-6803-44dd-a836-e02ede0407b2" returned: 0 in 0.752s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:19:14 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-ef096693-048f-46fc-8a64-4a678d31bdfc tempest-VolumesSnapshotListTestJSON-229292204 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d78e7673-199d-4f89-b206-71c5249ddf37(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 12:19:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ef096693-048f-46fc-8a64-4a678d31bdfc tempest-VolumesSnapshotListTestJSON-229292204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.605b09f1-3b08-43a8-857f-01e86333fd83 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:19:14 devstack sudo[97404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.605b09f1-3b08-43a8-857f-01e86333fd83 Nov 04 12:19:14 devstack sudo[97404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:19:15 devstack sudo[97404]: pam_unix(sudo:session): session closed for user root Nov 04 12:19:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ef096693-048f-46fc-8a64-4a678d31bdfc tempest-VolumesSnapshotListTestJSON-229292204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.605b09f1-3b08-43a8-857f-01e86333fd83" returned: 0 in 0.849s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:19:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ef096693-048f-46fc-8a64-4a678d31bdfc tempest-VolumesSnapshotListTestJSON-229292204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.605b09f1-3b08-43a8-857f-01e86333fd83 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:19:15 devstack sudo[97433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.605b09f1-3b08-43a8-857f-01e86333fd83 Nov 04 12:19:15 devstack sudo[97433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:19:16 devstack sudo[97433]: pam_unix(sudo:session): session closed for user root Nov 04 12:19:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ef096693-048f-46fc-8a64-4a678d31bdfc tempest-VolumesSnapshotListTestJSON-229292204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.605b09f1-3b08-43a8-857f-01e86333fd83" returned: 0 in 0.783s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:19:16 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ef096693-048f-46fc-8a64-4a678d31bdfc tempest-VolumesSnapshotListTestJSON-229292204 None] Lock "cinder-quobyte-605b09f1-3b08-43a8-857f-01e86333fd83" released by "_delete_snapshot" :: held 3.186s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:19:16 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ef096693-048f-46fc-8a64-4a678d31bdfc tempest-VolumesSnapshotListTestJSON-229292204 None] Lock "cinder-quobyte-d78e7673-199d-4f89-b206-71c5249ddf37" released by "delete_snapshot" :: held 3.226s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:19:16 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-ef096693-048f-46fc-8a64-4a678d31bdfc tempest-VolumesSnapshotListTestJSON-229292204 None] Created reservations ['bebe1548-344b-408c-a75f-c244914da99d', '269c3a94-3327-4b76-b235-d481c723db61', '26bd17b2-2658-4abc-ae3a-2c800cd1c4e2', 'c9f8af10-2da2-4282-8e8b-2e048f63c387'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:19:16 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-ef096693-048f-46fc-8a64-4a678d31bdfc tempest-VolumesSnapshotListTestJSON-229292204 None] Delete snapshot completed successfully. Nov 04 12:19:16 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ef096693-048f-46fc-8a64-4a678d31bdfc tempest-VolumesSnapshotListTestJSON-229292204 None] Lock "cinder-605b09f1-3b08-43a8-857f-01e86333fd83-delete_snapshot" released by "delete_snapshot" :: held 3.611s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:19:17 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-bd912a4b-fd58-4016-989b-70042cbb9988 tempest-VolumesSnapshotListTestJSON-229292204 None] Acquiring lock "cinder-3575ce7a-6803-44dd-a836-e02ede0407b2-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:19:17 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-bd912a4b-fd58-4016-989b-70042cbb9988 tempest-VolumesSnapshotListTestJSON-229292204 None] Lock "cinder-3575ce7a-6803-44dd-a836-e02ede0407b2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:19:17 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-bd912a4b-fd58-4016-989b-70042cbb9988 tempest-VolumesSnapshotListTestJSON-229292204 None] Acquiring lock "cinder-quobyte-d78e7673-199d-4f89-b206-71c5249ddf37" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:19:17 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-bd912a4b-fd58-4016-989b-70042cbb9988 tempest-VolumesSnapshotListTestJSON-229292204 None] Lock "cinder-quobyte-d78e7673-199d-4f89-b206-71c5249ddf37" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:19:17 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-bd912a4b-fd58-4016-989b-70042cbb9988 tempest-VolumesSnapshotListTestJSON-229292204 None] Acquiring lock "cinder-quobyte-3575ce7a-6803-44dd-a836-e02ede0407b2" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:19:17 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-bd912a4b-fd58-4016-989b-70042cbb9988 tempest-VolumesSnapshotListTestJSON-229292204 None] Lock "cinder-quobyte-3575ce7a-6803-44dd-a836-e02ede0407b2" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:19:17 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-bd912a4b-fd58-4016-989b-70042cbb9988 tempest-VolumesSnapshotListTestJSON-229292204 None] Deleting offline snapshot 3575ce7a-6803-44dd-a836-e02ede0407b2 of volume d78e7673-199d-4f89-b206-71c5249ddf37 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 12:19:17 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-bd912a4b-fd58-4016-989b-70042cbb9988 tempest-VolumesSnapshotListTestJSON-229292204 None] snapshot_file for this snap is: volume-d78e7673-199d-4f89-b206-71c5249ddf37.3575ce7a-6803-44dd-a836-e02ede0407b2 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 12:19:17 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f0048c-faaa-4bc8-afac-36bcfc56f04d]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:19:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-bd912a4b-fd58-4016-989b-70042cbb9988 tempest-VolumesSnapshotListTestJSON-229292204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.3575ce7a-6803-44dd-a836-e02ede0407b2 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:19:18 devstack sudo[97436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.3575ce7a-6803-44dd-a836-e02ede0407b2 Nov 04 12:19:18 devstack sudo[97436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:19:18 devstack sudo[97436]: pam_unix(sudo:session): session closed for user root Nov 04 12:19:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-bd912a4b-fd58-4016-989b-70042cbb9988 tempest-VolumesSnapshotListTestJSON-229292204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.3575ce7a-6803-44dd-a836-e02ede0407b2" returned: 0 in 0.950s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:19:18 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-bd912a4b-fd58-4016-989b-70042cbb9988 tempest-VolumesSnapshotListTestJSON-229292204 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d78e7673-199d-4f89-b206-71c5249ddf37(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 12:19:18 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[84be28ff-8f8a-4937-bae2-dedbedf3f1d5]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:19:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-bd912a4b-fd58-4016-989b-70042cbb9988 tempest-VolumesSnapshotListTestJSON-229292204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:19:19 devstack sudo[97445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37 Nov 04 12:19:19 devstack sudo[97445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:19:19 devstack sudo[97445]: pam_unix(sudo:session): session closed for user root Nov 04 12:19:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-bd912a4b-fd58-4016-989b-70042cbb9988 tempest-VolumesSnapshotListTestJSON-229292204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37" returned: 0 in 0.976s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:19:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-bd912a4b-fd58-4016-989b-70042cbb9988 tempest-VolumesSnapshotListTestJSON-229292204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.3575ce7a-6803-44dd-a836-e02ede0407b2 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:19:19 devstack sudo[97471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.3575ce7a-6803-44dd-a836-e02ede0407b2 Nov 04 12:19:19 devstack sudo[97471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:19:21 devstack sudo[97471]: pam_unix(sudo:session): session closed for user root Nov 04 12:19:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-bd912a4b-fd58-4016-989b-70042cbb9988 tempest-VolumesSnapshotListTestJSON-229292204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.3575ce7a-6803-44dd-a836-e02ede0407b2" returned: 0 in 1.403s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:19:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-bd912a4b-fd58-4016-989b-70042cbb9988 tempest-VolumesSnapshotListTestJSON-229292204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.3575ce7a-6803-44dd-a836-e02ede0407b2 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:19:21 devstack sudo[97519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.3575ce7a-6803-44dd-a836-e02ede0407b2 Nov 04 12:19:21 devstack sudo[97519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:19:21 devstack sudo[97519]: pam_unix(sudo:session): session closed for user root Nov 04 12:19:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-bd912a4b-fd58-4016-989b-70042cbb9988 tempest-VolumesSnapshotListTestJSON-229292204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37.3575ce7a-6803-44dd-a836-e02ede0407b2" returned: 0 in 0.506s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:19:21 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-bd912a4b-fd58-4016-989b-70042cbb9988 tempest-VolumesSnapshotListTestJSON-229292204 None] Lock "cinder-quobyte-3575ce7a-6803-44dd-a836-e02ede0407b2" released by "_delete_snapshot" :: held 4.238s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:19:21 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-bd912a4b-fd58-4016-989b-70042cbb9988 tempest-VolumesSnapshotListTestJSON-229292204 None] Lock "cinder-quobyte-d78e7673-199d-4f89-b206-71c5249ddf37" released by "delete_snapshot" :: held 4.294s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:19:22 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-bd912a4b-fd58-4016-989b-70042cbb9988 tempest-VolumesSnapshotListTestJSON-229292204 None] Created reservations ['8083c3b9-ce4d-4cdb-9e62-675bbb8af47c', '26cb1c1c-0627-4722-83ee-d7dba0f5b984', '54082677-f3c8-406f-b04c-c3fcbcf7a586', '315c6403-44dd-46f5-9792-aa38829795e0'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:19:22 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-bd912a4b-fd58-4016-989b-70042cbb9988 tempest-VolumesSnapshotListTestJSON-229292204 None] Delete snapshot completed successfully. Nov 04 12:19:22 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-bd912a4b-fd58-4016-989b-70042cbb9988 tempest-VolumesSnapshotListTestJSON-229292204 None] Lock "cinder-3575ce7a-6803-44dd-a836-e02ede0407b2-delete_snapshot" released by "delete_snapshot" :: held 4.795s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:19:23 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c8a3e8d8-3b1c-4b94-a68e-9fd81f6e4e0a tempest-VolumesSnapshotListTestJSON-229292204 None] Acquiring lock "cinder-d78e7673-199d-4f89-b206-71c5249ddf37-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:19:23 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c8a3e8d8-3b1c-4b94-a68e-9fd81f6e4e0a tempest-VolumesSnapshotListTestJSON-229292204 None] Lock "cinder-d78e7673-199d-4f89-b206-71c5249ddf37-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:19:23 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c8a3e8d8-3b1c-4b94-a68e-9fd81f6e4e0a tempest-VolumesSnapshotListTestJSON-229292204 None] Acquiring lock "cinder-quobyte-d78e7673-199d-4f89-b206-71c5249ddf37" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:19:23 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c8a3e8d8-3b1c-4b94-a68e-9fd81f6e4e0a tempest-VolumesSnapshotListTestJSON-229292204 None] Lock "cinder-quobyte-d78e7673-199d-4f89-b206-71c5249ddf37" acquired by "delete_volume" :: waited 0.072s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:19:24 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ca29f0-a92d-4eff-a640-9399f16168f4]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:19:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c8a3e8d8-3b1c-4b94-a68e-9fd81f6e4e0a tempest-VolumesSnapshotListTestJSON-229292204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:19:24 devstack sudo[97564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37 Nov 04 12:19:24 devstack sudo[97564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:19:25 devstack sudo[97564]: pam_unix(sudo:session): session closed for user root Nov 04 12:19:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c8a3e8d8-3b1c-4b94-a68e-9fd81f6e4e0a tempest-VolumesSnapshotListTestJSON-229292204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37" returned: 0 in 1.030s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:19:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c8a3e8d8-3b1c-4b94-a68e-9fd81f6e4e0a tempest-VolumesSnapshotListTestJSON-229292204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:19:25 devstack sudo[97571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37 Nov 04 12:19:25 devstack sudo[97571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:19:26 devstack sudo[97571]: pam_unix(sudo:session): session closed for user root Nov 04 12:19:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c8a3e8d8-3b1c-4b94-a68e-9fd81f6e4e0a tempest-VolumesSnapshotListTestJSON-229292204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d78e7673-199d-4f89-b206-71c5249ddf37" returned: 0 in 0.881s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:19:26 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c8a3e8d8-3b1c-4b94-a68e-9fd81f6e4e0a tempest-VolumesSnapshotListTestJSON-229292204 None] Lock "cinder-quobyte-d78e7673-199d-4f89-b206-71c5249ddf37" released by "delete_volume" :: held 2.166s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:19:26 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-c8a3e8d8-3b1c-4b94-a68e-9fd81f6e4e0a tempest-VolumesSnapshotListTestJSON-229292204 None] Created reservations ['07592e7d-953e-49b5-a5c5-0b3ca555343e', 'f3dda735-7216-486b-9c15-ded0dc28c591', '5c5d337f-0682-4fe7-a641-4716f4982f63', '6b30a954-4f88-4147-b57d-a04a76e5d614'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:19:26 devstack sudo[97394]: pam_unix(sudo:session): session closed for user root Nov 04 12:19:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f0244110-ba90-4feb-8d83-9539cf926200 tempest-VolumesSnapshotTestJSON-1532377660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d4625301-baf5-4e79-aaab-51260b5b6b84 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-84ab4bff-e6ff-4d6a-be1e-80a4bf2663c9" returned: 0 in 11.997s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:19:26 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-f0244110-ba90-4feb-8d83-9539cf926200 tempest-VolumesSnapshotTestJSON-1532377660 None] Image conversion details: src /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d4625301-baf5-4e79-aaab-51260b5b6b84, size 1024.00 MB, duration 12.00 sec, destination /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-84ab4bff-e6ff-4d6a-be1e-80a4bf2663c9 {{(pid=87095) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 12:19:26 devstack cinder-volume[87095]: INFO cinder.image.image_utils [None req-f0244110-ba90-4feb-8d83-9539cf926200 tempest-VolumesSnapshotTestJSON-1532377660 None] Converted 1024.00 MB image at 85.35 MB/s Nov 04 12:19:26 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-f0244110-ba90-4feb-8d83-9539cf926200 tempest-VolumesSnapshotTestJSON-1532377660 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-84ab4bff-e6ff-4d6a-be1e-80a4bf2663c9 is being set with open permissions: ugo+rw Nov 04 12:19:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f0244110-ba90-4feb-8d83-9539cf926200 tempest-VolumesSnapshotTestJSON-1532377660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-84ab4bff-e6ff-4d6a-be1e-80a4bf2663c9 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:19:26 devstack sudo[97574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-84ab4bff-e6ff-4d6a-be1e-80a4bf2663c9 Nov 04 12:19:26 devstack sudo[97574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:19:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c8a3e8d8-3b1c-4b94-a68e-9fd81f6e4e0a tempest-VolumesSnapshotListTestJSON-229292204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:19:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c8a3e8d8-3b1c-4b94-a68e-9fd81f6e4e0a tempest-VolumesSnapshotListTestJSON-229292204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:19:26 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c8a3e8d8-3b1c-4b94-a68e-9fd81f6e4e0a tempest-VolumesSnapshotListTestJSON-229292204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:19:26 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c8a3e8d8-3b1c-4b94-a68e-9fd81f6e4e0a tempest-VolumesSnapshotListTestJSON-229292204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:19:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c8a3e8d8-3b1c-4b94-a68e-9fd81f6e4e0a tempest-VolumesSnapshotListTestJSON-229292204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:19:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c8a3e8d8-3b1c-4b94-a68e-9fd81f6e4e0a tempest-VolumesSnapshotListTestJSON-229292204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:19:26 devstack sudo[97577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:19:26 devstack sudo[97577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:19:26 devstack sudo[97574]: pam_unix(sudo:session): session closed for user root Nov 04 12:19:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f0244110-ba90-4feb-8d83-9539cf926200 tempest-VolumesSnapshotTestJSON-1532377660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-84ab4bff-e6ff-4d6a-be1e-80a4bf2663c9" returned: 0 in 0.435s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:19:26 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f0244110-ba90-4feb-8d83-9539cf926200 tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "cinder-quobyte-84ab4bff-e6ff-4d6a-be1e-80a4bf2663c9" released by "_copy_volume_from_snapshot" :: held 13.941s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:19:26 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f0244110-ba90-4feb-8d83-9539cf926200 tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "cinder-quobyte-4bee96cc-bc74-427f-8d85-a485ec29d329-84ab4bff-e6ff-4d6a-be1e-80a4bf2663c9" released by "_create_volume_from_snapshot" :: held 14.060s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:19:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f0244110-ba90-4feb-8d83-9539cf926200 tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.097s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:19:26 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f0244110-ba90-4feb-8d83-9539cf926200 tempest-VolumesSnapshotTestJSON-1532377660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20e956e0-90a1-44b7-b7c4-face94ec7357) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84ab4bff-e6ff-4d6a-be1e-80a4bf2663c9', 'volume_size': 1, 'snapshot_id': '4bee96cc-bc74-427f-8d85-a485ec29d329'}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:19:26 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f0244110-ba90-4feb-8d83-9539cf926200 tempest-VolumesSnapshotTestJSON-1532377660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (472adce0-d2bc-4c69-a475-7e8c5f3ec53f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:19:26 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-f0244110-ba90-4feb-8d83-9539cf926200 tempest-VolumesSnapshotTestJSON-1532377660 None] Volume volume-84ab4bff-e6ff-4d6a-be1e-80a4bf2663c9 (84ab4bff-e6ff-4d6a-be1e-80a4bf2663c9): created successfully Nov 04 12:19:26 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f0244110-ba90-4feb-8d83-9539cf926200 tempest-VolumesSnapshotTestJSON-1532377660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (472adce0-d2bc-4c69-a475-7e8c5f3ec53f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:19:26 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f0244110-ba90-4feb-8d83-9539cf926200 tempest-VolumesSnapshotTestJSON-1532377660 None] Flow 'volume_create_manager' (bc3e1f65-409e-4395-bfa3-5a25b857bfde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:19:26 devstack sudo[97577]: pam_unix(sudo:session): session closed for user root Nov 04 12:19:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c8a3e8d8-3b1c-4b94-a68e-9fd81f6e4e0a tempest-VolumesSnapshotListTestJSON-229292204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.392s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:19:26 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-c8a3e8d8-3b1c-4b94-a68e-9fd81f6e4e0a tempest-VolumesSnapshotListTestJSON-229292204 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:19:26 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-c8a3e8d8-3b1c-4b94-a68e-9fd81f6e4e0a tempest-VolumesSnapshotListTestJSON-229292204 None] Deleted volume successfully. Nov 04 12:19:26 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-f0244110-ba90-4feb-8d83-9539cf926200 tempest-VolumesSnapshotTestJSON-1532377660 None] Created volume successfully. Nov 04 12:19:27 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c8a3e8d8-3b1c-4b94-a68e-9fd81f6e4e0a tempest-VolumesSnapshotListTestJSON-229292204 None] Lock "cinder-d78e7673-199d-4f89-b206-71c5249ddf37-delete_volume" released by "delete_volume" :: held 3.261s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:19:27 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-50cde6f7-d8ab-4795-b20e-20a418c3cd19 tempest-VolumesSnapshotTestJSON-1532377660 None] Acquiring lock "cinder-84ab4bff-e6ff-4d6a-be1e-80a4bf2663c9-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:19:27 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-50cde6f7-d8ab-4795-b20e-20a418c3cd19 tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "cinder-84ab4bff-e6ff-4d6a-be1e-80a4bf2663c9-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:19:27 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-50cde6f7-d8ab-4795-b20e-20a418c3cd19 tempest-VolumesSnapshotTestJSON-1532377660 None] Acquiring lock "cinder-quobyte-84ab4bff-e6ff-4d6a-be1e-80a4bf2663c9" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:19:27 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-50cde6f7-d8ab-4795-b20e-20a418c3cd19 tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "cinder-quobyte-84ab4bff-e6ff-4d6a-be1e-80a4bf2663c9" acquired by "delete_volume" :: waited 0.023s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:19:27 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02face3-7728-49c8-8c0d-462c7e68d9c9]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:19:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-50cde6f7-d8ab-4795-b20e-20a418c3cd19 tempest-VolumesSnapshotTestJSON-1532377660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-84ab4bff-e6ff-4d6a-be1e-80a4bf2663c9 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:19:28 devstack sudo[97589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-84ab4bff-e6ff-4d6a-be1e-80a4bf2663c9 Nov 04 12:19:28 devstack sudo[97589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:19:28 devstack sudo[97589]: pam_unix(sudo:session): session closed for user root Nov 04 12:19:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-50cde6f7-d8ab-4795-b20e-20a418c3cd19 tempest-VolumesSnapshotTestJSON-1532377660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-84ab4bff-e6ff-4d6a-be1e-80a4bf2663c9" returned: 0 in 0.514s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:19:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-50cde6f7-d8ab-4795-b20e-20a418c3cd19 tempest-VolumesSnapshotTestJSON-1532377660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-84ab4bff-e6ff-4d6a-be1e-80a4bf2663c9 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:19:28 devstack sudo[97595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-84ab4bff-e6ff-4d6a-be1e-80a4bf2663c9 Nov 04 12:19:28 devstack sudo[97595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:19:28 devstack sudo[97595]: pam_unix(sudo:session): session closed for user root Nov 04 12:19:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-50cde6f7-d8ab-4795-b20e-20a418c3cd19 tempest-VolumesSnapshotTestJSON-1532377660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-84ab4bff-e6ff-4d6a-be1e-80a4bf2663c9" returned: 0 in 0.406s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:19:28 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-50cde6f7-d8ab-4795-b20e-20a418c3cd19 tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "cinder-quobyte-84ab4bff-e6ff-4d6a-be1e-80a4bf2663c9" released by "delete_volume" :: held 0.993s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:19:29 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-50cde6f7-d8ab-4795-b20e-20a418c3cd19 tempest-VolumesSnapshotTestJSON-1532377660 None] Created reservations ['baa4fc37-9fc7-49a8-a170-650368f8d0f4', 'f602379a-46d0-47e7-940a-5f9e94031016', 'f8551930-8e46-47a1-b110-7df39afa0bfb', 'b3790af9-bc6a-474b-bce6-775fb7b0956d'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:19:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-50cde6f7-d8ab-4795-b20e-20a418c3cd19 tempest-VolumesSnapshotTestJSON-1532377660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:19:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-50cde6f7-d8ab-4795-b20e-20a418c3cd19 tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:19:29 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-50cde6f7-d8ab-4795-b20e-20a418c3cd19 tempest-VolumesSnapshotTestJSON-1532377660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:19:29 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-50cde6f7-d8ab-4795-b20e-20a418c3cd19 tempest-VolumesSnapshotTestJSON-1532377660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:19:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-50cde6f7-d8ab-4795-b20e-20a418c3cd19 tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:19:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-50cde6f7-d8ab-4795-b20e-20a418c3cd19 tempest-VolumesSnapshotTestJSON-1532377660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:19:29 devstack sudo[97603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:19:29 devstack sudo[97603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:19:29 devstack sudo[97603]: pam_unix(sudo:session): session closed for user root Nov 04 12:19:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-50cde6f7-d8ab-4795-b20e-20a418c3cd19 tempest-VolumesSnapshotTestJSON-1532377660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.455s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:19:29 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-50cde6f7-d8ab-4795-b20e-20a418c3cd19 tempest-VolumesSnapshotTestJSON-1532377660 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:19:29 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-50cde6f7-d8ab-4795-b20e-20a418c3cd19 tempest-VolumesSnapshotTestJSON-1532377660 None] Deleted volume successfully. Nov 04 12:19:29 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-50cde6f7-d8ab-4795-b20e-20a418c3cd19 tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "cinder-84ab4bff-e6ff-4d6a-be1e-80a4bf2663c9-delete_volume" released by "delete_volume" :: held 1.877s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:19:30 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-40356b73-671c-4ae8-9ed5-59c559801d1c tempest-VolumesSnapshotTestJSON-1532377660 None] Acquiring lock "cinder-4bee96cc-bc74-427f-8d85-a485ec29d329-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:19:30 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-40356b73-671c-4ae8-9ed5-59c559801d1c tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "cinder-4bee96cc-bc74-427f-8d85-a485ec29d329-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:19:30 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-40356b73-671c-4ae8-9ed5-59c559801d1c tempest-VolumesSnapshotTestJSON-1532377660 None] Acquiring lock "cinder-quobyte-d4625301-baf5-4e79-aaab-51260b5b6b84" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:19:30 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-40356b73-671c-4ae8-9ed5-59c559801d1c tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "cinder-quobyte-d4625301-baf5-4e79-aaab-51260b5b6b84" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:19:30 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-40356b73-671c-4ae8-9ed5-59c559801d1c tempest-VolumesSnapshotTestJSON-1532377660 None] Acquiring lock "cinder-quobyte-4bee96cc-bc74-427f-8d85-a485ec29d329" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:19:30 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-40356b73-671c-4ae8-9ed5-59c559801d1c tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "cinder-quobyte-4bee96cc-bc74-427f-8d85-a485ec29d329" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:19:30 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-40356b73-671c-4ae8-9ed5-59c559801d1c tempest-VolumesSnapshotTestJSON-1532377660 None] Deleting offline snapshot 4bee96cc-bc74-427f-8d85-a485ec29d329 of volume d4625301-baf5-4e79-aaab-51260b5b6b84 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 12:19:30 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-40356b73-671c-4ae8-9ed5-59c559801d1c tempest-VolumesSnapshotTestJSON-1532377660 None] snapshot_file for this snap is: volume-d4625301-baf5-4e79-aaab-51260b5b6b84.4bee96cc-bc74-427f-8d85-a485ec29d329 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 12:19:30 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ec797a-3520-4e47-bd0e-2664eb2f851e]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:19:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-40356b73-671c-4ae8-9ed5-59c559801d1c tempest-VolumesSnapshotTestJSON-1532377660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d4625301-baf5-4e79-aaab-51260b5b6b84.4bee96cc-bc74-427f-8d85-a485ec29d329 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:19:30 devstack sudo[97610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d4625301-baf5-4e79-aaab-51260b5b6b84.4bee96cc-bc74-427f-8d85-a485ec29d329 Nov 04 12:19:30 devstack sudo[97610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:19:30 devstack sudo[97610]: pam_unix(sudo:session): session closed for user root Nov 04 12:19:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-40356b73-671c-4ae8-9ed5-59c559801d1c tempest-VolumesSnapshotTestJSON-1532377660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d4625301-baf5-4e79-aaab-51260b5b6b84.4bee96cc-bc74-427f-8d85-a485ec29d329" returned: 0 in 0.569s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:19:30 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-40356b73-671c-4ae8-9ed5-59c559801d1c tempest-VolumesSnapshotTestJSON-1532377660 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4625301-baf5-4e79-aaab-51260b5b6b84(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 12:19:31 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b63bb5e-a5f4-4989-9307-8dad7e192e21]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:19:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-40356b73-671c-4ae8-9ed5-59c559801d1c tempest-VolumesSnapshotTestJSON-1532377660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d4625301-baf5-4e79-aaab-51260b5b6b84 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:19:31 devstack sudo[97616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d4625301-baf5-4e79-aaab-51260b5b6b84 Nov 04 12:19:31 devstack sudo[97616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:19:31 devstack sudo[97616]: pam_unix(sudo:session): session closed for user root Nov 04 12:19:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-40356b73-671c-4ae8-9ed5-59c559801d1c tempest-VolumesSnapshotTestJSON-1532377660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d4625301-baf5-4e79-aaab-51260b5b6b84" returned: 0 in 0.678s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:19:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-40356b73-671c-4ae8-9ed5-59c559801d1c tempest-VolumesSnapshotTestJSON-1532377660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d4625301-baf5-4e79-aaab-51260b5b6b84.4bee96cc-bc74-427f-8d85-a485ec29d329 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:19:31 devstack sudo[97621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d4625301-baf5-4e79-aaab-51260b5b6b84.4bee96cc-bc74-427f-8d85-a485ec29d329 Nov 04 12:19:31 devstack sudo[97621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:19:32 devstack sudo[97621]: pam_unix(sudo:session): session closed for user root Nov 04 12:19:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-40356b73-671c-4ae8-9ed5-59c559801d1c tempest-VolumesSnapshotTestJSON-1532377660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d4625301-baf5-4e79-aaab-51260b5b6b84.4bee96cc-bc74-427f-8d85-a485ec29d329" returned: 0 in 0.481s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:19:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-40356b73-671c-4ae8-9ed5-59c559801d1c tempest-VolumesSnapshotTestJSON-1532377660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d4625301-baf5-4e79-aaab-51260b5b6b84.4bee96cc-bc74-427f-8d85-a485ec29d329 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:19:32 devstack sudo[97627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d4625301-baf5-4e79-aaab-51260b5b6b84.4bee96cc-bc74-427f-8d85-a485ec29d329 Nov 04 12:19:32 devstack sudo[97627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:19:32 devstack sudo[97627]: pam_unix(sudo:session): session closed for user root Nov 04 12:19:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-40356b73-671c-4ae8-9ed5-59c559801d1c tempest-VolumesSnapshotTestJSON-1532377660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d4625301-baf5-4e79-aaab-51260b5b6b84.4bee96cc-bc74-427f-8d85-a485ec29d329" returned: 0 in 0.380s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:19:32 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-40356b73-671c-4ae8-9ed5-59c559801d1c tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "cinder-quobyte-4bee96cc-bc74-427f-8d85-a485ec29d329" released by "_delete_snapshot" :: held 2.285s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:19:32 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-40356b73-671c-4ae8-9ed5-59c559801d1c tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "cinder-quobyte-d4625301-baf5-4e79-aaab-51260b5b6b84" released by "delete_snapshot" :: held 2.343s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:19:32 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-40356b73-671c-4ae8-9ed5-59c559801d1c tempest-VolumesSnapshotTestJSON-1532377660 None] Created reservations ['02ccf523-99ae-44c2-bda3-e069b91d0af2', '73c56e5f-e9df-402f-a272-c5698f718033', '965eda1f-67df-4cb8-b51c-f8c0f7754044', 'c9d40ded-d8ee-477a-9e95-32a0a178c378'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:19:32 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-40356b73-671c-4ae8-9ed5-59c559801d1c tempest-VolumesSnapshotTestJSON-1532377660 None] Delete snapshot completed successfully. Nov 04 12:19:32 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-40356b73-671c-4ae8-9ed5-59c559801d1c tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "cinder-4bee96cc-bc74-427f-8d85-a485ec29d329-delete_snapshot" released by "delete_snapshot" :: held 2.583s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:19:33 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f409ec64-8f35-4554-a2ee-82015b12ec9b tempest-VolumesSnapshotTestJSON-1532377660 None] Acquiring lock "cinder-d4625301-baf5-4e79-aaab-51260b5b6b84-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:19:33 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f409ec64-8f35-4554-a2ee-82015b12ec9b tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "cinder-d4625301-baf5-4e79-aaab-51260b5b6b84-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:19:33 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f409ec64-8f35-4554-a2ee-82015b12ec9b tempest-VolumesSnapshotTestJSON-1532377660 None] Acquiring lock "cinder-quobyte-d4625301-baf5-4e79-aaab-51260b5b6b84" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:19:33 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f409ec64-8f35-4554-a2ee-82015b12ec9b tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "cinder-quobyte-d4625301-baf5-4e79-aaab-51260b5b6b84" acquired by "delete_volume" :: waited 0.033s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:19:33 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f87f8b-b277-4ef1-a2b2-26a957992bbe]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:19:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f409ec64-8f35-4554-a2ee-82015b12ec9b tempest-VolumesSnapshotTestJSON-1532377660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d4625301-baf5-4e79-aaab-51260b5b6b84 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:19:34 devstack sudo[97631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d4625301-baf5-4e79-aaab-51260b5b6b84 Nov 04 12:19:34 devstack sudo[97631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:19:34 devstack sudo[97631]: pam_unix(sudo:session): session closed for user root Nov 04 12:19:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f409ec64-8f35-4554-a2ee-82015b12ec9b tempest-VolumesSnapshotTestJSON-1532377660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d4625301-baf5-4e79-aaab-51260b5b6b84" returned: 0 in 0.666s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:19:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f409ec64-8f35-4554-a2ee-82015b12ec9b tempest-VolumesSnapshotTestJSON-1532377660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d4625301-baf5-4e79-aaab-51260b5b6b84 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:19:34 devstack sudo[97653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d4625301-baf5-4e79-aaab-51260b5b6b84 Nov 04 12:19:34 devstack sudo[97653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:19:34 devstack sudo[97653]: pam_unix(sudo:session): session closed for user root Nov 04 12:19:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f409ec64-8f35-4554-a2ee-82015b12ec9b tempest-VolumesSnapshotTestJSON-1532377660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d4625301-baf5-4e79-aaab-51260b5b6b84" returned: 0 in 0.298s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:19:34 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f409ec64-8f35-4554-a2ee-82015b12ec9b tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "cinder-quobyte-d4625301-baf5-4e79-aaab-51260b5b6b84" released by "delete_volume" :: held 1.089s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:19:34 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-f409ec64-8f35-4554-a2ee-82015b12ec9b tempest-VolumesSnapshotTestJSON-1532377660 None] Created reservations ['d25750b9-b5d5-481b-b2ae-6e4f82ea7b33', 'ee1f9886-6c67-4f37-b4dc-9ab8c892dafc', 'ceddcacd-b4fd-4dde-b050-edc6e647f877', '83ce2cf8-7918-451b-b649-d3e3827fe41b'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:19:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f409ec64-8f35-4554-a2ee-82015b12ec9b tempest-VolumesSnapshotTestJSON-1532377660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:19:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f409ec64-8f35-4554-a2ee-82015b12ec9b tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:19:35 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f409ec64-8f35-4554-a2ee-82015b12ec9b tempest-VolumesSnapshotTestJSON-1532377660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:19:35 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f409ec64-8f35-4554-a2ee-82015b12ec9b tempest-VolumesSnapshotTestJSON-1532377660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:19:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f409ec64-8f35-4554-a2ee-82015b12ec9b tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:19:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f409ec64-8f35-4554-a2ee-82015b12ec9b tempest-VolumesSnapshotTestJSON-1532377660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:19:35 devstack sudo[97656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:19:35 devstack sudo[97656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:19:35 devstack sudo[97656]: pam_unix(sudo:session): session closed for user root Nov 04 12:19:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f409ec64-8f35-4554-a2ee-82015b12ec9b tempest-VolumesSnapshotTestJSON-1532377660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.310s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:19:35 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-f409ec64-8f35-4554-a2ee-82015b12ec9b tempest-VolumesSnapshotTestJSON-1532377660 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:19:35 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-f409ec64-8f35-4554-a2ee-82015b12ec9b tempest-VolumesSnapshotTestJSON-1532377660 None] Deleted volume successfully. Nov 04 12:19:35 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f409ec64-8f35-4554-a2ee-82015b12ec9b tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "cinder-d4625301-baf5-4e79-aaab-51260b5b6b84-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:19:35 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e5a7f50c-95c5-43ea-8bfb-9a686b0b0403 tempest-VolumesSnapshotTestJSON-1532377660 None] Acquiring lock "cinder-b6898661-3dfc-4c77-9704-fe90d557c7df-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:19:36 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e5a7f50c-95c5-43ea-8bfb-9a686b0b0403 tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "cinder-b6898661-3dfc-4c77-9704-fe90d557c7df-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:19:36 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e5a7f50c-95c5-43ea-8bfb-9a686b0b0403 tempest-VolumesSnapshotTestJSON-1532377660 None] Acquiring lock "cinder-quobyte-b6898661-3dfc-4c77-9704-fe90d557c7df" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:19:36 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e5a7f50c-95c5-43ea-8bfb-9a686b0b0403 tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "cinder-quobyte-b6898661-3dfc-4c77-9704-fe90d557c7df" acquired by "delete_volume" :: waited 0.015s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:19:36 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa245bfe-b812-41e8-8a38-5a2056cea90f]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:19:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e5a7f50c-95c5-43ea-8bfb-9a686b0b0403 tempest-VolumesSnapshotTestJSON-1532377660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b6898661-3dfc-4c77-9704-fe90d557c7df {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:19:36 devstack sudo[97660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b6898661-3dfc-4c77-9704-fe90d557c7df Nov 04 12:19:36 devstack sudo[97660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:19:36 devstack sudo[97660]: pam_unix(sudo:session): session closed for user root Nov 04 12:19:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e5a7f50c-95c5-43ea-8bfb-9a686b0b0403 tempest-VolumesSnapshotTestJSON-1532377660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b6898661-3dfc-4c77-9704-fe90d557c7df" returned: 0 in 0.418s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:19:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e5a7f50c-95c5-43ea-8bfb-9a686b0b0403 tempest-VolumesSnapshotTestJSON-1532377660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b6898661-3dfc-4c77-9704-fe90d557c7df {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:19:36 devstack sudo[97666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b6898661-3dfc-4c77-9704-fe90d557c7df Nov 04 12:19:36 devstack sudo[97666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:19:36 devstack sudo[97666]: pam_unix(sudo:session): session closed for user root Nov 04 12:19:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e5a7f50c-95c5-43ea-8bfb-9a686b0b0403 tempest-VolumesSnapshotTestJSON-1532377660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b6898661-3dfc-4c77-9704-fe90d557c7df" returned: 0 in 0.316s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:19:36 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e5a7f50c-95c5-43ea-8bfb-9a686b0b0403 tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "cinder-quobyte-b6898661-3dfc-4c77-9704-fe90d557c7df" released by "delete_volume" :: held 0.818s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:19:36 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-e5a7f50c-95c5-43ea-8bfb-9a686b0b0403 tempest-VolumesSnapshotTestJSON-1532377660 None] Created reservations ['d1886662-129c-4dc2-9828-65fc0498f986', '139a4f34-6ad5-418d-8a4c-095cc874b4b1', '669c2708-876a-49aa-89f2-d849f3636775', '78855834-07ca-4056-936d-20db0d76b9a6'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:19:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e5a7f50c-95c5-43ea-8bfb-9a686b0b0403 tempest-VolumesSnapshotTestJSON-1532377660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:19:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e5a7f50c-95c5-43ea-8bfb-9a686b0b0403 tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:19:37 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e5a7f50c-95c5-43ea-8bfb-9a686b0b0403 tempest-VolumesSnapshotTestJSON-1532377660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:19:37 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e5a7f50c-95c5-43ea-8bfb-9a686b0b0403 tempest-VolumesSnapshotTestJSON-1532377660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:19:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e5a7f50c-95c5-43ea-8bfb-9a686b0b0403 tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:19:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e5a7f50c-95c5-43ea-8bfb-9a686b0b0403 tempest-VolumesSnapshotTestJSON-1532377660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:19:37 devstack sudo[97669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:19:37 devstack sudo[97669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:19:37 devstack sudo[97669]: pam_unix(sudo:session): session closed for user root Nov 04 12:19:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e5a7f50c-95c5-43ea-8bfb-9a686b0b0403 tempest-VolumesSnapshotTestJSON-1532377660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.300s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:19:37 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-e5a7f50c-95c5-43ea-8bfb-9a686b0b0403 tempest-VolumesSnapshotTestJSON-1532377660 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:19:37 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-e5a7f50c-95c5-43ea-8bfb-9a686b0b0403 tempest-VolumesSnapshotTestJSON-1532377660 None] Deleted volume successfully. Nov 04 12:19:37 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e5a7f50c-95c5-43ea-8bfb-9a686b0b0403 tempest-VolumesSnapshotTestJSON-1532377660 None] Lock "cinder-b6898661-3dfc-4c77-9704-fe90d557c7df-delete_volume" released by "delete_volume" :: held 1.359s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:19:47 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=61,cinder:UPDATE=60,cinder:INSERT=17,cinder:DELETE=4 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 12:19:47 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=48,cinder:INSERT=22,cinder:UPDATE=79,cinder:DELETE=5 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 12:19:47 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bcb1fdf-7375-4998-9120-d2a0bd9f69c5 tempest-AttachVolumeTestJSON-1999482404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:19:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1bcb1fdf-7375-4998-9120-d2a0bd9f69c5 tempest-AttachVolumeTestJSON-1999482404 None] Flow 'volume_create_manager' (6dd6daac-96cb-4894-962d-67f2db2a470f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:19:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1bcb1fdf-7375-4998-9120-d2a0bd9f69c5 tempest-AttachVolumeTestJSON-1999482404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9064132a-1581-496d-8d37-922d9f1bb362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:19:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1bcb1fdf-7375-4998-9120-d2a0bd9f69c5 tempest-AttachVolumeTestJSON-1999482404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9064132a-1581-496d-8d37-922d9f1bb362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:19:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-837249780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd6988eb-b6bf-4631-bfe7-bc6a0056b1db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f3393a5a9324a1fa2a9e14272c58611',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:19:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:19:47Z,use_quota=True,user_id='d7257aa9cd244214bde6a8311299af7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:19:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1bcb1fdf-7375-4998-9120-d2a0bd9f69c5 tempest-AttachVolumeTestJSON-1999482404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (836d77f8-dfd8-48e5-9218-5cb6a0d9df37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:19:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1bcb1fdf-7375-4998-9120-d2a0bd9f69c5 tempest-AttachVolumeTestJSON-1999482404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (836d77f8-dfd8-48e5-9218-5cb6a0d9df37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:19:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1bcb1fdf-7375-4998-9120-d2a0bd9f69c5 tempest-AttachVolumeTestJSON-1999482404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0134a794-9779-4d0b-9a10-392c18e54bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:19:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1bcb1fdf-7375-4998-9120-d2a0bd9f69c5 tempest-AttachVolumeTestJSON-1999482404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0134a794-9779-4d0b-9a10-392c18e54bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd6988eb-b6bf-4631-bfe7-bc6a0056b1db', 'volume_name': 'volume-fd6988eb-b6bf-4631-bfe7-bc6a0056b1db', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:19:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1bcb1fdf-7375-4998-9120-d2a0bd9f69c5 tempest-AttachVolumeTestJSON-1999482404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97abf920-1649-434e-891b-7c63fc3632fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:19:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1bcb1fdf-7375-4998-9120-d2a0bd9f69c5 tempest-AttachVolumeTestJSON-1999482404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97abf920-1649-434e-891b-7c63fc3632fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:19:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1bcb1fdf-7375-4998-9120-d2a0bd9f69c5 tempest-AttachVolumeTestJSON-1999482404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecbc69af-74f2-4bd3-8305-1293ef1cbfc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:19:47 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-1bcb1fdf-7375-4998-9120-d2a0bd9f69c5 tempest-AttachVolumeTestJSON-1999482404 None] Volume fd6988eb-b6bf-4631-bfe7-bc6a0056b1db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd6988eb-b6bf-4631-bfe7-bc6a0056b1db', 'volume_size': 1} Nov 04 12:19:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1bcb1fdf-7375-4998-9120-d2a0bd9f69c5 tempest-AttachVolumeTestJSON-1999482404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:19:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1bcb1fdf-7375-4998-9120-d2a0bd9f69c5 tempest-AttachVolumeTestJSON-1999482404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:19:47 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1bcb1fdf-7375-4998-9120-d2a0bd9f69c5 tempest-AttachVolumeTestJSON-1999482404 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:19:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-837249780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd6988eb-b6bf-4631-bfe7-bc6a0056b1db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f3393a5a9324a1fa2a9e14272c58611',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:19:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:19:47Z,use_quota=True,user_id='d7257aa9cd244214bde6a8311299af7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:19:47 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-1bcb1fdf-7375-4998-9120-d2a0bd9f69c5 tempest-AttachVolumeTestJSON-1999482404 None] Creating volume fd6988eb-b6bf-4631-bfe7-bc6a0056b1db {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:19:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1bcb1fdf-7375-4998-9120-d2a0bd9f69c5 tempest-AttachVolumeTestJSON-1999482404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:19:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1bcb1fdf-7375-4998-9120-d2a0bd9f69c5 tempest-AttachVolumeTestJSON-1999482404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:19:47 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1bcb1fdf-7375-4998-9120-d2a0bd9f69c5 tempest-AttachVolumeTestJSON-1999482404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:19:47 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1bcb1fdf-7375-4998-9120-d2a0bd9f69c5 tempest-AttachVolumeTestJSON-1999482404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:19:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1bcb1fdf-7375-4998-9120-d2a0bd9f69c5 tempest-AttachVolumeTestJSON-1999482404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:19:47 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1bcb1fdf-7375-4998-9120-d2a0bd9f69c5 tempest-AttachVolumeTestJSON-1999482404 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:19:47 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-1bcb1fdf-7375-4998-9120-d2a0bd9f69c5 tempest-AttachVolumeTestJSON-1999482404 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:19:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1bcb1fdf-7375-4998-9120-d2a0bd9f69c5 tempest-AttachVolumeTestJSON-1999482404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fd6988eb-b6bf-4631-bfe7-bc6a0056b1db 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:19:47 devstack sudo[97676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fd6988eb-b6bf-4631-bfe7-bc6a0056b1db 1073741824 Nov 04 12:19:47 devstack sudo[97676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:19:48 devstack sudo[97676]: pam_unix(sudo:session): session closed for user root Nov 04 12:19:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1bcb1fdf-7375-4998-9120-d2a0bd9f69c5 tempest-AttachVolumeTestJSON-1999482404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fd6988eb-b6bf-4631-bfe7-bc6a0056b1db 1073741824" returned: 0 in 0.624s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:19:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1bcb1fdf-7375-4998-9120-d2a0bd9f69c5 tempest-AttachVolumeTestJSON-1999482404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fd6988eb-b6bf-4631-bfe7-bc6a0056b1db {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:19:48 devstack sudo[97682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fd6988eb-b6bf-4631-bfe7-bc6a0056b1db Nov 04 12:19:48 devstack sudo[97682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:19:48 devstack sudo[97682]: pam_unix(sudo:session): session closed for user root Nov 04 12:19:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1bcb1fdf-7375-4998-9120-d2a0bd9f69c5 tempest-AttachVolumeTestJSON-1999482404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fd6988eb-b6bf-4631-bfe7-bc6a0056b1db" returned: 0 in 0.362s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:19:48 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1bcb1fdf-7375-4998-9120-d2a0bd9f69c5 tempest-AttachVolumeTestJSON-1999482404 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:19:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1bcb1fdf-7375-4998-9120-d2a0bd9f69c5 tempest-AttachVolumeTestJSON-1999482404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:19:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1bcb1fdf-7375-4998-9120-d2a0bd9f69c5 tempest-AttachVolumeTestJSON-1999482404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecbc69af-74f2-4bd3-8305-1293ef1cbfc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd6988eb-b6bf-4631-bfe7-bc6a0056b1db', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:19:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1bcb1fdf-7375-4998-9120-d2a0bd9f69c5 tempest-AttachVolumeTestJSON-1999482404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (565d34e6-8d25-4159-a985-60a90cd79ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:19:48 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-1bcb1fdf-7375-4998-9120-d2a0bd9f69c5 tempest-AttachVolumeTestJSON-1999482404 None] Volume volume-fd6988eb-b6bf-4631-bfe7-bc6a0056b1db (fd6988eb-b6bf-4631-bfe7-bc6a0056b1db): created successfully Nov 04 12:19:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1bcb1fdf-7375-4998-9120-d2a0bd9f69c5 tempest-AttachVolumeTestJSON-1999482404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (565d34e6-8d25-4159-a985-60a90cd79ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:19:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1bcb1fdf-7375-4998-9120-d2a0bd9f69c5 tempest-AttachVolumeTestJSON-1999482404 None] Flow 'volume_create_manager' (6dd6daac-96cb-4894-962d-67f2db2a470f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:19:48 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-1bcb1fdf-7375-4998-9120-d2a0bd9f69c5 tempest-AttachVolumeTestJSON-1999482404 None] Created volume successfully. Nov 04 12:19:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-b9ea6d5f-a078-44d1-8868-87c7a36fd638 req-d816d482-4479-493c-b626-195f45ccb03a tempest-AttachVolumeTestJSON-1999482404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:19:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-b9ea6d5f-a078-44d1-8868-87c7a36fd638 req-d816d482-4479-493c-b626-195f45ccb03a tempest-AttachVolumeTestJSON-1999482404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:19:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-b9ea6d5f-a078-44d1-8868-87c7a36fd638 req-d816d482-4479-493c-b626-195f45ccb03a tempest-AttachVolumeTestJSON-1999482404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:19:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-b9ea6d5f-a078-44d1-8868-87c7a36fd638 req-d816d482-4479-493c-b626-195f45ccb03a tempest-AttachVolumeTestJSON-1999482404 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784', 'name': 'volume-fd6988eb-b6bf-4631-bfe7-bc6a0056b1db', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4325bc5f-fe99-4793-aec7-96eb555244bc', 'enforce_multipath': True} {{(pid=87095) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 12:19:50 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-b9ea6d5f-a078-44d1-8868-87c7a36fd638 req-d816d482-4479-493c-b626-195f45ccb03a tempest-AttachVolumeTestJSON-1999482404 None] attachment_update completed successfully. Nov 04 12:19:53 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-86724a7f-3073-441b-b568-abd1e5df77eb tempest-AttachVolumeTestJSON-1999482404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:19:53 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-86724a7f-3073-441b-b568-abd1e5df77eb tempest-AttachVolumeTestJSON-1999482404 None] Flow 'volume_create_manager' (05ed00fd-cba6-4173-b60f-0c34eccd92ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:19:53 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-86724a7f-3073-441b-b568-abd1e5df77eb tempest-AttachVolumeTestJSON-1999482404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad375e71-4766-460a-8ad6-ee7c23cecec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:19:53 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-86724a7f-3073-441b-b568-abd1e5df77eb tempest-AttachVolumeTestJSON-1999482404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad375e71-4766-460a-8ad6-ee7c23cecec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:19:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-646025509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9bac4d8-3f43-456c-9d7d-4fc48e4e199c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f3393a5a9324a1fa2a9e14272c58611',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:19:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:19:53Z,use_quota=True,user_id='d7257aa9cd244214bde6a8311299af7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:19:53 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-86724a7f-3073-441b-b568-abd1e5df77eb tempest-AttachVolumeTestJSON-1999482404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a95a95ab-b151-43dd-9abf-bc157b008a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:19:53 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-86724a7f-3073-441b-b568-abd1e5df77eb tempest-AttachVolumeTestJSON-1999482404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a95a95ab-b151-43dd-9abf-bc157b008a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:19:53 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-86724a7f-3073-441b-b568-abd1e5df77eb tempest-AttachVolumeTestJSON-1999482404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ad1cc0b-4a73-4ccd-bc05-e94d26c2a05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:19:53 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-86724a7f-3073-441b-b568-abd1e5df77eb tempest-AttachVolumeTestJSON-1999482404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ad1cc0b-4a73-4ccd-bc05-e94d26c2a05a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9bac4d8-3f43-456c-9d7d-4fc48e4e199c', 'volume_name': 'volume-c9bac4d8-3f43-456c-9d7d-4fc48e4e199c', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:19:53 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-86724a7f-3073-441b-b568-abd1e5df77eb tempest-AttachVolumeTestJSON-1999482404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b72eac79-d3ad-4115-adab-8955bb6ffc83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:19:53 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-86724a7f-3073-441b-b568-abd1e5df77eb tempest-AttachVolumeTestJSON-1999482404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b72eac79-d3ad-4115-adab-8955bb6ffc83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:19:53 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-86724a7f-3073-441b-b568-abd1e5df77eb tempest-AttachVolumeTestJSON-1999482404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34e525d8-c57e-4f7e-8479-fe41271bef30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:19:53 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-86724a7f-3073-441b-b568-abd1e5df77eb tempest-AttachVolumeTestJSON-1999482404 None] Volume c9bac4d8-3f43-456c-9d7d-4fc48e4e199c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9bac4d8-3f43-456c-9d7d-4fc48e4e199c', 'volume_size': 1} Nov 04 12:19:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-86724a7f-3073-441b-b568-abd1e5df77eb tempest-AttachVolumeTestJSON-1999482404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:19:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-86724a7f-3073-441b-b568-abd1e5df77eb tempest-AttachVolumeTestJSON-1999482404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:19:53 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-86724a7f-3073-441b-b568-abd1e5df77eb tempest-AttachVolumeTestJSON-1999482404 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:19:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-646025509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9bac4d8-3f43-456c-9d7d-4fc48e4e199c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f3393a5a9324a1fa2a9e14272c58611',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:19:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:19:53Z,use_quota=True,user_id='d7257aa9cd244214bde6a8311299af7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:19:53 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-86724a7f-3073-441b-b568-abd1e5df77eb tempest-AttachVolumeTestJSON-1999482404 None] Creating volume c9bac4d8-3f43-456c-9d7d-4fc48e4e199c {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:19:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-86724a7f-3073-441b-b568-abd1e5df77eb tempest-AttachVolumeTestJSON-1999482404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:19:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-86724a7f-3073-441b-b568-abd1e5df77eb tempest-AttachVolumeTestJSON-1999482404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:19:53 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-86724a7f-3073-441b-b568-abd1e5df77eb tempest-AttachVolumeTestJSON-1999482404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:19:53 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-86724a7f-3073-441b-b568-abd1e5df77eb tempest-AttachVolumeTestJSON-1999482404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:19:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-86724a7f-3073-441b-b568-abd1e5df77eb tempest-AttachVolumeTestJSON-1999482404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:19:53 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-86724a7f-3073-441b-b568-abd1e5df77eb tempest-AttachVolumeTestJSON-1999482404 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:19:53 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-86724a7f-3073-441b-b568-abd1e5df77eb tempest-AttachVolumeTestJSON-1999482404 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:19:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-86724a7f-3073-441b-b568-abd1e5df77eb tempest-AttachVolumeTestJSON-1999482404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c9bac4d8-3f43-456c-9d7d-4fc48e4e199c 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:19:53 devstack sudo[98113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c9bac4d8-3f43-456c-9d7d-4fc48e4e199c 1073741824 Nov 04 12:19:53 devstack sudo[98113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:19:53 devstack sudo[98113]: pam_unix(sudo:session): session closed for user root Nov 04 12:19:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-86724a7f-3073-441b-b568-abd1e5df77eb tempest-AttachVolumeTestJSON-1999482404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c9bac4d8-3f43-456c-9d7d-4fc48e4e199c 1073741824" returned: 0 in 0.550s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:19:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-86724a7f-3073-441b-b568-abd1e5df77eb tempest-AttachVolumeTestJSON-1999482404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c9bac4d8-3f43-456c-9d7d-4fc48e4e199c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:19:53 devstack sudo[98119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c9bac4d8-3f43-456c-9d7d-4fc48e4e199c Nov 04 12:19:53 devstack sudo[98119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:19:54 devstack sudo[98119]: pam_unix(sudo:session): session closed for user root Nov 04 12:19:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-86724a7f-3073-441b-b568-abd1e5df77eb tempest-AttachVolumeTestJSON-1999482404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c9bac4d8-3f43-456c-9d7d-4fc48e4e199c" returned: 0 in 0.317s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:19:54 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-86724a7f-3073-441b-b568-abd1e5df77eb tempest-AttachVolumeTestJSON-1999482404 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:19:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-86724a7f-3073-441b-b568-abd1e5df77eb tempest-AttachVolumeTestJSON-1999482404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:19:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-86724a7f-3073-441b-b568-abd1e5df77eb tempest-AttachVolumeTestJSON-1999482404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34e525d8-c57e-4f7e-8479-fe41271bef30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9bac4d8-3f43-456c-9d7d-4fc48e4e199c', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:19:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-86724a7f-3073-441b-b568-abd1e5df77eb tempest-AttachVolumeTestJSON-1999482404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebeefcec-2793-4a81-b01c-7b05d0dbc1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:19:54 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-86724a7f-3073-441b-b568-abd1e5df77eb tempest-AttachVolumeTestJSON-1999482404 None] Volume volume-c9bac4d8-3f43-456c-9d7d-4fc48e4e199c (c9bac4d8-3f43-456c-9d7d-4fc48e4e199c): created successfully Nov 04 12:19:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-86724a7f-3073-441b-b568-abd1e5df77eb tempest-AttachVolumeTestJSON-1999482404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebeefcec-2793-4a81-b01c-7b05d0dbc1bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:19:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-86724a7f-3073-441b-b568-abd1e5df77eb tempest-AttachVolumeTestJSON-1999482404 None] Flow 'volume_create_manager' (05ed00fd-cba6-4173-b60f-0c34eccd92ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:19:54 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-86724a7f-3073-441b-b568-abd1e5df77eb tempest-AttachVolumeTestJSON-1999482404 None] Created volume successfully. Nov 04 12:19:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-923bed92-d5ba-4305-ab71-87a8d69fab9f req-288500a7-e974-4a16-a126-16b26fcfc769 tempest-AttachVolumeTestJSON-1999482404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:19:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-923bed92-d5ba-4305-ab71-87a8d69fab9f req-288500a7-e974-4a16-a126-16b26fcfc769 tempest-AttachVolumeTestJSON-1999482404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:19:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-923bed92-d5ba-4305-ab71-87a8d69fab9f req-288500a7-e974-4a16-a126-16b26fcfc769 tempest-AttachVolumeTestJSON-1999482404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:19:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-923bed92-d5ba-4305-ab71-87a8d69fab9f req-288500a7-e974-4a16-a126-16b26fcfc769 tempest-AttachVolumeTestJSON-1999482404 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784', 'name': 'volume-c9bac4d8-3f43-456c-9d7d-4fc48e4e199c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0766ccfc-11e2-42ad-a1ed-9a52c8b5b89a', 'enforce_multipath': True} {{(pid=87095) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 12:19:56 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-923bed92-d5ba-4305-ab71-87a8d69fab9f req-288500a7-e974-4a16-a126-16b26fcfc769 tempest-AttachVolumeTestJSON-1999482404 None] attachment_update completed successfully. Nov 04 12:19:58 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-ac82ba58-704a-4259-ba37-243162f22a4d req-717273e2-6424-42f7-8902-c9076cdd34cc tempest-AttachVolumeTestJSON-1999482404 None] Terminate volume connection completed successfully. Nov 04 12:19:58 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-ac82ba58-704a-4259-ba37-243162f22a4d req-717273e2-6424-42f7-8902-c9076cdd34cc tempest-AttachVolumeTestJSON-1999482404 None] Deleting attachment 4325bc5f-fe99-4793-aec7-96eb555244bc. {{(pid=87095) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 12:20:00 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-184dc361-fb9b-4be6-991a-6327bdfaef23 req-9264d1b2-8db4-474b-9012-5eb5190b39c5 tempest-AttachVolumeTestJSON-1999482404 None] Terminate volume connection completed successfully. Nov 04 12:20:00 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-184dc361-fb9b-4be6-991a-6327bdfaef23 req-9264d1b2-8db4-474b-9012-5eb5190b39c5 tempest-AttachVolumeTestJSON-1999482404 None] Deleting attachment 0766ccfc-11e2-42ad-a1ed-9a52c8b5b89a. {{(pid=87095) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 12:20:01 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 12:20:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:20:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:20:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:20:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:20:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:20:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:20:01 devstack sudo[98172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:20:01 devstack sudo[98172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:20:02 devstack sudo[98172]: pam_unix(sudo:session): session closed for user root Nov 04 12:20:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.318s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:20:02 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:20:02 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Running periodic task VolumeManager._thread_info {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 12:20:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] thread count: 28 {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 12:20:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] thread info: [<_MainThread(MainThread, started 140610387472512)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 12:20:07 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d94db4e-fb9f-4c28-9ab7-7ea0ce03105c tempest-TestImageHashVerification-550995545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:20:07 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3d94db4e-fb9f-4c28-9ab7-7ea0ce03105c tempest-TestImageHashVerification-550995545 None] Flow 'volume_create_manager' (cdc9ebad-375a-4d7c-a991-1e412de8b9e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:20:07 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3d94db4e-fb9f-4c28-9ab7-7ea0ce03105c tempest-TestImageHashVerification-550995545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7014725-311b-4dae-a21b-3d9e2ec3dcc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:20:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3d94db4e-fb9f-4c28-9ab7-7ea0ce03105c tempest-TestImageHashVerification-550995545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7014725-311b-4dae-a21b-3d9e2ec3dcc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:20:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1278449791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee3dd2b8-5328-48e8-8ea0-2a399d7218b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='212ff5261d014e8997648f9eb1833760',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:20:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:20:08Z,use_quota=True,user_id='0db6d23df1a74fab87ce64d39075bf22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:20:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3d94db4e-fb9f-4c28-9ab7-7ea0ce03105c tempest-TestImageHashVerification-550995545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5433c726-8e86-424e-8717-aa066715667f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:20:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3d94db4e-fb9f-4c28-9ab7-7ea0ce03105c tempest-TestImageHashVerification-550995545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5433c726-8e86-424e-8717-aa066715667f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:20:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3d94db4e-fb9f-4c28-9ab7-7ea0ce03105c tempest-TestImageHashVerification-550995545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18364de2-81d0-4b31-ac24-9a4e72b0b179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:20:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3d94db4e-fb9f-4c28-9ab7-7ea0ce03105c tempest-TestImageHashVerification-550995545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18364de2-81d0-4b31-ac24-9a4e72b0b179) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee3dd2b8-5328-48e8-8ea0-2a399d7218b5', 'volume_name': 'volume-ee3dd2b8-5328-48e8-8ea0-2a399d7218b5', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:20:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3d94db4e-fb9f-4c28-9ab7-7ea0ce03105c tempest-TestImageHashVerification-550995545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37c854ea-7657-45b0-8e8e-ca4386c74457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:20:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3d94db4e-fb9f-4c28-9ab7-7ea0ce03105c tempest-TestImageHashVerification-550995545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37c854ea-7657-45b0-8e8e-ca4386c74457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:20:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3d94db4e-fb9f-4c28-9ab7-7ea0ce03105c tempest-TestImageHashVerification-550995545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3723d5f5-765f-42c4-91c8-c6ecfeb3537c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:20:08 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-3d94db4e-fb9f-4c28-9ab7-7ea0ce03105c tempest-TestImageHashVerification-550995545 None] Volume ee3dd2b8-5328-48e8-8ea0-2a399d7218b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee3dd2b8-5328-48e8-8ea0-2a399d7218b5', 'volume_size': 1} Nov 04 12:20:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d94db4e-fb9f-4c28-9ab7-7ea0ce03105c tempest-TestImageHashVerification-550995545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:20:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d94db4e-fb9f-4c28-9ab7-7ea0ce03105c tempest-TestImageHashVerification-550995545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:20:08 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3d94db4e-fb9f-4c28-9ab7-7ea0ce03105c tempest-TestImageHashVerification-550995545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:20:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1278449791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee3dd2b8-5328-48e8-8ea0-2a399d7218b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='212ff5261d014e8997648f9eb1833760',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:20:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:20:08Z,use_quota=True,user_id='0db6d23df1a74fab87ce64d39075bf22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:20:08 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-3d94db4e-fb9f-4c28-9ab7-7ea0ce03105c tempest-TestImageHashVerification-550995545 None] Creating volume ee3dd2b8-5328-48e8-8ea0-2a399d7218b5 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:20:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d94db4e-fb9f-4c28-9ab7-7ea0ce03105c tempest-TestImageHashVerification-550995545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:20:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d94db4e-fb9f-4c28-9ab7-7ea0ce03105c tempest-TestImageHashVerification-550995545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:20:08 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3d94db4e-fb9f-4c28-9ab7-7ea0ce03105c tempest-TestImageHashVerification-550995545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:20:08 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3d94db4e-fb9f-4c28-9ab7-7ea0ce03105c tempest-TestImageHashVerification-550995545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:20:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d94db4e-fb9f-4c28-9ab7-7ea0ce03105c tempest-TestImageHashVerification-550995545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:20:08 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3d94db4e-fb9f-4c28-9ab7-7ea0ce03105c tempest-TestImageHashVerification-550995545 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:20:08 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-3d94db4e-fb9f-4c28-9ab7-7ea0ce03105c tempest-TestImageHashVerification-550995545 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:20:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3d94db4e-fb9f-4c28-9ab7-7ea0ce03105c tempest-TestImageHashVerification-550995545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee3dd2b8-5328-48e8-8ea0-2a399d7218b5 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:20:08 devstack sudo[98200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee3dd2b8-5328-48e8-8ea0-2a399d7218b5 1073741824 Nov 04 12:20:08 devstack sudo[98200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:20:08 devstack sudo[98200]: pam_unix(sudo:session): session closed for user root Nov 04 12:20:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3d94db4e-fb9f-4c28-9ab7-7ea0ce03105c tempest-TestImageHashVerification-550995545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee3dd2b8-5328-48e8-8ea0-2a399d7218b5 1073741824" returned: 0 in 0.707s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:20:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3d94db4e-fb9f-4c28-9ab7-7ea0ce03105c tempest-TestImageHashVerification-550995545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee3dd2b8-5328-48e8-8ea0-2a399d7218b5 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:20:08 devstack sudo[98206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee3dd2b8-5328-48e8-8ea0-2a399d7218b5 Nov 04 12:20:08 devstack sudo[98206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:20:09 devstack sudo[98206]: pam_unix(sudo:session): session closed for user root Nov 04 12:20:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3d94db4e-fb9f-4c28-9ab7-7ea0ce03105c tempest-TestImageHashVerification-550995545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee3dd2b8-5328-48e8-8ea0-2a399d7218b5" returned: 0 in 0.439s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:20:09 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3d94db4e-fb9f-4c28-9ab7-7ea0ce03105c tempest-TestImageHashVerification-550995545 None] <== create_volume: return (1219ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:20:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d94db4e-fb9f-4c28-9ab7-7ea0ce03105c tempest-TestImageHashVerification-550995545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.223s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:20:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3d94db4e-fb9f-4c28-9ab7-7ea0ce03105c tempest-TestImageHashVerification-550995545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3723d5f5-765f-42c4-91c8-c6ecfeb3537c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee3dd2b8-5328-48e8-8ea0-2a399d7218b5', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:20:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3d94db4e-fb9f-4c28-9ab7-7ea0ce03105c tempest-TestImageHashVerification-550995545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d18e17af-0bec-4ab9-af11-d447309abfd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:20:09 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-3d94db4e-fb9f-4c28-9ab7-7ea0ce03105c tempest-TestImageHashVerification-550995545 None] Volume volume-ee3dd2b8-5328-48e8-8ea0-2a399d7218b5 (ee3dd2b8-5328-48e8-8ea0-2a399d7218b5): created successfully Nov 04 12:20:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3d94db4e-fb9f-4c28-9ab7-7ea0ce03105c tempest-TestImageHashVerification-550995545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d18e17af-0bec-4ab9-af11-d447309abfd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:20:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3d94db4e-fb9f-4c28-9ab7-7ea0ce03105c tempest-TestImageHashVerification-550995545 None] Flow 'volume_create_manager' (cdc9ebad-375a-4d7c-a991-1e412de8b9e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:20:09 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-3d94db4e-fb9f-4c28-9ab7-7ea0ce03105c tempest-TestImageHashVerification-550995545 None] Created volume successfully. Nov 04 12:20:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-fe68a0c7-23a7-4582-8282-bf08f2f0269b tempest-TestImageHashVerification-550995545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:20:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-fe68a0c7-23a7-4582-8282-bf08f2f0269b tempest-TestImageHashVerification-550995545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:20:11 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a90e0d94-1dd2-4180-bef1-bbbf42fe8233]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:20:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fe68a0c7-23a7-4582-8282-bf08f2f0269b tempest-TestImageHashVerification-550995545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee3dd2b8-5328-48e8-8ea0-2a399d7218b5 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:20:11 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-1e792581-a3d0-4049-a6d9-2892bb506b88 tempest-AttachVolumeTestJSON-1999482404 None] Acquiring lock "cinder-c9bac4d8-3f43-456c-9d7d-4fc48e4e199c-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:20:11 devstack sudo[98212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee3dd2b8-5328-48e8-8ea0-2a399d7218b5 Nov 04 12:20:11 devstack sudo[98212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:20:11 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-1e792581-a3d0-4049-a6d9-2892bb506b88 tempest-AttachVolumeTestJSON-1999482404 None] Lock "cinder-c9bac4d8-3f43-456c-9d7d-4fc48e4e199c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:20:11 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-1e792581-a3d0-4049-a6d9-2892bb506b88 tempest-AttachVolumeTestJSON-1999482404 None] Acquiring lock "cinder-quobyte-c9bac4d8-3f43-456c-9d7d-4fc48e4e199c" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:20:11 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-1e792581-a3d0-4049-a6d9-2892bb506b88 tempest-AttachVolumeTestJSON-1999482404 None] Lock "cinder-quobyte-c9bac4d8-3f43-456c-9d7d-4fc48e4e199c" acquired by "delete_volume" :: waited 0.032s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:20:11 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f591023-769d-4c8d-b556-31fce9e38fee]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:20:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1e792581-a3d0-4049-a6d9-2892bb506b88 tempest-AttachVolumeTestJSON-1999482404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c9bac4d8-3f43-456c-9d7d-4fc48e4e199c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:20:12 devstack sudo[98212]: pam_unix(sudo:session): session closed for user root Nov 04 12:20:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fe68a0c7-23a7-4582-8282-bf08f2f0269b tempest-TestImageHashVerification-550995545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee3dd2b8-5328-48e8-8ea0-2a399d7218b5" returned: 0 in 0.600s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:20:12 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2daac2ec-4ab4-4bc0-8864-e13195d83fb9]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:20:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fe68a0c7-23a7-4582-8282-bf08f2f0269b tempest-TestImageHashVerification-550995545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee3dd2b8-5328-48e8-8ea0-2a399d7218b5 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:20:12 devstack sudo[98214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c9bac4d8-3f43-456c-9d7d-4fc48e4e199c Nov 04 12:20:12 devstack sudo[98214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:20:12 devstack sudo[98218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee3dd2b8-5328-48e8-8ea0-2a399d7218b5 Nov 04 12:20:12 devstack sudo[98218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:20:12 devstack sudo[98214]: pam_unix(sudo:session): session closed for user root Nov 04 12:20:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1e792581-a3d0-4049-a6d9-2892bb506b88 tempest-AttachVolumeTestJSON-1999482404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c9bac4d8-3f43-456c-9d7d-4fc48e4e199c" returned: 0 in 0.711s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:20:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1e792581-a3d0-4049-a6d9-2892bb506b88 tempest-AttachVolumeTestJSON-1999482404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c9bac4d8-3f43-456c-9d7d-4fc48e4e199c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:20:12 devstack sudo[98224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c9bac4d8-3f43-456c-9d7d-4fc48e4e199c Nov 04 12:20:12 devstack sudo[98224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:20:13 devstack sudo[98218]: pam_unix(sudo:session): session closed for user root Nov 04 12:20:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fe68a0c7-23a7-4582-8282-bf08f2f0269b tempest-TestImageHashVerification-550995545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee3dd2b8-5328-48e8-8ea0-2a399d7218b5" returned: 0 in 0.791s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:20:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fe68a0c7-23a7-4582-8282-bf08f2f0269b tempest-TestImageHashVerification-550995545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee3dd2b8-5328-48e8-8ea0-2a399d7218b5 /opt/stack/data/cinder/conversion/ee3dd2b8-5328-48e8-8ea0-2a399d7218b5.temp_image.5643706d-0e32-4184-934c-682c7ae9a7e5j1g27eyc.img {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:20:13 devstack sudo[98231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee3dd2b8-5328-48e8-8ea0-2a399d7218b5 /opt/stack/data/cinder/conversion/ee3dd2b8-5328-48e8-8ea0-2a399d7218b5.temp_image.5643706d-0e32-4184-934c-682c7ae9a7e5j1g27eyc.img Nov 04 12:20:13 devstack sudo[98231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:20:13 devstack sudo[98224]: pam_unix(sudo:session): session closed for user root Nov 04 12:20:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1e792581-a3d0-4049-a6d9-2892bb506b88 tempest-AttachVolumeTestJSON-1999482404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c9bac4d8-3f43-456c-9d7d-4fc48e4e199c" returned: 0 in 0.481s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:20:13 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-1e792581-a3d0-4049-a6d9-2892bb506b88 tempest-AttachVolumeTestJSON-1999482404 None] Lock "cinder-quobyte-c9bac4d8-3f43-456c-9d7d-4fc48e4e199c" released by "delete_volume" :: held 1.305s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:20:13 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-1e792581-a3d0-4049-a6d9-2892bb506b88 tempest-AttachVolumeTestJSON-1999482404 None] Created reservations ['38a2a732-7500-450b-a119-231fa91e3cd4', '44ab5689-cc28-47e7-ab59-a3c6be2ef6d6', '62b7fc63-a31a-4b0a-9538-aabf9ddfb66e', 'b428e2bd-32d5-4a4e-8675-486438decce6'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:20:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1e792581-a3d0-4049-a6d9-2892bb506b88 tempest-AttachVolumeTestJSON-1999482404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:20:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1e792581-a3d0-4049-a6d9-2892bb506b88 tempest-AttachVolumeTestJSON-1999482404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:20:13 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1e792581-a3d0-4049-a6d9-2892bb506b88 tempest-AttachVolumeTestJSON-1999482404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:20:13 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1e792581-a3d0-4049-a6d9-2892bb506b88 tempest-AttachVolumeTestJSON-1999482404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:20:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1e792581-a3d0-4049-a6d9-2892bb506b88 tempest-AttachVolumeTestJSON-1999482404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:20:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1e792581-a3d0-4049-a6d9-2892bb506b88 tempest-AttachVolumeTestJSON-1999482404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:20:13 devstack sudo[98250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:20:13 devstack sudo[98250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:20:14 devstack sudo[98250]: pam_unix(sudo:session): session closed for user root Nov 04 12:20:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1e792581-a3d0-4049-a6d9-2892bb506b88 tempest-AttachVolumeTestJSON-1999482404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.638s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:20:14 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-1e792581-a3d0-4049-a6d9-2892bb506b88 tempest-AttachVolumeTestJSON-1999482404 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:20:14 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-1e792581-a3d0-4049-a6d9-2892bb506b88 tempest-AttachVolumeTestJSON-1999482404 None] Deleted volume successfully. Nov 04 12:20:14 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6dd194b2-084f-4902-8d28-81fb0cbd85e2 tempest-AttachVolumeTestJSON-1999482404 None] Acquiring lock "cinder-fd6988eb-b6bf-4631-bfe7-bc6a0056b1db-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:20:14 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-1e792581-a3d0-4049-a6d9-2892bb506b88 tempest-AttachVolumeTestJSON-1999482404 None] Lock "cinder-c9bac4d8-3f43-456c-9d7d-4fc48e4e199c-delete_volume" released by "delete_volume" :: held 2.497s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:20:14 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6dd194b2-084f-4902-8d28-81fb0cbd85e2 tempest-AttachVolumeTestJSON-1999482404 None] Lock "cinder-fd6988eb-b6bf-4631-bfe7-bc6a0056b1db-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:20:14 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6dd194b2-084f-4902-8d28-81fb0cbd85e2 tempest-AttachVolumeTestJSON-1999482404 None] Acquiring lock "cinder-quobyte-fd6988eb-b6bf-4631-bfe7-bc6a0056b1db" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:20:14 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6dd194b2-084f-4902-8d28-81fb0cbd85e2 tempest-AttachVolumeTestJSON-1999482404 None] Lock "cinder-quobyte-fd6988eb-b6bf-4631-bfe7-bc6a0056b1db" acquired by "delete_volume" :: waited 0.039s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:20:14 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee04fcfa-4fe6-4d8d-a098-36f3ef0aa46f]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:20:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6dd194b2-084f-4902-8d28-81fb0cbd85e2 tempest-AttachVolumeTestJSON-1999482404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fd6988eb-b6bf-4631-bfe7-bc6a0056b1db {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:20:14 devstack sudo[98268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fd6988eb-b6bf-4631-bfe7-bc6a0056b1db Nov 04 12:20:14 devstack sudo[98268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:20:15 devstack sudo[98268]: pam_unix(sudo:session): session closed for user root Nov 04 12:20:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6dd194b2-084f-4902-8d28-81fb0cbd85e2 tempest-AttachVolumeTestJSON-1999482404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fd6988eb-b6bf-4631-bfe7-bc6a0056b1db" returned: 0 in 1.105s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:20:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6dd194b2-084f-4902-8d28-81fb0cbd85e2 tempest-AttachVolumeTestJSON-1999482404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fd6988eb-b6bf-4631-bfe7-bc6a0056b1db {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:20:15 devstack sudo[98286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fd6988eb-b6bf-4631-bfe7-bc6a0056b1db Nov 04 12:20:15 devstack sudo[98286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:20:16 devstack sudo[98286]: pam_unix(sudo:session): session closed for user root Nov 04 12:20:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6dd194b2-084f-4902-8d28-81fb0cbd85e2 tempest-AttachVolumeTestJSON-1999482404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fd6988eb-b6bf-4631-bfe7-bc6a0056b1db" returned: 0 in 0.818s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:20:16 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6dd194b2-084f-4902-8d28-81fb0cbd85e2 tempest-AttachVolumeTestJSON-1999482404 None] Lock "cinder-quobyte-fd6988eb-b6bf-4631-bfe7-bc6a0056b1db" released by "delete_volume" :: held 2.048s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:20:16 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-6dd194b2-084f-4902-8d28-81fb0cbd85e2 tempest-AttachVolumeTestJSON-1999482404 None] Created reservations ['f7047829-5565-47af-a9f4-c9974c6fc772', '11189b75-4b59-495a-8a7d-45432180bb83', 'a071f4a8-b315-4ab9-a5fc-12072e36bc0f', 'a2c13933-d25e-4df1-b57b-87aefbf6b569'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:20:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6dd194b2-084f-4902-8d28-81fb0cbd85e2 tempest-AttachVolumeTestJSON-1999482404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:20:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6dd194b2-084f-4902-8d28-81fb0cbd85e2 tempest-AttachVolumeTestJSON-1999482404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:20:16 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6dd194b2-084f-4902-8d28-81fb0cbd85e2 tempest-AttachVolumeTestJSON-1999482404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:20:16 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6dd194b2-084f-4902-8d28-81fb0cbd85e2 tempest-AttachVolumeTestJSON-1999482404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:20:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6dd194b2-084f-4902-8d28-81fb0cbd85e2 tempest-AttachVolumeTestJSON-1999482404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:20:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6dd194b2-084f-4902-8d28-81fb0cbd85e2 tempest-AttachVolumeTestJSON-1999482404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:20:16 devstack sudo[98289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:20:16 devstack sudo[98289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:20:17 devstack sudo[98289]: pam_unix(sudo:session): session closed for user root Nov 04 12:20:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6dd194b2-084f-4902-8d28-81fb0cbd85e2 tempest-AttachVolumeTestJSON-1999482404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.689s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:20:17 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-6dd194b2-084f-4902-8d28-81fb0cbd85e2 tempest-AttachVolumeTestJSON-1999482404 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:20:17 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-6dd194b2-084f-4902-8d28-81fb0cbd85e2 tempest-AttachVolumeTestJSON-1999482404 None] Deleted volume successfully. Nov 04 12:20:17 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6dd194b2-084f-4902-8d28-81fb0cbd85e2 tempest-AttachVolumeTestJSON-1999482404 None] Lock "cinder-fd6988eb-b6bf-4631-bfe7-bc6a0056b1db-delete_volume" released by "delete_volume" :: held 3.237s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:20:18 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-49866b0f-90b2-4585-b835-e6eedf50dc5c tempest-AttachVolumeTestJSON-1999482404 None] Acquiring lock "cinder-f0ac70db-2a5a-4ad1-a80f-1ae58516ccd5-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:20:18 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-49866b0f-90b2-4585-b835-e6eedf50dc5c tempest-AttachVolumeTestJSON-1999482404 None] Lock "cinder-f0ac70db-2a5a-4ad1-a80f-1ae58516ccd5-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:20:18 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-49866b0f-90b2-4585-b835-e6eedf50dc5c tempest-AttachVolumeTestJSON-1999482404 None] Acquiring lock "cinder-quobyte-f0ac70db-2a5a-4ad1-a80f-1ae58516ccd5" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:20:18 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-49866b0f-90b2-4585-b835-e6eedf50dc5c tempest-AttachVolumeTestJSON-1999482404 None] Lock "cinder-quobyte-f0ac70db-2a5a-4ad1-a80f-1ae58516ccd5" acquired by "delete_volume" :: waited 0.032s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:20:18 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[74331f86-323d-4278-9d23-1ff1c0703d0d]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:20:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-49866b0f-90b2-4585-b835-e6eedf50dc5c tempest-AttachVolumeTestJSON-1999482404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f0ac70db-2a5a-4ad1-a80f-1ae58516ccd5 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:20:19 devstack sudo[98295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f0ac70db-2a5a-4ad1-a80f-1ae58516ccd5 Nov 04 12:20:19 devstack sudo[98295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:20:20 devstack sudo[98295]: pam_unix(sudo:session): session closed for user root Nov 04 12:20:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-49866b0f-90b2-4585-b835-e6eedf50dc5c tempest-AttachVolumeTestJSON-1999482404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f0ac70db-2a5a-4ad1-a80f-1ae58516ccd5" returned: 0 in 1.218s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:20:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-49866b0f-90b2-4585-b835-e6eedf50dc5c tempest-AttachVolumeTestJSON-1999482404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f0ac70db-2a5a-4ad1-a80f-1ae58516ccd5 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:20:20 devstack sudo[98354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f0ac70db-2a5a-4ad1-a80f-1ae58516ccd5 Nov 04 12:20:20 devstack sudo[98354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:20:20 devstack sudo[98354]: pam_unix(sudo:session): session closed for user root Nov 04 12:20:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-49866b0f-90b2-4585-b835-e6eedf50dc5c tempest-AttachVolumeTestJSON-1999482404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f0ac70db-2a5a-4ad1-a80f-1ae58516ccd5" returned: 0 in 0.900s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:20:20 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-49866b0f-90b2-4585-b835-e6eedf50dc5c tempest-AttachVolumeTestJSON-1999482404 None] Lock "cinder-quobyte-f0ac70db-2a5a-4ad1-a80f-1ae58516ccd5" released by "delete_volume" :: held 2.252s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:20:21 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-49866b0f-90b2-4585-b835-e6eedf50dc5c tempest-AttachVolumeTestJSON-1999482404 None] Created reservations ['89fb16a9-feec-40c6-917a-e11ab3794d5c', '5cc2fae5-4030-4ae9-a0d9-3970ae01decd', 'c940f198-a655-43f9-92f0-e3aefafd6156', '858a0ad6-8d19-4826-b107-8f0968e63d6e'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:20:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-49866b0f-90b2-4585-b835-e6eedf50dc5c tempest-AttachVolumeTestJSON-1999482404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:20:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-49866b0f-90b2-4585-b835-e6eedf50dc5c tempest-AttachVolumeTestJSON-1999482404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:20:21 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-49866b0f-90b2-4585-b835-e6eedf50dc5c tempest-AttachVolumeTestJSON-1999482404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:20:21 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-49866b0f-90b2-4585-b835-e6eedf50dc5c tempest-AttachVolumeTestJSON-1999482404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:20:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-49866b0f-90b2-4585-b835-e6eedf50dc5c tempest-AttachVolumeTestJSON-1999482404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:20:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-49866b0f-90b2-4585-b835-e6eedf50dc5c tempest-AttachVolumeTestJSON-1999482404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:20:21 devstack sudo[98372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:20:21 devstack sudo[98372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:20:22 devstack sudo[98372]: pam_unix(sudo:session): session closed for user root Nov 04 12:20:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-49866b0f-90b2-4585-b835-e6eedf50dc5c tempest-AttachVolumeTestJSON-1999482404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.628s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:20:22 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-49866b0f-90b2-4585-b835-e6eedf50dc5c tempest-AttachVolumeTestJSON-1999482404 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:20:22 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-49866b0f-90b2-4585-b835-e6eedf50dc5c tempest-AttachVolumeTestJSON-1999482404 None] Deleted volume successfully. Nov 04 12:20:22 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-49866b0f-90b2-4585-b835-e6eedf50dc5c tempest-AttachVolumeTestJSON-1999482404 None] Lock "cinder-f0ac70db-2a5a-4ad1-a80f-1ae58516ccd5-delete_volume" released by "delete_volume" :: held 3.580s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:20:24 devstack sudo[98231]: pam_unix(sudo:session): session closed for user root Nov 04 12:20:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fe68a0c7-23a7-4582-8282-bf08f2f0269b tempest-TestImageHashVerification-550995545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee3dd2b8-5328-48e8-8ea0-2a399d7218b5 /opt/stack/data/cinder/conversion/ee3dd2b8-5328-48e8-8ea0-2a399d7218b5.temp_image.5643706d-0e32-4184-934c-682c7ae9a7e5j1g27eyc.img" returned: 0 in 11.986s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:20:25 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[7403464a-73b2-4c3c-9d70-f9971f9dd395]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:20:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fe68a0c7-23a7-4582-8282-bf08f2f0269b tempest-TestImageHashVerification-550995545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee3dd2b8-5328-48e8-8ea0-2a399d7218b5 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:20:25 devstack sudo[98411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee3dd2b8-5328-48e8-8ea0-2a399d7218b5 Nov 04 12:20:25 devstack sudo[98411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:20:25 devstack sudo[98411]: pam_unix(sudo:session): session closed for user root Nov 04 12:20:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fe68a0c7-23a7-4582-8282-bf08f2f0269b tempest-TestImageHashVerification-550995545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee3dd2b8-5328-48e8-8ea0-2a399d7218b5" returned: 0 in 0.815s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:20:25 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-fe68a0c7-23a7-4582-8282-bf08f2f0269b tempest-TestImageHashVerification-550995545 None] Image conversion details: src /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee3dd2b8-5328-48e8-8ea0-2a399d7218b5, size 1024.00 MB, duration 11.99 sec, destination /opt/stack/data/cinder/conversion/ee3dd2b8-5328-48e8-8ea0-2a399d7218b5.temp_image.5643706d-0e32-4184-934c-682c7ae9a7e5j1g27eyc.img {{(pid=87095) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 12:20:25 devstack cinder-volume[87095]: INFO cinder.image.image_utils [None req-fe68a0c7-23a7-4582-8282-bf08f2f0269b tempest-TestImageHashVerification-550995545 None] Converted 1024.00 MB image at 85.42 MB/s Nov 04 12:20:25 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-fe68a0c7-23a7-4582-8282-bf08f2f0269b tempest-TestImageHashVerification-550995545 None] 5643706d-0e32-4184-934c-682c7ae9a7e5 was raw, no need to convert to raw {{(pid=87095) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 04 12:20:32 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=35,cinder:UPDATE=33,cinder:DELETE=2,cinder:INSERT=8 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 12:20:34 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-23af7676-5615-4947-8bde-e247e7601ad2 tempest-TestMinimumBasicScenario-957363426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:20:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-23af7676-5615-4947-8bde-e247e7601ad2 tempest-TestMinimumBasicScenario-957363426 None] Flow 'volume_create_manager' (1b9531ed-4f9a-418c-976c-13b79b567607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:20:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-23af7676-5615-4947-8bde-e247e7601ad2 tempest-TestMinimumBasicScenario-957363426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2002afe8-abfe-4d7f-8381-2a8c856274ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:20:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-23af7676-5615-4947-8bde-e247e7601ad2 tempest-TestMinimumBasicScenario-957363426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2002afe8-abfe-4d7f-8381-2a8c856274ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:20:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1742365169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcacd0c9-1bb9-40c6-9e09-a7a4b4b1d2e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84b141f8052e43d990e7b0c1f2462c2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:20:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:20:35Z,use_quota=True,user_id='4cf51013de9643218f8e4087d514a0a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:20:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-23af7676-5615-4947-8bde-e247e7601ad2 tempest-TestMinimumBasicScenario-957363426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (293c5a4e-d867-4119-9c70-1ade15388b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:20:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-23af7676-5615-4947-8bde-e247e7601ad2 tempest-TestMinimumBasicScenario-957363426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (293c5a4e-d867-4119-9c70-1ade15388b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:20:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-23af7676-5615-4947-8bde-e247e7601ad2 tempest-TestMinimumBasicScenario-957363426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84757160-bd39-4a1c-bcd9-b257e83e5e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:20:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-23af7676-5615-4947-8bde-e247e7601ad2 tempest-TestMinimumBasicScenario-957363426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84757160-bd39-4a1c-bcd9-b257e83e5e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcacd0c9-1bb9-40c6-9e09-a7a4b4b1d2e3', 'volume_name': 'volume-fcacd0c9-1bb9-40c6-9e09-a7a4b4b1d2e3', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:20:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-23af7676-5615-4947-8bde-e247e7601ad2 tempest-TestMinimumBasicScenario-957363426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ee40f1c-94b7-4c2a-bc23-39434dbf968e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:20:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-23af7676-5615-4947-8bde-e247e7601ad2 tempest-TestMinimumBasicScenario-957363426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ee40f1c-94b7-4c2a-bc23-39434dbf968e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:20:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-23af7676-5615-4947-8bde-e247e7601ad2 tempest-TestMinimumBasicScenario-957363426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ecab2c1-0aa8-4123-8c3a-7eca9f18a371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:20:34 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-23af7676-5615-4947-8bde-e247e7601ad2 tempest-TestMinimumBasicScenario-957363426 None] Volume fcacd0c9-1bb9-40c6-9e09-a7a4b4b1d2e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcacd0c9-1bb9-40c6-9e09-a7a4b4b1d2e3', 'volume_size': 1} Nov 04 12:20:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-23af7676-5615-4947-8bde-e247e7601ad2 tempest-TestMinimumBasicScenario-957363426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:20:35 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=40,cinder:UPDATE=39,cinder:INSERT=7,cinder:DELETE=4 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 12:20:39 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-70b30e26-e718-4070-852e-dc451711ec9f tempest-TestServerVolumeAttachmentScenario-1482419918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:20:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-70b30e26-e718-4070-852e-dc451711ec9f tempest-TestServerVolumeAttachmentScenario-1482419918 None] Flow 'volume_create_manager' (b759a4f2-d997-45ea-bf97-71886590e531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:20:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-70b30e26-e718-4070-852e-dc451711ec9f tempest-TestServerVolumeAttachmentScenario-1482419918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c41fa715-8fd1-4f99-acb8-8fae9935d76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:20:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-70b30e26-e718-4070-852e-dc451711ec9f tempest-TestServerVolumeAttachmentScenario-1482419918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c41fa715-8fd1-4f99-acb8-8fae9935d76f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:20:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-5557471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61ff6aaa-db42-460a-82c3-bd7fcea735c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bde1cfeca7548c6a6f6f8c8ddb3a3ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:20:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:20:39Z,use_quota=True,user_id='aaff3c35ce4444618af60fbae0b5323d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:20:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-70b30e26-e718-4070-852e-dc451711ec9f tempest-TestServerVolumeAttachmentScenario-1482419918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f390743-5f5c-4c46-8d70-dee62c7c4a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:20:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-70b30e26-e718-4070-852e-dc451711ec9f tempest-TestServerVolumeAttachmentScenario-1482419918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f390743-5f5c-4c46-8d70-dee62c7c4a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:20:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-70b30e26-e718-4070-852e-dc451711ec9f tempest-TestServerVolumeAttachmentScenario-1482419918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c19d0f75-6164-4cea-9f58-06edf6f1690e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:20:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-70b30e26-e718-4070-852e-dc451711ec9f tempest-TestServerVolumeAttachmentScenario-1482419918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c19d0f75-6164-4cea-9f58-06edf6f1690e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61ff6aaa-db42-460a-82c3-bd7fcea735c0', 'volume_name': 'volume-61ff6aaa-db42-460a-82c3-bd7fcea735c0', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:20:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-70b30e26-e718-4070-852e-dc451711ec9f tempest-TestServerVolumeAttachmentScenario-1482419918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cb9aaa5-7a57-44e2-8385-0eac6aaec717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:20:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-70b30e26-e718-4070-852e-dc451711ec9f tempest-TestServerVolumeAttachmentScenario-1482419918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cb9aaa5-7a57-44e2-8385-0eac6aaec717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:20:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-70b30e26-e718-4070-852e-dc451711ec9f tempest-TestServerVolumeAttachmentScenario-1482419918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7260f6d6-f2ec-4ad9-84e9-470570b0223e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:20:39 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-70b30e26-e718-4070-852e-dc451711ec9f tempest-TestServerVolumeAttachmentScenario-1482419918 None] Volume 61ff6aaa-db42-460a-82c3-bd7fcea735c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61ff6aaa-db42-460a-82c3-bd7fcea735c0', 'volume_size': 1} Nov 04 12:20:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-70b30e26-e718-4070-852e-dc451711ec9f tempest-TestServerVolumeAttachmentScenario-1482419918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:20:39 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-222df17e-02ed-42af-aa73-dea716631be2 tempest-TestServerVolumeAttachmentScenario-1482419918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:20:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-222df17e-02ed-42af-aa73-dea716631be2 tempest-TestServerVolumeAttachmentScenario-1482419918 None] Flow 'volume_create_manager' (9d62405b-d750-4a55-98dd-d4c5a8bf14e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:20:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-222df17e-02ed-42af-aa73-dea716631be2 tempest-TestServerVolumeAttachmentScenario-1482419918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba06572a-9e0c-4526-8398-bc92e5e6152d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:20:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-222df17e-02ed-42af-aa73-dea716631be2 tempest-TestServerVolumeAttachmentScenario-1482419918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba06572a-9e0c-4526-8398-bc92e5e6152d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:20:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1946628937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86e799c0-2c6e-41f6-8f50-7c82b64a9f57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bde1cfeca7548c6a6f6f8c8ddb3a3ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:20:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:20:40Z,use_quota=True,user_id='aaff3c35ce4444618af60fbae0b5323d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:20:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-222df17e-02ed-42af-aa73-dea716631be2 tempest-TestServerVolumeAttachmentScenario-1482419918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdbc9200-e5dc-45f9-826d-c585fbd20151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:20:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-222df17e-02ed-42af-aa73-dea716631be2 tempest-TestServerVolumeAttachmentScenario-1482419918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdbc9200-e5dc-45f9-826d-c585fbd20151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:20:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-222df17e-02ed-42af-aa73-dea716631be2 tempest-TestServerVolumeAttachmentScenario-1482419918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c464a665-c21e-4901-b702-51bedffbf37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:20:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-222df17e-02ed-42af-aa73-dea716631be2 tempest-TestServerVolumeAttachmentScenario-1482419918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c464a665-c21e-4901-b702-51bedffbf37d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86e799c0-2c6e-41f6-8f50-7c82b64a9f57', 'volume_name': 'volume-86e799c0-2c6e-41f6-8f50-7c82b64a9f57', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:20:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-222df17e-02ed-42af-aa73-dea716631be2 tempest-TestServerVolumeAttachmentScenario-1482419918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7613f91-0721-4daf-b990-c9e80690615f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:20:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-222df17e-02ed-42af-aa73-dea716631be2 tempest-TestServerVolumeAttachmentScenario-1482419918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7613f91-0721-4daf-b990-c9e80690615f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:20:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-222df17e-02ed-42af-aa73-dea716631be2 tempest-TestServerVolumeAttachmentScenario-1482419918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1457fac4-74e5-4595-a128-952ac1ab1bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:20:39 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-222df17e-02ed-42af-aa73-dea716631be2 tempest-TestServerVolumeAttachmentScenario-1482419918 None] Volume 86e799c0-2c6e-41f6-8f50-7c82b64a9f57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86e799c0-2c6e-41f6-8f50-7c82b64a9f57', 'volume_size': 1} Nov 04 12:20:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-222df17e-02ed-42af-aa73-dea716631be2 tempest-TestServerVolumeAttachmentScenario-1482419918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:20:49 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 12:20:49 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 12:20:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-fe68a0c7-23a7-4582-8282-bf08f2f0269b tempest-TestImageHashVerification-550995545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 46.909s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:20:58 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-fe68a0c7-23a7-4582-8282-bf08f2f0269b tempest-TestImageHashVerification-550995545 None] Uploaded volume to glance image-id: 5643706d-0e32-4184-934c-682c7ae9a7e5. {{(pid=87095) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 04 12:20:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-23af7676-5615-4947-8bde-e247e7601ad2 tempest-TestMinimumBasicScenario-957363426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 23.600s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:20:58 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-23af7676-5615-4947-8bde-e247e7601ad2 tempest-TestMinimumBasicScenario-957363426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:20:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1742365169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcacd0c9-1bb9-40c6-9e09-a7a4b4b1d2e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84b141f8052e43d990e7b0c1f2462c2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:20:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:20:35Z,use_quota=True,user_id='4cf51013de9643218f8e4087d514a0a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:20:58 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-23af7676-5615-4947-8bde-e247e7601ad2 tempest-TestMinimumBasicScenario-957363426 None] Creating volume fcacd0c9-1bb9-40c6-9e09-a7a4b4b1d2e3 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:20:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-23af7676-5615-4947-8bde-e247e7601ad2 tempest-TestMinimumBasicScenario-957363426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:20:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-23af7676-5615-4947-8bde-e247e7601ad2 tempest-TestMinimumBasicScenario-957363426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:20:58 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-23af7676-5615-4947-8bde-e247e7601ad2 tempest-TestMinimumBasicScenario-957363426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:20:58 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-23af7676-5615-4947-8bde-e247e7601ad2 tempest-TestMinimumBasicScenario-957363426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:20:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-23af7676-5615-4947-8bde-e247e7601ad2 tempest-TestMinimumBasicScenario-957363426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:20:58 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-23af7676-5615-4947-8bde-e247e7601ad2 tempest-TestMinimumBasicScenario-957363426 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:20:58 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-23af7676-5615-4947-8bde-e247e7601ad2 tempest-TestMinimumBasicScenario-957363426 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:20:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-23af7676-5615-4947-8bde-e247e7601ad2 tempest-TestMinimumBasicScenario-957363426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fcacd0c9-1bb9-40c6-9e09-a7a4b4b1d2e3 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:20:58 devstack sudo[98548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fcacd0c9-1bb9-40c6-9e09-a7a4b4b1d2e3 1073741824 Nov 04 12:20:58 devstack sudo[98548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:20:58 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-fe68a0c7-23a7-4582-8282-bf08f2f0269b tempest-TestImageHashVerification-550995545 None] Copy volume to image completed successfully. Nov 04 12:20:59 devstack sudo[98548]: pam_unix(sudo:session): session closed for user root Nov 04 12:20:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-23af7676-5615-4947-8bde-e247e7601ad2 tempest-TestMinimumBasicScenario-957363426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fcacd0c9-1bb9-40c6-9e09-a7a4b4b1d2e3 1073741824" returned: 0 in 0.547s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:20:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-23af7676-5615-4947-8bde-e247e7601ad2 tempest-TestMinimumBasicScenario-957363426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fcacd0c9-1bb9-40c6-9e09-a7a4b4b1d2e3 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:20:59 devstack sudo[98554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fcacd0c9-1bb9-40c6-9e09-a7a4b4b1d2e3 Nov 04 12:20:59 devstack sudo[98554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:20:59 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-93bca222-a343-4e47-9909-ac732b61c154 tempest-TestImageHashVerification-550995545 None] Acquiring lock "cinder-ee3dd2b8-5328-48e8-8ea0-2a399d7218b5-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:20:59 devstack sudo[98554]: pam_unix(sudo:session): session closed for user root Nov 04 12:20:59 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-93bca222-a343-4e47-9909-ac732b61c154 tempest-TestImageHashVerification-550995545 None] Lock "cinder-ee3dd2b8-5328-48e8-8ea0-2a399d7218b5-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:20:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-23af7676-5615-4947-8bde-e247e7601ad2 tempest-TestMinimumBasicScenario-957363426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fcacd0c9-1bb9-40c6-9e09-a7a4b4b1d2e3" returned: 0 in 0.457s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:20:59 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-23af7676-5615-4947-8bde-e247e7601ad2 tempest-TestMinimumBasicScenario-957363426 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:20:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-23af7676-5615-4947-8bde-e247e7601ad2 tempest-TestMinimumBasicScenario-957363426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:20:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-70b30e26-e718-4070-852e-dc451711ec9f tempest-TestServerVolumeAttachmentScenario-1482419918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.990s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:20:59 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-70b30e26-e718-4070-852e-dc451711ec9f tempest-TestServerVolumeAttachmentScenario-1482419918 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:20:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-5557471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61ff6aaa-db42-460a-82c3-bd7fcea735c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bde1cfeca7548c6a6f6f8c8ddb3a3ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:20:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:20:39Z,use_quota=True,user_id='aaff3c35ce4444618af60fbae0b5323d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:20:59 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-70b30e26-e718-4070-852e-dc451711ec9f tempest-TestServerVolumeAttachmentScenario-1482419918 None] Creating volume 61ff6aaa-db42-460a-82c3-bd7fcea735c0 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:20:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-70b30e26-e718-4070-852e-dc451711ec9f tempest-TestServerVolumeAttachmentScenario-1482419918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:20:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-70b30e26-e718-4070-852e-dc451711ec9f tempest-TestServerVolumeAttachmentScenario-1482419918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:20:59 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-70b30e26-e718-4070-852e-dc451711ec9f tempest-TestServerVolumeAttachmentScenario-1482419918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:20:59 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-70b30e26-e718-4070-852e-dc451711ec9f tempest-TestServerVolumeAttachmentScenario-1482419918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:20:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-70b30e26-e718-4070-852e-dc451711ec9f tempest-TestServerVolumeAttachmentScenario-1482419918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:20:59 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-70b30e26-e718-4070-852e-dc451711ec9f tempest-TestServerVolumeAttachmentScenario-1482419918 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:20:59 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-70b30e26-e718-4070-852e-dc451711ec9f tempest-TestServerVolumeAttachmentScenario-1482419918 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:20:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-70b30e26-e718-4070-852e-dc451711ec9f tempest-TestServerVolumeAttachmentScenario-1482419918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-61ff6aaa-db42-460a-82c3-bd7fcea735c0 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:20:59 devstack sudo[98557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-61ff6aaa-db42-460a-82c3-bd7fcea735c0 1073741824 Nov 04 12:20:59 devstack sudo[98557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:20:59 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-23af7676-5615-4947-8bde-e247e7601ad2 tempest-TestMinimumBasicScenario-957363426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ecab2c1-0aa8-4123-8c3a-7eca9f18a371) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcacd0c9-1bb9-40c6-9e09-a7a4b4b1d2e3', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:20:59 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-23af7676-5615-4947-8bde-e247e7601ad2 tempest-TestMinimumBasicScenario-957363426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70bd410d-fb82-4107-a191-82a777312eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:20:59 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-23af7676-5615-4947-8bde-e247e7601ad2 tempest-TestMinimumBasicScenario-957363426 None] Volume volume-fcacd0c9-1bb9-40c6-9e09-a7a4b4b1d2e3 (fcacd0c9-1bb9-40c6-9e09-a7a4b4b1d2e3): created successfully Nov 04 12:20:59 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-23af7676-5615-4947-8bde-e247e7601ad2 tempest-TestMinimumBasicScenario-957363426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70bd410d-fb82-4107-a191-82a777312eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:20:59 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-23af7676-5615-4947-8bde-e247e7601ad2 tempest-TestMinimumBasicScenario-957363426 None] Flow 'volume_create_manager' (1b9531ed-4f9a-418c-976c-13b79b567607) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:20:59 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-93bca222-a343-4e47-9909-ac732b61c154 tempest-TestImageHashVerification-550995545 None] Acquiring lock "cinder-quobyte-ee3dd2b8-5328-48e8-8ea0-2a399d7218b5" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:20:59 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-23af7676-5615-4947-8bde-e247e7601ad2 tempest-TestMinimumBasicScenario-957363426 None] Created volume successfully. Nov 04 12:20:59 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-93bca222-a343-4e47-9909-ac732b61c154 tempest-TestImageHashVerification-550995545 None] Lock "cinder-quobyte-ee3dd2b8-5328-48e8-8ea0-2a399d7218b5" acquired by "delete_volume" :: waited 0.045s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:20:59 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be723d3-7366-442a-bbe0-4e334ca2672b]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:20:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-93bca222-a343-4e47-9909-ac732b61c154 tempest-TestImageHashVerification-550995545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee3dd2b8-5328-48e8-8ea0-2a399d7218b5 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:20:59 devstack sudo[98559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee3dd2b8-5328-48e8-8ea0-2a399d7218b5 Nov 04 12:20:59 devstack sudo[98559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:21:00 devstack sudo[98557]: pam_unix(sudo:session): session closed for user root Nov 04 12:21:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-70b30e26-e718-4070-852e-dc451711ec9f tempest-TestServerVolumeAttachmentScenario-1482419918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-61ff6aaa-db42-460a-82c3-bd7fcea735c0 1073741824" returned: 0 in 0.519s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:21:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-70b30e26-e718-4070-852e-dc451711ec9f tempest-TestServerVolumeAttachmentScenario-1482419918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-61ff6aaa-db42-460a-82c3-bd7fcea735c0 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:21:00 devstack sudo[98567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-61ff6aaa-db42-460a-82c3-bd7fcea735c0 Nov 04 12:21:00 devstack sudo[98567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:21:00 devstack sudo[98559]: pam_unix(sudo:session): session closed for user root Nov 04 12:21:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-93bca222-a343-4e47-9909-ac732b61c154 tempest-TestImageHashVerification-550995545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee3dd2b8-5328-48e8-8ea0-2a399d7218b5" returned: 0 in 0.491s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:21:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-93bca222-a343-4e47-9909-ac732b61c154 tempest-TestImageHashVerification-550995545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee3dd2b8-5328-48e8-8ea0-2a399d7218b5 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:21:00 devstack sudo[98570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee3dd2b8-5328-48e8-8ea0-2a399d7218b5 Nov 04 12:21:00 devstack sudo[98570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:21:00 devstack sudo[98567]: pam_unix(sudo:session): session closed for user root Nov 04 12:21:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-70b30e26-e718-4070-852e-dc451711ec9f tempest-TestServerVolumeAttachmentScenario-1482419918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-61ff6aaa-db42-460a-82c3-bd7fcea735c0" returned: 0 in 0.413s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:21:00 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-70b30e26-e718-4070-852e-dc451711ec9f tempest-TestServerVolumeAttachmentScenario-1482419918 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:21:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-70b30e26-e718-4070-852e-dc451711ec9f tempest-TestServerVolumeAttachmentScenario-1482419918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:21:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-222df17e-02ed-42af-aa73-dea716631be2 tempest-TestServerVolumeAttachmentScenario-1482419918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.581s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:21:00 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-222df17e-02ed-42af-aa73-dea716631be2 tempest-TestServerVolumeAttachmentScenario-1482419918 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:20:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1946628937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86e799c0-2c6e-41f6-8f50-7c82b64a9f57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bde1cfeca7548c6a6f6f8c8ddb3a3ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:20:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:20:40Z,use_quota=True,user_id='aaff3c35ce4444618af60fbae0b5323d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:21:00 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-222df17e-02ed-42af-aa73-dea716631be2 tempest-TestServerVolumeAttachmentScenario-1482419918 None] Creating volume 86e799c0-2c6e-41f6-8f50-7c82b64a9f57 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:21:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-222df17e-02ed-42af-aa73-dea716631be2 tempest-TestServerVolumeAttachmentScenario-1482419918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:21:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-222df17e-02ed-42af-aa73-dea716631be2 tempest-TestServerVolumeAttachmentScenario-1482419918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:21:00 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-222df17e-02ed-42af-aa73-dea716631be2 tempest-TestServerVolumeAttachmentScenario-1482419918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:21:00 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-222df17e-02ed-42af-aa73-dea716631be2 tempest-TestServerVolumeAttachmentScenario-1482419918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:21:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-222df17e-02ed-42af-aa73-dea716631be2 tempest-TestServerVolumeAttachmentScenario-1482419918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:21:00 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-222df17e-02ed-42af-aa73-dea716631be2 tempest-TestServerVolumeAttachmentScenario-1482419918 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:21:00 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-222df17e-02ed-42af-aa73-dea716631be2 tempest-TestServerVolumeAttachmentScenario-1482419918 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:21:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-222df17e-02ed-42af-aa73-dea716631be2 tempest-TestServerVolumeAttachmentScenario-1482419918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-86e799c0-2c6e-41f6-8f50-7c82b64a9f57 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:21:00 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-70b30e26-e718-4070-852e-dc451711ec9f tempest-TestServerVolumeAttachmentScenario-1482419918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7260f6d6-f2ec-4ad9-84e9-470570b0223e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61ff6aaa-db42-460a-82c3-bd7fcea735c0', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:21:00 devstack sudo[98576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-86e799c0-2c6e-41f6-8f50-7c82b64a9f57 1073741824 Nov 04 12:21:00 devstack sudo[98576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:21:00 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-70b30e26-e718-4070-852e-dc451711ec9f tempest-TestServerVolumeAttachmentScenario-1482419918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bca5609e-5f48-4fc7-b0e7-38a70bb7ce24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:21:00 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-70b30e26-e718-4070-852e-dc451711ec9f tempest-TestServerVolumeAttachmentScenario-1482419918 None] Volume volume-61ff6aaa-db42-460a-82c3-bd7fcea735c0 (61ff6aaa-db42-460a-82c3-bd7fcea735c0): created successfully Nov 04 12:21:00 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-70b30e26-e718-4070-852e-dc451711ec9f tempest-TestServerVolumeAttachmentScenario-1482419918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bca5609e-5f48-4fc7-b0e7-38a70bb7ce24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:21:00 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-70b30e26-e718-4070-852e-dc451711ec9f tempest-TestServerVolumeAttachmentScenario-1482419918 None] Flow 'volume_create_manager' (b759a4f2-d997-45ea-bf97-71886590e531) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:21:00 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-70b30e26-e718-4070-852e-dc451711ec9f tempest-TestServerVolumeAttachmentScenario-1482419918 None] Created volume successfully. Nov 04 12:21:00 devstack sudo[98570]: pam_unix(sudo:session): session closed for user root Nov 04 12:21:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-93bca222-a343-4e47-9909-ac732b61c154 tempest-TestImageHashVerification-550995545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee3dd2b8-5328-48e8-8ea0-2a399d7218b5" returned: 0 in 0.596s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:21:00 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-93bca222-a343-4e47-9909-ac732b61c154 tempest-TestImageHashVerification-550995545 None] Lock "cinder-quobyte-ee3dd2b8-5328-48e8-8ea0-2a399d7218b5" released by "delete_volume" :: held 1.149s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:21:00 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-93bca222-a343-4e47-9909-ac732b61c154 tempest-TestImageHashVerification-550995545 None] Created reservations ['3be30c89-8a19-4fcb-ab03-e2dd5e6dce0f', '8558206c-6127-454a-bc56-61509b62f020', '2a2dfb98-40dd-49b3-84dd-d3730a500a98', 'da347e75-32d1-4ff7-9978-d9240ba07a99'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:21:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-93bca222-a343-4e47-9909-ac732b61c154 tempest-TestImageHashVerification-550995545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:21:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-93bca222-a343-4e47-9909-ac732b61c154 tempest-TestImageHashVerification-550995545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:21:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-93bca222-a343-4e47-9909-ac732b61c154 tempest-TestImageHashVerification-550995545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:21:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-93bca222-a343-4e47-9909-ac732b61c154 tempest-TestImageHashVerification-550995545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:21:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-93bca222-a343-4e47-9909-ac732b61c154 tempest-TestImageHashVerification-550995545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:21:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-93bca222-a343-4e47-9909-ac732b61c154 tempest-TestImageHashVerification-550995545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:21:01 devstack sudo[98583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:21:01 devstack sudo[98583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:21:01 devstack sudo[98583]: pam_unix(sudo:session): session closed for user root Nov 04 12:21:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-93bca222-a343-4e47-9909-ac732b61c154 tempest-TestImageHashVerification-550995545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.436s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:21:01 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-93bca222-a343-4e47-9909-ac732b61c154 tempest-TestImageHashVerification-550995545 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:21:01 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-93bca222-a343-4e47-9909-ac732b61c154 tempest-TestImageHashVerification-550995545 None] Deleted volume successfully. Nov 04 12:21:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-93bca222-a343-4e47-9909-ac732b61c154 tempest-TestImageHashVerification-550995545 None] Lock "cinder-ee3dd2b8-5328-48e8-8ea0-2a399d7218b5-delete_volume" released by "delete_volume" :: held 2.054s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:21:01 devstack sudo[98576]: pam_unix(sudo:session): session closed for user root Nov 04 12:21:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-222df17e-02ed-42af-aa73-dea716631be2 tempest-TestServerVolumeAttachmentScenario-1482419918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-86e799c0-2c6e-41f6-8f50-7c82b64a9f57 1073741824" returned: 0 in 0.980s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:21:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-222df17e-02ed-42af-aa73-dea716631be2 tempest-TestServerVolumeAttachmentScenario-1482419918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-86e799c0-2c6e-41f6-8f50-7c82b64a9f57 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:21:01 devstack sudo[98591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-86e799c0-2c6e-41f6-8f50-7c82b64a9f57 Nov 04 12:21:01 devstack sudo[98591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:21:01 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 12:21:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:21:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:21:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:21:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:21:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:21:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:21:01 devstack sudo[98598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:21:01 devstack sudo[98598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:21:02 devstack sudo[98591]: pam_unix(sudo:session): session closed for user root Nov 04 12:21:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-222df17e-02ed-42af-aa73-dea716631be2 tempest-TestServerVolumeAttachmentScenario-1482419918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-86e799c0-2c6e-41f6-8f50-7c82b64a9f57" returned: 0 in 0.483s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:21:02 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-222df17e-02ed-42af-aa73-dea716631be2 tempest-TestServerVolumeAttachmentScenario-1482419918 None] <== create_volume: return (1535ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:21:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-222df17e-02ed-42af-aa73-dea716631be2 tempest-TestServerVolumeAttachmentScenario-1482419918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.542s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:21:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-f6c34291-85a5-47eb-83ff-6005e6e49288 req-f6f31246-a83e-49ed-8831-bf292cb285c1 tempest-TestMinimumBasicScenario-957363426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:21:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-f6c34291-85a5-47eb-83ff-6005e6e49288 req-f6f31246-a83e-49ed-8831-bf292cb285c1 tempest-TestMinimumBasicScenario-957363426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:21:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-222df17e-02ed-42af-aa73-dea716631be2 tempest-TestServerVolumeAttachmentScenario-1482419918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1457fac4-74e5-4595-a128-952ac1ab1bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86e799c0-2c6e-41f6-8f50-7c82b64a9f57', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:21:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-222df17e-02ed-42af-aa73-dea716631be2 tempest-TestServerVolumeAttachmentScenario-1482419918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bddfda39-c1c1-478c-9f3b-5782772355f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:21:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-f6c34291-85a5-47eb-83ff-6005e6e49288 req-f6f31246-a83e-49ed-8831-bf292cb285c1 tempest-TestMinimumBasicScenario-957363426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:21:02 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-222df17e-02ed-42af-aa73-dea716631be2 tempest-TestServerVolumeAttachmentScenario-1482419918 None] Volume volume-86e799c0-2c6e-41f6-8f50-7c82b64a9f57 (86e799c0-2c6e-41f6-8f50-7c82b64a9f57): created successfully Nov 04 12:21:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-222df17e-02ed-42af-aa73-dea716631be2 tempest-TestServerVolumeAttachmentScenario-1482419918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bddfda39-c1c1-478c-9f3b-5782772355f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:21:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-222df17e-02ed-42af-aa73-dea716631be2 tempest-TestServerVolumeAttachmentScenario-1482419918 None] Flow 'volume_create_manager' (9d62405b-d750-4a55-98dd-d4c5a8bf14e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:21:02 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-222df17e-02ed-42af-aa73-dea716631be2 tempest-TestServerVolumeAttachmentScenario-1482419918 None] Created volume successfully. Nov 04 12:21:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-f6c34291-85a5-47eb-83ff-6005e6e49288 req-f6f31246-a83e-49ed-8831-bf292cb285c1 tempest-TestMinimumBasicScenario-957363426 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784', 'name': 'volume-fcacd0c9-1bb9-40c6-9e09-a7a4b4b1d2e3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '883a8fbb-cadf-4541-b03a-4702f365d0bb', 'enforce_multipath': True} {{(pid=87095) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 12:21:02 devstack sudo[98598]: pam_unix(sudo:session): session closed for user root Nov 04 12:21:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.528s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:21:02 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:21:02 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Running periodic task VolumeManager._thread_info {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 12:21:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] thread count: 28 {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 12:21:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] thread info: [<_MainThread(MainThread, started 140610387472512)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 12:21:02 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-f6c34291-85a5-47eb-83ff-6005e6e49288 req-f6f31246-a83e-49ed-8831-bf292cb285c1 tempest-TestMinimumBasicScenario-957363426 None] attachment_update completed successfully. Nov 04 12:21:12 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:UPDATE=21,cinder:SELECT=14,cinder:DELETE=3,cinder:INSERT=4 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 12:21:12 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=16,cinder:UPDATE=14,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 12:21:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-23075351-7771-451e-ba52-679ab787aa55 req-11616579-b6be-4a21-8afc-5af151b0a63c tempest-TestServerVolumeAttachmentScenario-1482419918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:21:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-23075351-7771-451e-ba52-679ab787aa55 req-11616579-b6be-4a21-8afc-5af151b0a63c tempest-TestServerVolumeAttachmentScenario-1482419918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:21:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-23075351-7771-451e-ba52-679ab787aa55 req-11616579-b6be-4a21-8afc-5af151b0a63c tempest-TestServerVolumeAttachmentScenario-1482419918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:21:17 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-23075351-7771-451e-ba52-679ab787aa55 req-11616579-b6be-4a21-8afc-5af151b0a63c tempest-TestServerVolumeAttachmentScenario-1482419918 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784', 'name': 'volume-61ff6aaa-db42-460a-82c3-bd7fcea735c0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '02a215b7-016d-4278-94e8-b76b03484850', 'enforce_multipath': True} {{(pid=87095) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 12:21:18 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-23075351-7771-451e-ba52-679ab787aa55 req-11616579-b6be-4a21-8afc-5af151b0a63c tempest-TestServerVolumeAttachmentScenario-1482419918 None] attachment_update completed successfully. Nov 04 12:21:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-7b69e213-f4e1-48c2-b7a5-1879b4df2291 req-aa3f8d4b-3fcb-42bc-819f-e9d3d542722a tempest-TestServerVolumeAttachmentScenario-1482419918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:21:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-7b69e213-f4e1-48c2-b7a5-1879b4df2291 req-aa3f8d4b-3fcb-42bc-819f-e9d3d542722a tempest-TestServerVolumeAttachmentScenario-1482419918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:21:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-7b69e213-f4e1-48c2-b7a5-1879b4df2291 req-aa3f8d4b-3fcb-42bc-819f-e9d3d542722a tempest-TestServerVolumeAttachmentScenario-1482419918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:21:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-7b69e213-f4e1-48c2-b7a5-1879b4df2291 req-aa3f8d4b-3fcb-42bc-819f-e9d3d542722a tempest-TestServerVolumeAttachmentScenario-1482419918 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784', 'name': 'volume-86e799c0-2c6e-41f6-8f50-7c82b64a9f57', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '23ddd462-b824-4ad7-b37e-db1c3ea9cacf', 'enforce_multipath': True} {{(pid=87095) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 12:21:24 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-7b69e213-f4e1-48c2-b7a5-1879b4df2291 req-aa3f8d4b-3fcb-42bc-819f-e9d3d542722a tempest-TestServerVolumeAttachmentScenario-1482419918 None] attachment_update completed successfully. Nov 04 12:21:26 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-a943ea8d-2bfb-44b9-99bd-7f442c2ffa22 req-b1c7fd59-d757-4f26-8640-352127a8bb74 tempest-TestServerVolumeAttachmentScenario-1482419918 None] Terminate volume connection completed successfully. Nov 04 12:21:26 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-a943ea8d-2bfb-44b9-99bd-7f442c2ffa22 req-b1c7fd59-d757-4f26-8640-352127a8bb74 tempest-TestServerVolumeAttachmentScenario-1482419918 None] Deleting attachment 23ddd462-b824-4ad7-b37e-db1c3ea9cacf. {{(pid=87095) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 12:21:27 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-59ff35bc-f396-488c-980d-3e4f55fe89d4 req-3dca58a4-dc90-4039-a38a-19488807c0c9 tempest-TestServerVolumeAttachmentScenario-1482419918 None] Terminate volume connection completed successfully. Nov 04 12:21:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-59ff35bc-f396-488c-980d-3e4f55fe89d4 req-3dca58a4-dc90-4039-a38a-19488807c0c9 tempest-TestServerVolumeAttachmentScenario-1482419918 None] Deleting attachment 02a215b7-016d-4278-94e8-b76b03484850. {{(pid=87095) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 12:21:34 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-36b3b261-6eb1-42df-b846-3f0224f2d1fd tempest-TestServerVolumeAttachmentScenario-1482419918 None] Acquiring lock "cinder-86e799c0-2c6e-41f6-8f50-7c82b64a9f57-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:21:34 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-36b3b261-6eb1-42df-b846-3f0224f2d1fd tempest-TestServerVolumeAttachmentScenario-1482419918 None] Lock "cinder-86e799c0-2c6e-41f6-8f50-7c82b64a9f57-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:21:34 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-36b3b261-6eb1-42df-b846-3f0224f2d1fd tempest-TestServerVolumeAttachmentScenario-1482419918 None] Acquiring lock "cinder-quobyte-86e799c0-2c6e-41f6-8f50-7c82b64a9f57" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:21:34 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-36b3b261-6eb1-42df-b846-3f0224f2d1fd tempest-TestServerVolumeAttachmentScenario-1482419918 None] Lock "cinder-quobyte-86e799c0-2c6e-41f6-8f50-7c82b64a9f57" acquired by "delete_volume" :: waited 0.029s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:21:34 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce422d9-44b2-4770-9c15-4de5ef8ff93d]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:21:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-36b3b261-6eb1-42df-b846-3f0224f2d1fd tempest-TestServerVolumeAttachmentScenario-1482419918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-86e799c0-2c6e-41f6-8f50-7c82b64a9f57 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:21:34 devstack sudo[99348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-86e799c0-2c6e-41f6-8f50-7c82b64a9f57 Nov 04 12:21:34 devstack sudo[99348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:21:35 devstack sudo[99348]: pam_unix(sudo:session): session closed for user root Nov 04 12:21:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-36b3b261-6eb1-42df-b846-3f0224f2d1fd tempest-TestServerVolumeAttachmentScenario-1482419918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-86e799c0-2c6e-41f6-8f50-7c82b64a9f57" returned: 0 in 0.574s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:21:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-36b3b261-6eb1-42df-b846-3f0224f2d1fd tempest-TestServerVolumeAttachmentScenario-1482419918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-86e799c0-2c6e-41f6-8f50-7c82b64a9f57 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:21:35 devstack sudo[99353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-86e799c0-2c6e-41f6-8f50-7c82b64a9f57 Nov 04 12:21:35 devstack sudo[99353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:21:35 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-432a085e-52a8-4164-8952-afbf7cf25826 tempest-AttachVolumeNegativeTest-1833368782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:21:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-432a085e-52a8-4164-8952-afbf7cf25826 tempest-AttachVolumeNegativeTest-1833368782 None] Flow 'volume_create_manager' (d740d3ac-53a0-4c42-895f-2c2f93113900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:21:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-432a085e-52a8-4164-8952-afbf7cf25826 tempest-AttachVolumeNegativeTest-1833368782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cba94783-b2f4-4999-bcf7-4dd79b895a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:21:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-432a085e-52a8-4164-8952-afbf7cf25826 tempest-AttachVolumeNegativeTest-1833368782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cba94783-b2f4-4999-bcf7-4dd79b895a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:21:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1993626940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33de3682-4e86-4c0f-ba66-0bf31024a8e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af841f214471418c9e103670562e75a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:21:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:21:35Z,use_quota=True,user_id='c5a5a0abad934484bdf8be54400a7185',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:21:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-432a085e-52a8-4164-8952-afbf7cf25826 tempest-AttachVolumeNegativeTest-1833368782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89140c09-d8fd-49a9-a235-f75490992ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:21:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-432a085e-52a8-4164-8952-afbf7cf25826 tempest-AttachVolumeNegativeTest-1833368782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89140c09-d8fd-49a9-a235-f75490992ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:21:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-432a085e-52a8-4164-8952-afbf7cf25826 tempest-AttachVolumeNegativeTest-1833368782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68293555-c442-4c12-b5c7-ed285db14e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:21:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-432a085e-52a8-4164-8952-afbf7cf25826 tempest-AttachVolumeNegativeTest-1833368782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68293555-c442-4c12-b5c7-ed285db14e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33de3682-4e86-4c0f-ba66-0bf31024a8e4', 'volume_name': 'volume-33de3682-4e86-4c0f-ba66-0bf31024a8e4', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:21:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-432a085e-52a8-4164-8952-afbf7cf25826 tempest-AttachVolumeNegativeTest-1833368782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (976c0c9c-2ba5-4ce6-ac27-70bb19fe3821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:21:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-432a085e-52a8-4164-8952-afbf7cf25826 tempest-AttachVolumeNegativeTest-1833368782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (976c0c9c-2ba5-4ce6-ac27-70bb19fe3821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:21:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-432a085e-52a8-4164-8952-afbf7cf25826 tempest-AttachVolumeNegativeTest-1833368782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26aaea43-1839-4ebf-8208-9dca729ed114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:21:35 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-432a085e-52a8-4164-8952-afbf7cf25826 tempest-AttachVolumeNegativeTest-1833368782 None] Volume 33de3682-4e86-4c0f-ba66-0bf31024a8e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33de3682-4e86-4c0f-ba66-0bf31024a8e4', 'volume_size': 1} Nov 04 12:21:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-432a085e-52a8-4164-8952-afbf7cf25826 tempest-AttachVolumeNegativeTest-1833368782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:21:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-432a085e-52a8-4164-8952-afbf7cf25826 tempest-AttachVolumeNegativeTest-1833368782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:21:35 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-432a085e-52a8-4164-8952-afbf7cf25826 tempest-AttachVolumeNegativeTest-1833368782 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:21:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1993626940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33de3682-4e86-4c0f-ba66-0bf31024a8e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af841f214471418c9e103670562e75a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:21:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:21:35Z,use_quota=True,user_id='c5a5a0abad934484bdf8be54400a7185',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:21:35 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-432a085e-52a8-4164-8952-afbf7cf25826 tempest-AttachVolumeNegativeTest-1833368782 None] Creating volume 33de3682-4e86-4c0f-ba66-0bf31024a8e4 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:21:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-432a085e-52a8-4164-8952-afbf7cf25826 tempest-AttachVolumeNegativeTest-1833368782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:21:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-432a085e-52a8-4164-8952-afbf7cf25826 tempest-AttachVolumeNegativeTest-1833368782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:21:35 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-432a085e-52a8-4164-8952-afbf7cf25826 tempest-AttachVolumeNegativeTest-1833368782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:21:35 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-432a085e-52a8-4164-8952-afbf7cf25826 tempest-AttachVolumeNegativeTest-1833368782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:21:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-432a085e-52a8-4164-8952-afbf7cf25826 tempest-AttachVolumeNegativeTest-1833368782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:21:35 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-432a085e-52a8-4164-8952-afbf7cf25826 tempest-AttachVolumeNegativeTest-1833368782 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:21:35 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-432a085e-52a8-4164-8952-afbf7cf25826 tempest-AttachVolumeNegativeTest-1833368782 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:21:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-432a085e-52a8-4164-8952-afbf7cf25826 tempest-AttachVolumeNegativeTest-1833368782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-33de3682-4e86-4c0f-ba66-0bf31024a8e4 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:21:35 devstack sudo[99355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-33de3682-4e86-4c0f-ba66-0bf31024a8e4 1073741824 Nov 04 12:21:35 devstack sudo[99355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:21:35 devstack sudo[99353]: pam_unix(sudo:session): session closed for user root Nov 04 12:21:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-36b3b261-6eb1-42df-b846-3f0224f2d1fd tempest-TestServerVolumeAttachmentScenario-1482419918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-86e799c0-2c6e-41f6-8f50-7c82b64a9f57" returned: 0 in 0.273s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:21:35 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-36b3b261-6eb1-42df-b846-3f0224f2d1fd tempest-TestServerVolumeAttachmentScenario-1482419918 None] Lock "cinder-quobyte-86e799c0-2c6e-41f6-8f50-7c82b64a9f57" released by "delete_volume" :: held 0.950s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:21:35 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-36b3b261-6eb1-42df-b846-3f0224f2d1fd tempest-TestServerVolumeAttachmentScenario-1482419918 None] Created reservations ['69d70943-99e5-46b0-9a80-43ebbcb55b3a', '31d514f2-89c8-4feb-898a-dde03b7840f1', '98694cde-c094-45a3-b6b8-54f6ad90aeba', '31dcf956-9da5-4522-975a-ce9f8befe621'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:21:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-36b3b261-6eb1-42df-b846-3f0224f2d1fd tempest-TestServerVolumeAttachmentScenario-1482419918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:21:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-36b3b261-6eb1-42df-b846-3f0224f2d1fd tempest-TestServerVolumeAttachmentScenario-1482419918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:21:35 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-36b3b261-6eb1-42df-b846-3f0224f2d1fd tempest-TestServerVolumeAttachmentScenario-1482419918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:21:35 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-36b3b261-6eb1-42df-b846-3f0224f2d1fd tempest-TestServerVolumeAttachmentScenario-1482419918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:21:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-36b3b261-6eb1-42df-b846-3f0224f2d1fd tempest-TestServerVolumeAttachmentScenario-1482419918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:21:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-36b3b261-6eb1-42df-b846-3f0224f2d1fd tempest-TestServerVolumeAttachmentScenario-1482419918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:21:35 devstack sudo[99361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:21:35 devstack sudo[99361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:21:36 devstack sudo[99355]: pam_unix(sudo:session): session closed for user root Nov 04 12:21:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-432a085e-52a8-4164-8952-afbf7cf25826 tempest-AttachVolumeNegativeTest-1833368782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-33de3682-4e86-4c0f-ba66-0bf31024a8e4 1073741824" returned: 0 in 0.627s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:21:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-432a085e-52a8-4164-8952-afbf7cf25826 tempest-AttachVolumeNegativeTest-1833368782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-33de3682-4e86-4c0f-ba66-0bf31024a8e4 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:21:36 devstack sudo[99368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-33de3682-4e86-4c0f-ba66-0bf31024a8e4 Nov 04 12:21:36 devstack sudo[99368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:21:36 devstack sudo[99361]: pam_unix(sudo:session): session closed for user root Nov 04 12:21:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-36b3b261-6eb1-42df-b846-3f0224f2d1fd tempest-TestServerVolumeAttachmentScenario-1482419918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.365s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:21:36 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-36b3b261-6eb1-42df-b846-3f0224f2d1fd tempest-TestServerVolumeAttachmentScenario-1482419918 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:21:36 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-36b3b261-6eb1-42df-b846-3f0224f2d1fd tempest-TestServerVolumeAttachmentScenario-1482419918 None] Deleted volume successfully. Nov 04 12:21:36 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-36b3b261-6eb1-42df-b846-3f0224f2d1fd tempest-TestServerVolumeAttachmentScenario-1482419918 None] Lock "cinder-86e799c0-2c6e-41f6-8f50-7c82b64a9f57-delete_volume" released by "delete_volume" :: held 1.797s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:21:36 devstack sudo[99368]: pam_unix(sudo:session): session closed for user root Nov 04 12:21:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-432a085e-52a8-4164-8952-afbf7cf25826 tempest-AttachVolumeNegativeTest-1833368782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-33de3682-4e86-4c0f-ba66-0bf31024a8e4" returned: 0 in 0.321s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:21:36 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-432a085e-52a8-4164-8952-afbf7cf25826 tempest-AttachVolumeNegativeTest-1833368782 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:21:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-432a085e-52a8-4164-8952-afbf7cf25826 tempest-AttachVolumeNegativeTest-1833368782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:21:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-432a085e-52a8-4164-8952-afbf7cf25826 tempest-AttachVolumeNegativeTest-1833368782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26aaea43-1839-4ebf-8208-9dca729ed114) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33de3682-4e86-4c0f-ba66-0bf31024a8e4', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:21:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-432a085e-52a8-4164-8952-afbf7cf25826 tempest-AttachVolumeNegativeTest-1833368782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92f0be9f-0510-4f83-93c5-f453a63756f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:21:36 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-432a085e-52a8-4164-8952-afbf7cf25826 tempest-AttachVolumeNegativeTest-1833368782 None] Volume volume-33de3682-4e86-4c0f-ba66-0bf31024a8e4 (33de3682-4e86-4c0f-ba66-0bf31024a8e4): created successfully Nov 04 12:21:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-432a085e-52a8-4164-8952-afbf7cf25826 tempest-AttachVolumeNegativeTest-1833368782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92f0be9f-0510-4f83-93c5-f453a63756f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:21:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-432a085e-52a8-4164-8952-afbf7cf25826 tempest-AttachVolumeNegativeTest-1833368782 None] Flow 'volume_create_manager' (d740d3ac-53a0-4c42-895f-2c2f93113900) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:21:36 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-432a085e-52a8-4164-8952-afbf7cf25826 tempest-AttachVolumeNegativeTest-1833368782 None] Created volume successfully. Nov 04 12:21:36 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-98a38786-aab4-43d0-b4ec-eec0cd8ec727 tempest-TestServerVolumeAttachmentScenario-1482419918 None] Acquiring lock "cinder-61ff6aaa-db42-460a-82c3-bd7fcea735c0-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:21:36 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-98a38786-aab4-43d0-b4ec-eec0cd8ec727 tempest-TestServerVolumeAttachmentScenario-1482419918 None] Lock "cinder-61ff6aaa-db42-460a-82c3-bd7fcea735c0-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:21:36 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-98a38786-aab4-43d0-b4ec-eec0cd8ec727 tempest-TestServerVolumeAttachmentScenario-1482419918 None] Acquiring lock "cinder-quobyte-61ff6aaa-db42-460a-82c3-bd7fcea735c0" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:21:36 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-98a38786-aab4-43d0-b4ec-eec0cd8ec727 tempest-TestServerVolumeAttachmentScenario-1482419918 None] Lock "cinder-quobyte-61ff6aaa-db42-460a-82c3-bd7fcea735c0" acquired by "delete_volume" :: waited 0.021s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:21:36 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb1f73c3-0223-4646-9539-d3b05e3d2329]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:21:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-98a38786-aab4-43d0-b4ec-eec0cd8ec727 tempest-TestServerVolumeAttachmentScenario-1482419918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-61ff6aaa-db42-460a-82c3-bd7fcea735c0 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:21:36 devstack sudo[99380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-61ff6aaa-db42-460a-82c3-bd7fcea735c0 Nov 04 12:21:36 devstack sudo[99380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:21:37 devstack sudo[99380]: pam_unix(sudo:session): session closed for user root Nov 04 12:21:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-98a38786-aab4-43d0-b4ec-eec0cd8ec727 tempest-TestServerVolumeAttachmentScenario-1482419918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-61ff6aaa-db42-460a-82c3-bd7fcea735c0" returned: 0 in 0.386s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:21:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-98a38786-aab4-43d0-b4ec-eec0cd8ec727 tempest-TestServerVolumeAttachmentScenario-1482419918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-61ff6aaa-db42-460a-82c3-bd7fcea735c0 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:21:37 devstack sudo[99388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-61ff6aaa-db42-460a-82c3-bd7fcea735c0 Nov 04 12:21:37 devstack sudo[99388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:21:37 devstack sudo[99388]: pam_unix(sudo:session): session closed for user root Nov 04 12:21:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-98a38786-aab4-43d0-b4ec-eec0cd8ec727 tempest-TestServerVolumeAttachmentScenario-1482419918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-61ff6aaa-db42-460a-82c3-bd7fcea735c0" returned: 0 in 0.307s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:21:37 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-98a38786-aab4-43d0-b4ec-eec0cd8ec727 tempest-TestServerVolumeAttachmentScenario-1482419918 None] Lock "cinder-quobyte-61ff6aaa-db42-460a-82c3-bd7fcea735c0" released by "delete_volume" :: held 0.754s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:21:37 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-98a38786-aab4-43d0-b4ec-eec0cd8ec727 tempest-TestServerVolumeAttachmentScenario-1482419918 None] Created reservations ['08846645-7115-41c1-aa98-5f35d5f115f0', '3381236b-ee81-448f-86af-aa216045ade1', '40b4bbc8-ad4d-4f84-b6b9-6b13bf8bc5b8', 'eb5bb46a-89ff-4d52-a6ee-42b4dabf1582'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:21:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-98a38786-aab4-43d0-b4ec-eec0cd8ec727 tempest-TestServerVolumeAttachmentScenario-1482419918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:21:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-98a38786-aab4-43d0-b4ec-eec0cd8ec727 tempest-TestServerVolumeAttachmentScenario-1482419918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:21:37 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-98a38786-aab4-43d0-b4ec-eec0cd8ec727 tempest-TestServerVolumeAttachmentScenario-1482419918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:21:37 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-98a38786-aab4-43d0-b4ec-eec0cd8ec727 tempest-TestServerVolumeAttachmentScenario-1482419918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:21:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-98a38786-aab4-43d0-b4ec-eec0cd8ec727 tempest-TestServerVolumeAttachmentScenario-1482419918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:21:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-98a38786-aab4-43d0-b4ec-eec0cd8ec727 tempest-TestServerVolumeAttachmentScenario-1482419918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:21:37 devstack sudo[99398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:21:37 devstack sudo[99398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:21:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-4611c3de-74aa-46d6-a57b-7f75d83f69a5 req-d377f975-046a-4e8a-acf8-940e92247fa2 tempest-AttachVolumeNegativeTest-1833368782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:21:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-4611c3de-74aa-46d6-a57b-7f75d83f69a5 req-d377f975-046a-4e8a-acf8-940e92247fa2 tempest-AttachVolumeNegativeTest-1833368782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:21:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-4611c3de-74aa-46d6-a57b-7f75d83f69a5 req-d377f975-046a-4e8a-acf8-940e92247fa2 tempest-AttachVolumeNegativeTest-1833368782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:21:38 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-4611c3de-74aa-46d6-a57b-7f75d83f69a5 req-d377f975-046a-4e8a-acf8-940e92247fa2 tempest-AttachVolumeNegativeTest-1833368782 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784', 'name': 'volume-33de3682-4e86-4c0f-ba66-0bf31024a8e4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2010f188-1955-40b7-a5e8-a7673ba38ba5', 'enforce_multipath': True} {{(pid=87095) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 12:21:38 devstack sudo[99398]: pam_unix(sudo:session): session closed for user root Nov 04 12:21:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-98a38786-aab4-43d0-b4ec-eec0cd8ec727 tempest-TestServerVolumeAttachmentScenario-1482419918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.333s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:21:38 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-98a38786-aab4-43d0-b4ec-eec0cd8ec727 tempest-TestServerVolumeAttachmentScenario-1482419918 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:21:38 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-98a38786-aab4-43d0-b4ec-eec0cd8ec727 tempest-TestServerVolumeAttachmentScenario-1482419918 None] Deleted volume successfully. Nov 04 12:21:38 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-98a38786-aab4-43d0-b4ec-eec0cd8ec727 tempest-TestServerVolumeAttachmentScenario-1482419918 None] Lock "cinder-61ff6aaa-db42-460a-82c3-bd7fcea735c0-delete_volume" released by "delete_volume" :: held 1.395s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:21:38 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-4611c3de-74aa-46d6-a57b-7f75d83f69a5 req-d377f975-046a-4e8a-acf8-940e92247fa2 tempest-AttachVolumeNegativeTest-1833368782 None] attachment_update completed successfully. Nov 04 12:21:48 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=37,cinder:UPDATE=21,cinder:INSERT=5,cinder:DELETE=2 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 12:21:48 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=31,cinder:UPDATE=27,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 12:21:51 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-74edda5b-cfcb-4758-9737-ab9dbb32780a req-841a16cf-167b-4487-8c86-bb07ee7e6c85 tempest-TestMinimumBasicScenario-957363426 None] Terminate volume connection completed successfully. Nov 04 12:21:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-74edda5b-cfcb-4758-9737-ab9dbb32780a req-841a16cf-167b-4487-8c86-bb07ee7e6c85 tempest-TestMinimumBasicScenario-957363426 None] Deleting attachment 883a8fbb-cadf-4541-b03a-4702f365d0bb. {{(pid=87095) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 12:21:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-d811054a-d8f5-493f-8966-4f20ed6cd655 tempest-TestMinimumBasicScenario-957363426 None] Acquiring lock "cinder-fcacd0c9-1bb9-40c6-9e09-a7a4b4b1d2e3-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:21:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-d811054a-d8f5-493f-8966-4f20ed6cd655 tempest-TestMinimumBasicScenario-957363426 None] Lock "cinder-fcacd0c9-1bb9-40c6-9e09-a7a4b4b1d2e3-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:21:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-d811054a-d8f5-493f-8966-4f20ed6cd655 tempest-TestMinimumBasicScenario-957363426 None] Acquiring lock "cinder-quobyte-fcacd0c9-1bb9-40c6-9e09-a7a4b4b1d2e3" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:21:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-d811054a-d8f5-493f-8966-4f20ed6cd655 tempest-TestMinimumBasicScenario-957363426 None] Lock "cinder-quobyte-fcacd0c9-1bb9-40c6-9e09-a7a4b4b1d2e3" acquired by "delete_volume" :: waited 0.035s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:21:52 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[769f3400-5352-40e9-b380-4e8c730307da]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:21:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d811054a-d8f5-493f-8966-4f20ed6cd655 tempest-TestMinimumBasicScenario-957363426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fcacd0c9-1bb9-40c6-9e09-a7a4b4b1d2e3 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:21:52 devstack sudo[99421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fcacd0c9-1bb9-40c6-9e09-a7a4b4b1d2e3 Nov 04 12:21:52 devstack sudo[99421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:21:52 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ffe4def-8f2e-4568-ba48-68ed938c83df tempest-TestStampPattern-979127523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:21:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7ffe4def-8f2e-4568-ba48-68ed938c83df tempest-TestStampPattern-979127523 None] Flow 'volume_create_manager' (46374dc0-7244-48dc-a9e6-bb45437ed554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:21:52 devstack sudo[99421]: pam_unix(sudo:session): session closed for user root Nov 04 12:21:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7ffe4def-8f2e-4568-ba48-68ed938c83df tempest-TestStampPattern-979127523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (619f0c91-c1f8-407a-a5f2-e0605f21e4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:21:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d811054a-d8f5-493f-8966-4f20ed6cd655 tempest-TestMinimumBasicScenario-957363426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fcacd0c9-1bb9-40c6-9e09-a7a4b4b1d2e3" returned: 0 in 0.698s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:21:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d811054a-d8f5-493f-8966-4f20ed6cd655 tempest-TestMinimumBasicScenario-957363426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fcacd0c9-1bb9-40c6-9e09-a7a4b4b1d2e3 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:21:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7ffe4def-8f2e-4568-ba48-68ed938c83df tempest-TestStampPattern-979127523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (619f0c91-c1f8-407a-a5f2-e0605f21e4f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:21:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1459804720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff7aff92-ea95-4882-b1bd-9a444df50764,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69bf40c8da1c4c37af1dc60e68fa5952',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:21:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:21:53Z,use_quota=True,user_id='2122ba2073114df49f55c8ab2b281018',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:21:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7ffe4def-8f2e-4568-ba48-68ed938c83df tempest-TestStampPattern-979127523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (756dcd26-d088-4bc4-bc3b-7833afd7acca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:21:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7ffe4def-8f2e-4568-ba48-68ed938c83df tempest-TestStampPattern-979127523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (756dcd26-d088-4bc4-bc3b-7833afd7acca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:21:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7ffe4def-8f2e-4568-ba48-68ed938c83df tempest-TestStampPattern-979127523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55fe855a-7eb0-433a-8e61-5f6ff01402cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:21:52 devstack sudo[99427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fcacd0c9-1bb9-40c6-9e09-a7a4b4b1d2e3 Nov 04 12:21:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7ffe4def-8f2e-4568-ba48-68ed938c83df tempest-TestStampPattern-979127523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55fe855a-7eb0-433a-8e61-5f6ff01402cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff7aff92-ea95-4882-b1bd-9a444df50764', 'volume_name': 'volume-ff7aff92-ea95-4882-b1bd-9a444df50764', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:21:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7ffe4def-8f2e-4568-ba48-68ed938c83df tempest-TestStampPattern-979127523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b2fc0bc-7851-4421-86cb-eceee6986289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:21:52 devstack sudo[99427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:21:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7ffe4def-8f2e-4568-ba48-68ed938c83df tempest-TestStampPattern-979127523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b2fc0bc-7851-4421-86cb-eceee6986289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:21:53 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7ffe4def-8f2e-4568-ba48-68ed938c83df tempest-TestStampPattern-979127523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ab91476-1f9d-4984-b20e-0ecb46bb25e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:21:53 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-7ffe4def-8f2e-4568-ba48-68ed938c83df tempest-TestStampPattern-979127523 None] Volume ff7aff92-ea95-4882-b1bd-9a444df50764: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff7aff92-ea95-4882-b1bd-9a444df50764', 'volume_size': 1} Nov 04 12:21:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7ffe4def-8f2e-4568-ba48-68ed938c83df tempest-TestStampPattern-979127523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:21:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7ffe4def-8f2e-4568-ba48-68ed938c83df tempest-TestStampPattern-979127523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:21:53 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7ffe4def-8f2e-4568-ba48-68ed938c83df tempest-TestStampPattern-979127523 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:21:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1459804720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff7aff92-ea95-4882-b1bd-9a444df50764,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69bf40c8da1c4c37af1dc60e68fa5952',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:21:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:21:53Z,use_quota=True,user_id='2122ba2073114df49f55c8ab2b281018',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:21:53 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-7ffe4def-8f2e-4568-ba48-68ed938c83df tempest-TestStampPattern-979127523 None] Creating volume ff7aff92-ea95-4882-b1bd-9a444df50764 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:21:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7ffe4def-8f2e-4568-ba48-68ed938c83df tempest-TestStampPattern-979127523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:21:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7ffe4def-8f2e-4568-ba48-68ed938c83df tempest-TestStampPattern-979127523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:21:53 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7ffe4def-8f2e-4568-ba48-68ed938c83df tempest-TestStampPattern-979127523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:21:53 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7ffe4def-8f2e-4568-ba48-68ed938c83df tempest-TestStampPattern-979127523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:21:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7ffe4def-8f2e-4568-ba48-68ed938c83df tempest-TestStampPattern-979127523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:21:53 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7ffe4def-8f2e-4568-ba48-68ed938c83df tempest-TestStampPattern-979127523 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:21:53 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-7ffe4def-8f2e-4568-ba48-68ed938c83df tempest-TestStampPattern-979127523 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:21:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7ffe4def-8f2e-4568-ba48-68ed938c83df tempest-TestStampPattern-979127523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ff7aff92-ea95-4882-b1bd-9a444df50764 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:21:53 devstack sudo[99429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ff7aff92-ea95-4882-b1bd-9a444df50764 1073741824 Nov 04 12:21:53 devstack sudo[99429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:21:53 devstack sudo[99427]: pam_unix(sudo:session): session closed for user root Nov 04 12:21:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d811054a-d8f5-493f-8966-4f20ed6cd655 tempest-TestMinimumBasicScenario-957363426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fcacd0c9-1bb9-40c6-9e09-a7a4b4b1d2e3" returned: 0 in 0.550s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:21:53 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-d811054a-d8f5-493f-8966-4f20ed6cd655 tempest-TestMinimumBasicScenario-957363426 None] Lock "cinder-quobyte-fcacd0c9-1bb9-40c6-9e09-a7a4b4b1d2e3" released by "delete_volume" :: held 1.335s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:21:53 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-d811054a-d8f5-493f-8966-4f20ed6cd655 tempest-TestMinimumBasicScenario-957363426 None] Created reservations ['6464bae6-8984-4b7b-bd44-f153d8387728', '4386d79b-9e12-4214-beb9-0e3eb5f7e344', '11d94a27-7fd6-45a9-a432-6ee2451bf84a', 'f94c7b47-b5e8-49db-96cf-0b29a18627be'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:21:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d811054a-d8f5-493f-8966-4f20ed6cd655 tempest-TestMinimumBasicScenario-957363426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:21:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d811054a-d8f5-493f-8966-4f20ed6cd655 tempest-TestMinimumBasicScenario-957363426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:21:53 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d811054a-d8f5-493f-8966-4f20ed6cd655 tempest-TestMinimumBasicScenario-957363426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:21:53 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d811054a-d8f5-493f-8966-4f20ed6cd655 tempest-TestMinimumBasicScenario-957363426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:21:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d811054a-d8f5-493f-8966-4f20ed6cd655 tempest-TestMinimumBasicScenario-957363426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:21:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d811054a-d8f5-493f-8966-4f20ed6cd655 tempest-TestMinimumBasicScenario-957363426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:21:53 devstack sudo[99429]: pam_unix(sudo:session): session closed for user root Nov 04 12:21:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7ffe4def-8f2e-4568-ba48-68ed938c83df tempest-TestStampPattern-979127523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ff7aff92-ea95-4882-b1bd-9a444df50764 1073741824" returned: 0 in 0.711s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:21:53 devstack sudo[99436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:21:53 devstack sudo[99436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:21:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7ffe4def-8f2e-4568-ba48-68ed938c83df tempest-TestStampPattern-979127523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ff7aff92-ea95-4882-b1bd-9a444df50764 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:21:53 devstack sudo[99438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ff7aff92-ea95-4882-b1bd-9a444df50764 Nov 04 12:21:53 devstack sudo[99438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:21:54 devstack sudo[99436]: pam_unix(sudo:session): session closed for user root Nov 04 12:21:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d811054a-d8f5-493f-8966-4f20ed6cd655 tempest-TestMinimumBasicScenario-957363426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.716s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:21:54 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-d811054a-d8f5-493f-8966-4f20ed6cd655 tempest-TestMinimumBasicScenario-957363426 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:21:54 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-d811054a-d8f5-493f-8966-4f20ed6cd655 tempest-TestMinimumBasicScenario-957363426 None] Deleted volume successfully. Nov 04 12:21:54 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-d811054a-d8f5-493f-8966-4f20ed6cd655 tempest-TestMinimumBasicScenario-957363426 None] Lock "cinder-fcacd0c9-1bb9-40c6-9e09-a7a4b4b1d2e3-delete_volume" released by "delete_volume" :: held 2.450s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:21:54 devstack sudo[99438]: pam_unix(sudo:session): session closed for user root Nov 04 12:21:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7ffe4def-8f2e-4568-ba48-68ed938c83df tempest-TestStampPattern-979127523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ff7aff92-ea95-4882-b1bd-9a444df50764" returned: 0 in 0.800s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:21:54 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7ffe4def-8f2e-4568-ba48-68ed938c83df tempest-TestStampPattern-979127523 None] <== create_volume: return (1571ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:21:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7ffe4def-8f2e-4568-ba48-68ed938c83df tempest-TestStampPattern-979127523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.575s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:21:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7ffe4def-8f2e-4568-ba48-68ed938c83df tempest-TestStampPattern-979127523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ab91476-1f9d-4984-b20e-0ecb46bb25e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff7aff92-ea95-4882-b1bd-9a444df50764', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:21:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7ffe4def-8f2e-4568-ba48-68ed938c83df tempest-TestStampPattern-979127523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1295f6a2-5a9a-4e3e-bb11-59230d4fac2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:21:54 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-7ffe4def-8f2e-4568-ba48-68ed938c83df tempest-TestStampPattern-979127523 None] Volume volume-ff7aff92-ea95-4882-b1bd-9a444df50764 (ff7aff92-ea95-4882-b1bd-9a444df50764): created successfully Nov 04 12:21:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7ffe4def-8f2e-4568-ba48-68ed938c83df tempest-TestStampPattern-979127523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1295f6a2-5a9a-4e3e-bb11-59230d4fac2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:21:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7ffe4def-8f2e-4568-ba48-68ed938c83df tempest-TestStampPattern-979127523 None] Flow 'volume_create_manager' (46374dc0-7244-48dc-a9e6-bb45437ed554) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:21:54 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-7ffe4def-8f2e-4568-ba48-68ed938c83df tempest-TestStampPattern-979127523 None] Created volume successfully. Nov 04 12:22:01 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 12:22:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:22:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:22:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:22:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:22:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:22:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:22:01 devstack sudo[99547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:22:01 devstack sudo[99547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:22:02 devstack sudo[99547]: pam_unix(sudo:session): session closed for user root Nov 04 12:22:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.356s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:22:02 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:22:02 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Running periodic task VolumeManager._thread_info {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 12:22:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] thread count: 28 {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 12:22:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] thread info: [<_MainThread(MainThread, started 140610387472512)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 12:22:04 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=9,cinder:UPDATE=13,cinder:INSERT=3 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 12:22:04 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=7,cinder:UPDATE=9,cinder:INSERT=2,cinder:DELETE=2 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 12:22:08 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfc97064-6f2e-464e-8175-29bca1c8139b tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:22:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dfc97064-6f2e-464e-8175-29bca1c8139b tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] Flow 'volume_create_manager' (83521f21-ae09-48cf-bb72-ef056b89bcf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:22:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dfc97064-6f2e-464e-8175-29bca1c8139b tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19247dc0-7b19-44cf-93f5-df1bce1633d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:22:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dfc97064-6f2e-464e-8175-29bca1c8139b tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19247dc0-7b19-44cf-93f5-df1bce1633d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47f451c6-91d4-43f2-a0c9-405f10c2a248,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='323e4729f06d431c9bb8ec7a4806407b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:22:09Z,use_quota=True,user_id='90f671337719410fbb050149fa0a8b0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(350fe80c-ae5a-4afa-b1e7-33c022df82ed),volume_type_id=350fe80c-ae5a-4afa-b1e7-33c022df82ed)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:22:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dfc97064-6f2e-464e-8175-29bca1c8139b tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e78cfc77-eb4d-40ac-a37f-8684784c5804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:22:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dfc97064-6f2e-464e-8175-29bca1c8139b tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e78cfc77-eb4d-40ac-a37f-8684784c5804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:22:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dfc97064-6f2e-464e-8175-29bca1c8139b tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18f23423-f8ab-4356-9dad-36fa7d0d154a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:22:08 devstack cinder-volume[87095]: DEBUG cinder.image.glance [None req-dfc97064-6f2e-464e-8175-29bca1c8139b tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] Creating Keystone auth plugin from conf {{(pid=87095) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 04 12:22:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dfc97064-6f2e-464e-8175-29bca1c8139b tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18f23423-f8ab-4356-9dad-36fa7d0d154a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '47f451c6-91d4-43f2-a0c9-405f10c2a248', 'volume_name': 'volume-47f451c6-91d4-43f2-a0c9-405f10c2a248', 'volume_size': 1, 'image_id': 'e43e8168-ae51-4122-81ac-9c06506422cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e43e8168-ae51-4122-81ac-9c06506422cf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8bf26e2426b5c665263c19f0fabad018', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '323e4729f06d431c9bb8ec7a4806407b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5e47b9cd8010806fcaca3b35ba5dd7eb57b55761a38b36e9a454ed37070664017acb713910152cbd9ce6060bdd4b11a298bc2e0555fde967b926aecf34407c87', 'id': 'e43e8168-ae51-4122-81ac-9c06506422cf', 'created_at': datetime.datetime(2026, 11, 4, 11, 22, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 11, 22, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e43e8168-ae51-4122-81ac-9c06506422cf/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:22:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dfc97064-6f2e-464e-8175-29bca1c8139b tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ed2b80c-8079-485a-90a7-32ea3840cb27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:22:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dfc97064-6f2e-464e-8175-29bca1c8139b tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ed2b80c-8079-485a-90a7-32ea3840cb27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:22:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dfc97064-6f2e-464e-8175-29bca1c8139b tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ace9958-65b2-4803-a49d-6638a4503e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:22:09 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-dfc97064-6f2e-464e-8175-29bca1c8139b tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] Volume 47f451c6-91d4-43f2-a0c9-405f10c2a248: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-47f451c6-91d4-43f2-a0c9-405f10c2a248', 'volume_size': 1, 'image_id': 'e43e8168-ae51-4122-81ac-9c06506422cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e43e8168-ae51-4122-81ac-9c06506422cf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8bf26e2426b5c665263c19f0fabad018', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '323e4729f06d431c9bb8ec7a4806407b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5e47b9cd8010806fcaca3b35ba5dd7eb57b55761a38b36e9a454ed37070664017acb713910152cbd9ce6060bdd4b11a298bc2e0555fde967b926aecf34407c87', 'id': 'e43e8168-ae51-4122-81ac-9c06506422cf', 'created_at': datetime.datetime(2026, 11, 4, 11, 22, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 11, 22, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e43e8168-ae51-4122-81ac-9c06506422cf/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 04 12:22:09 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfc97064-6f2e-464e-8175-29bca1c8139b tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] Trying to clone 47f451c6-91d4-43f2-a0c9-405f10c2a248 from image e43e8168-ae51-4122-81ac-9c06506422cf at location (None, [{'url': 'file:///opt/stack/data/glance/images/e43e8168-ae51-4122-81ac-9c06506422cf', 'metadata': {}}]). {{(pid=87095) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 04 12:22:09 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-dfc97064-6f2e-464e-8175-29bca1c8139b tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e43e8168-ae51-4122-81ac-9c06506422cf_xci0iyj9devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87095) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 04 12:22:09 devstack cinder-volume[87095]: INFO cinder.image.image_utils [None req-dfc97064-6f2e-464e-8175-29bca1c8139b tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] Image download 0.00 MB at 0.00 MB/s Nov 04 12:22:10 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fdae0ec-7cd1-4c8d-bb1c-de1a0b4ace61]: (4, 'raw') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:22:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-dfc97064-6f2e-464e-8175-29bca1c8139b tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e43e8168-ae51-4122-81ac-9c06506422cf_xci0iyj9devstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:22:10 devstack sudo[99625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e43e8168-ae51-4122-81ac-9c06506422cf_xci0iyj9devstack@QuobyteHD Nov 04 12:22:10 devstack sudo[99625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:22:10 devstack sudo[99625]: pam_unix(sudo:session): session closed for user root Nov 04 12:22:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-dfc97064-6f2e-464e-8175-29bca1c8139b tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e43e8168-ae51-4122-81ac-9c06506422cf_xci0iyj9devstack@QuobyteHD" returned: 0 in 0.669s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:22:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-dfc97064-6f2e-464e-8175-29bca1c8139b tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e43e8168-ae51-4122-81ac-9c06506422cf_xci0iyj9devstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:22:10 devstack sudo[99629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e43e8168-ae51-4122-81ac-9c06506422cf_xci0iyj9devstack@QuobyteHD Nov 04 12:22:10 devstack sudo[99629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:22:11 devstack sudo[99629]: pam_unix(sudo:session): session closed for user root Nov 04 12:22:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-dfc97064-6f2e-464e-8175-29bca1c8139b tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e43e8168-ae51-4122-81ac-9c06506422cf_xci0iyj9devstack@QuobyteHD" returned: 1 in 0.765s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:22:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-dfc97064-6f2e-464e-8175-29bca1c8139b tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e43e8168-ae51-4122-81ac-9c06506422cf_xci0iyj9devstack@QuobyteHD' failed. Not Retrying. {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 12:22:11 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-dfc97064-6f2e-464e-8175-29bca1c8139b tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] Temporary image e43e8168-ae51-4122-81ac-9c06506422cf is fetched for user 90f671337719410fbb050149fa0a8b0a. {{(pid=87095) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 04 12:22:11 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a49757e-a765-4105-bd2a-2a89301c4a6c]: (4, 'raw') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:22:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-dfc97064-6f2e-464e-8175-29bca1c8139b tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e43e8168-ae51-4122-81ac-9c06506422cf_xci0iyj9devstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:22:11 devstack sudo[99634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e43e8168-ae51-4122-81ac-9c06506422cf_xci0iyj9devstack@QuobyteHD Nov 04 12:22:11 devstack sudo[99634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:22:12 devstack sudo[99634]: pam_unix(sudo:session): session closed for user root Nov 04 12:22:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-dfc97064-6f2e-464e-8175-29bca1c8139b tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e43e8168-ae51-4122-81ac-9c06506422cf_xci0iyj9devstack@QuobyteHD" returned: 0 in 0.747s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:22:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-dfc97064-6f2e-464e-8175-29bca1c8139b tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e43e8168-ae51-4122-81ac-9c06506422cf_xci0iyj9devstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:22:12 devstack sudo[99639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e43e8168-ae51-4122-81ac-9c06506422cf_xci0iyj9devstack@QuobyteHD Nov 04 12:22:12 devstack sudo[99639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:22:13 devstack sudo[99639]: pam_unix(sudo:session): session closed for user root Nov 04 12:22:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-dfc97064-6f2e-464e-8175-29bca1c8139b tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e43e8168-ae51-4122-81ac-9c06506422cf_xci0iyj9devstack@QuobyteHD" returned: 1 in 0.895s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:22:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-dfc97064-6f2e-464e-8175-29bca1c8139b tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e43e8168-ae51-4122-81ac-9c06506422cf_xci0iyj9devstack@QuobyteHD' failed. Not Retrying. {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 12:22:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-dfc97064-6f2e-464e-8175-29bca1c8139b tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:22:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-dfc97064-6f2e-464e-8175-29bca1c8139b tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:22:13 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-dfc97064-6f2e-464e-8175-29bca1c8139b tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47f451c6-91d4-43f2-a0c9-405f10c2a248,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='323e4729f06d431c9bb8ec7a4806407b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:22:09Z,use_quota=True,user_id='90f671337719410fbb050149fa0a8b0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(350fe80c-ae5a-4afa-b1e7-33c022df82ed),volume_type_id=350fe80c-ae5a-4afa-b1e7-33c022df82ed)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:22:13 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-dfc97064-6f2e-464e-8175-29bca1c8139b tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] Creating volume 47f451c6-91d4-43f2-a0c9-405f10c2a248 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:22:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-dfc97064-6f2e-464e-8175-29bca1c8139b tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:22:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-dfc97064-6f2e-464e-8175-29bca1c8139b tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:22:13 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-dfc97064-6f2e-464e-8175-29bca1c8139b tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:22:13 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-dfc97064-6f2e-464e-8175-29bca1c8139b tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:22:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-dfc97064-6f2e-464e-8175-29bca1c8139b tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:22:13 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-dfc97064-6f2e-464e-8175-29bca1c8139b tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:22:13 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-dfc97064-6f2e-464e-8175-29bca1c8139b tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:22:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-dfc97064-6f2e-464e-8175-29bca1c8139b tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-47f451c6-91d4-43f2-a0c9-405f10c2a248 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:22:13 devstack sudo[99645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-47f451c6-91d4-43f2-a0c9-405f10c2a248 1073741824 Nov 04 12:22:13 devstack sudo[99645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:22:14 devstack sudo[99645]: pam_unix(sudo:session): session closed for user root Nov 04 12:22:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-dfc97064-6f2e-464e-8175-29bca1c8139b tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-47f451c6-91d4-43f2-a0c9-405f10c2a248 1073741824" returned: 0 in 1.078s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:22:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-dfc97064-6f2e-464e-8175-29bca1c8139b tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-47f451c6-91d4-43f2-a0c9-405f10c2a248 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:22:14 devstack sudo[99687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-47f451c6-91d4-43f2-a0c9-405f10c2a248 Nov 04 12:22:14 devstack sudo[99687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:22:14 devstack sudo[99687]: pam_unix(sudo:session): session closed for user root Nov 04 12:22:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-dfc97064-6f2e-464e-8175-29bca1c8139b tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-47f451c6-91d4-43f2-a0c9-405f10c2a248" returned: 0 in 0.308s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:22:14 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-dfc97064-6f2e-464e-8175-29bca1c8139b tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] <== create_volume: return (1478ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:22:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-dfc97064-6f2e-464e-8175-29bca1c8139b tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.485s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:22:14 devstack cinder-volume[87095]: DEBUG cinder.volume.volume_utils [None req-dfc97064-6f2e-464e-8175-29bca1c8139b tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] Attempting download of e43e8168-ae51-4122-81ac-9c06506422cf ((None, [{'url': 'file:///opt/stack/data/glance/images/e43e8168-ae51-4122-81ac-9c06506422cf', 'metadata': {}}])) to volume 47f451c6-91d4-43f2-a0c9-405f10c2a248. {{(pid=87095) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 04 12:22:14 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[68aad75b-e6d5-4a3e-9ba3-fb0b3fd32c3b]: (4, 'raw') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:22:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-dfc97064-6f2e-464e-8175-29bca1c8139b tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e43e8168-ae51-4122-81ac-9c06506422cf_ku46odhd {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:22:14 devstack sudo[99691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e43e8168-ae51-4122-81ac-9c06506422cf_ku46odhd Nov 04 12:22:14 devstack sudo[99691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:22:15 devstack sudo[99691]: pam_unix(sudo:session): session closed for user root Nov 04 12:22:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-dfc97064-6f2e-464e-8175-29bca1c8139b tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e43e8168-ae51-4122-81ac-9c06506422cf_ku46odhd" returned: 0 in 0.372s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:22:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-dfc97064-6f2e-464e-8175-29bca1c8139b tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e43e8168-ae51-4122-81ac-9c06506422cf_ku46odhd {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:22:15 devstack sudo[99695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e43e8168-ae51-4122-81ac-9c06506422cf_ku46odhd Nov 04 12:22:15 devstack sudo[99695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:22:15 devstack sudo[99695]: pam_unix(sudo:session): session closed for user root Nov 04 12:22:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-dfc97064-6f2e-464e-8175-29bca1c8139b tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e43e8168-ae51-4122-81ac-9c06506422cf_ku46odhd" returned: 1 in 0.437s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:22:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-dfc97064-6f2e-464e-8175-29bca1c8139b tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e43e8168-ae51-4122-81ac-9c06506422cf_ku46odhd' failed. Not Retrying. {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 12:22:15 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[340cea4e-b821-498d-8715-988c752dc7b0]: (4, 'raw') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:22:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-dfc97064-6f2e-464e-8175-29bca1c8139b tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e43e8168-ae51-4122-81ac-9c06506422cf_xci0iyj9devstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:22:15 devstack sudo[99700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e43e8168-ae51-4122-81ac-9c06506422cf_xci0iyj9devstack@QuobyteHD Nov 04 12:22:15 devstack sudo[99700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:22:16 devstack sudo[99700]: pam_unix(sudo:session): session closed for user root Nov 04 12:22:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-dfc97064-6f2e-464e-8175-29bca1c8139b tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e43e8168-ae51-4122-81ac-9c06506422cf_xci0iyj9devstack@QuobyteHD" returned: 0 in 0.404s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:22:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-dfc97064-6f2e-464e-8175-29bca1c8139b tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e43e8168-ae51-4122-81ac-9c06506422cf_xci0iyj9devstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:22:16 devstack sudo[99704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e43e8168-ae51-4122-81ac-9c06506422cf_xci0iyj9devstack@QuobyteHD Nov 04 12:22:16 devstack sudo[99704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:22:16 devstack sudo[99704]: pam_unix(sudo:session): session closed for user root Nov 04 12:22:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-dfc97064-6f2e-464e-8175-29bca1c8139b tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e43e8168-ae51-4122-81ac-9c06506422cf_xci0iyj9devstack@QuobyteHD" returned: 1 in 0.426s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:22:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-dfc97064-6f2e-464e-8175-29bca1c8139b tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e43e8168-ae51-4122-81ac-9c06506422cf_xci0iyj9devstack@QuobyteHD' failed. Not Retrying. {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 12:22:16 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-dfc97064-6f2e-464e-8175-29bca1c8139b tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] e43e8168-ae51-4122-81ac-9c06506422cf was raw, converting to qcow2 {{(pid=87095) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 04 12:22:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-dfc97064-6f2e-464e-8175-29bca1c8139b tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e43e8168-ae51-4122-81ac-9c06506422cf_xci0iyj9devstack@QuobyteHD /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-47f451c6-91d4-43f2-a0c9-405f10c2a248 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:22:16 devstack sudo[99710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e43e8168-ae51-4122-81ac-9c06506422cf_xci0iyj9devstack@QuobyteHD /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-47f451c6-91d4-43f2-a0c9-405f10c2a248 Nov 04 12:22:16 devstack sudo[99710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:22:17 devstack sudo[99710]: pam_unix(sudo:session): session closed for user root Nov 04 12:22:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-dfc97064-6f2e-464e-8175-29bca1c8139b tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e43e8168-ae51-4122-81ac-9c06506422cf_xci0iyj9devstack@QuobyteHD /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-47f451c6-91d4-43f2-a0c9-405f10c2a248" returned: 0 in 0.577s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:22:17 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-dfc97064-6f2e-464e-8175-29bca1c8139b tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e43e8168-ae51-4122-81ac-9c06506422cf_xci0iyj9devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-47f451c6-91d4-43f2-a0c9-405f10c2a248 {{(pid=87095) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 12:22:17 devstack cinder-volume[87095]: INFO cinder.image.image_utils [None req-dfc97064-6f2e-464e-8175-29bca1c8139b tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] Converted 0.00 MB image at 0.00 MB/s Nov 04 12:22:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-dfc97064-6f2e-464e-8175-29bca1c8139b tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-47f451c6-91d4-43f2-a0c9-405f10c2a248 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:22:17 devstack sudo[99715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-47f451c6-91d4-43f2-a0c9-405f10c2a248 1G Nov 04 12:22:17 devstack sudo[99715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:22:17 devstack sudo[99715]: pam_unix(sudo:session): session closed for user root Nov 04 12:22:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-dfc97064-6f2e-464e-8175-29bca1c8139b tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-47f451c6-91d4-43f2-a0c9-405f10c2a248 1G" returned: 0 in 0.395s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:22:17 devstack cinder-volume[87095]: DEBUG cinder.volume.volume_utils [None req-dfc97064-6f2e-464e-8175-29bca1c8139b tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] Downloaded image e43e8168-ae51-4122-81ac-9c06506422cf ((None, [{'url': 'file:///opt/stack/data/glance/images/e43e8168-ae51-4122-81ac-9c06506422cf', 'metadata': {}}])) to volume 47f451c6-91d4-43f2-a0c9-405f10c2a248 successfully. {{(pid=87095) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 04 12:22:17 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-dfc97064-6f2e-464e-8175-29bca1c8139b tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] Temporary image e43e8168-ae51-4122-81ac-9c06506422cf for user 90f671337719410fbb050149fa0a8b0a is deleted. {{(pid=87095) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 04 12:22:17 devstack cinder-volume[87095]: DEBUG cinder.volume.volume_utils [None req-dfc97064-6f2e-464e-8175-29bca1c8139b tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] Marking volume 47f451c6-91d4-43f2-a0c9-405f10c2a248 as bootable. {{(pid=87095) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 04 12:22:17 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfc97064-6f2e-464e-8175-29bca1c8139b tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] Copying metadata from image e43e8168-ae51-4122-81ac-9c06506422cf to 47f451c6-91d4-43f2-a0c9-405f10c2a248. {{(pid=87095) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 04 12:22:17 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfc97064-6f2e-464e-8175-29bca1c8139b tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] Creating volume glance metadata for volume 47f451c6-91d4-43f2-a0c9-405f10c2a248 backed by image e43e8168-ae51-4122-81ac-9c06506422cf with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'e43e8168-ae51-4122-81ac-9c06506422cf', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '8bf26e2426b5c665263c19f0fabad018', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87095) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 04 12:22:17 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dfc97064-6f2e-464e-8175-29bca1c8139b tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ace9958-65b2-4803-a49d-6638a4503e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47f451c6-91d4-43f2-a0c9-405f10c2a248', 'volume_size': 1, 'image_id': 'e43e8168-ae51-4122-81ac-9c06506422cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e43e8168-ae51-4122-81ac-9c06506422cf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8bf26e2426b5c665263c19f0fabad018', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '323e4729f06d431c9bb8ec7a4806407b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5e47b9cd8010806fcaca3b35ba5dd7eb57b55761a38b36e9a454ed37070664017acb713910152cbd9ce6060bdd4b11a298bc2e0555fde967b926aecf34407c87', 'id': 'e43e8168-ae51-4122-81ac-9c06506422cf', 'created_at': datetime.datetime(2026, 11, 4, 11, 22, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 11, 22, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e43e8168-ae51-4122-81ac-9c06506422cf/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:22:17 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dfc97064-6f2e-464e-8175-29bca1c8139b tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (916392ff-ceae-49a6-a3c0-6e4d05f0aab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:22:17 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-dfc97064-6f2e-464e-8175-29bca1c8139b tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] Volume volume-47f451c6-91d4-43f2-a0c9-405f10c2a248 (47f451c6-91d4-43f2-a0c9-405f10c2a248): created successfully Nov 04 12:22:17 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dfc97064-6f2e-464e-8175-29bca1c8139b tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (916392ff-ceae-49a6-a3c0-6e4d05f0aab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:22:17 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dfc97064-6f2e-464e-8175-29bca1c8139b tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] Flow 'volume_create_manager' (83521f21-ae09-48cf-bb72-ef056b89bcf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:22:17 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-dfc97064-6f2e-464e-8175-29bca1c8139b tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] Created volume successfully. Nov 04 12:22:18 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-39e4ea14-c431-4470-8093-723060b8f2f7 tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] Acquiring lock "cinder-47f451c6-91d4-43f2-a0c9-405f10c2a248-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:22:18 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-39e4ea14-c431-4470-8093-723060b8f2f7 tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] Lock "cinder-47f451c6-91d4-43f2-a0c9-405f10c2a248-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:22:18 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-39e4ea14-c431-4470-8093-723060b8f2f7 tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] Acquiring lock "cinder-quobyte-47f451c6-91d4-43f2-a0c9-405f10c2a248" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:22:18 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-39e4ea14-c431-4470-8093-723060b8f2f7 tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] Lock "cinder-quobyte-47f451c6-91d4-43f2-a0c9-405f10c2a248" acquired by "delete_volume" :: waited 0.022s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:22:18 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e51174-5f61-48a8-912e-2ae31c64bee0]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:22:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-39e4ea14-c431-4470-8093-723060b8f2f7 tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-47f451c6-91d4-43f2-a0c9-405f10c2a248 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:22:18 devstack sudo[99723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-47f451c6-91d4-43f2-a0c9-405f10c2a248 Nov 04 12:22:18 devstack sudo[99723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:22:19 devstack sudo[99723]: pam_unix(sudo:session): session closed for user root Nov 04 12:22:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-39e4ea14-c431-4470-8093-723060b8f2f7 tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-47f451c6-91d4-43f2-a0c9-405f10c2a248" returned: 0 in 0.437s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:22:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-39e4ea14-c431-4470-8093-723060b8f2f7 tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-47f451c6-91d4-43f2-a0c9-405f10c2a248 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:22:19 devstack sudo[99746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-47f451c6-91d4-43f2-a0c9-405f10c2a248 Nov 04 12:22:19 devstack sudo[99746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:22:19 devstack sudo[99746]: pam_unix(sudo:session): session closed for user root Nov 04 12:22:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-39e4ea14-c431-4470-8093-723060b8f2f7 tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-47f451c6-91d4-43f2-a0c9-405f10c2a248" returned: 0 in 0.282s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:22:19 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-39e4ea14-c431-4470-8093-723060b8f2f7 tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] Lock "cinder-quobyte-47f451c6-91d4-43f2-a0c9-405f10c2a248" released by "delete_volume" :: held 0.788s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:22:19 devstack cinder-volume[87095]: WARNING cinder.quota [None req-39e4ea14-c431-4470-8093-723060b8f2f7 tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 04 12:22:19 devstack cinder-volume[87095]: WARNING cinder.quota [None req-39e4ea14-c431-4470-8093-723060b8f2f7 tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 04 12:22:19 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-39e4ea14-c431-4470-8093-723060b8f2f7 tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] Created reservations ['e843f3b3-b41b-47e8-9787-b9bdb4574489', '82c6ce07-81d6-4bfe-8fbb-e75bf982a852', '745c4a7b-b491-4857-9986-3bbdda4ac019', '5c020620-3d1e-4080-8085-92781849fd6a'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:22:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-39e4ea14-c431-4470-8093-723060b8f2f7 tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:22:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-39e4ea14-c431-4470-8093-723060b8f2f7 tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:22:19 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-39e4ea14-c431-4470-8093-723060b8f2f7 tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:22:19 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-39e4ea14-c431-4470-8093-723060b8f2f7 tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:22:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-39e4ea14-c431-4470-8093-723060b8f2f7 tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:22:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-39e4ea14-c431-4470-8093-723060b8f2f7 tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:22:19 devstack sudo[99749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:22:19 devstack sudo[99749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:22:20 devstack sudo[99749]: pam_unix(sudo:session): session closed for user root Nov 04 12:22:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-39e4ea14-c431-4470-8093-723060b8f2f7 tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.337s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:22:20 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-39e4ea14-c431-4470-8093-723060b8f2f7 tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:22:20 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-39e4ea14-c431-4470-8093-723060b8f2f7 tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] Deleted volume successfully. Nov 04 12:22:20 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-39e4ea14-c431-4470-8093-723060b8f2f7 tempest-VolumeAndVolumeTypeFromImageTest-1591555699 None] Lock "cinder-47f451c6-91d4-43f2-a0c9-405f10c2a248-delete_volume" released by "delete_volume" :: held 1.386s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:22:25 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-be862b89-cf52-4416-a0a2-d9c884044b35 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:22:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-be862b89-cf52-4416-a0a2-d9c884044b35 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Flow 'volume_create_manager' (43467ead-8419-4a02-84bd-e7edbd7624d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:22:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-be862b89-cf52-4416-a0a2-d9c884044b35 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1933d73d-3229-474f-b580-1c4b1b2766f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:22:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-be862b89-cf52-4416-a0a2-d9c884044b35 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1933d73d-3229-474f-b580-1c4b1b2766f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:22:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1310443731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4cbaf1a-df77-4cab-af3f-3142eb34ac70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3974be693db744cdb79bc7e12c67b63b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:22:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:22:25Z,use_quota=True,user_id='71e1976370b642d8a8ee1d5d06da60cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:22:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-be862b89-cf52-4416-a0a2-d9c884044b35 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d821992-ff65-4ad8-b599-4884f47e2c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:22:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-be862b89-cf52-4416-a0a2-d9c884044b35 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d821992-ff65-4ad8-b599-4884f47e2c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:22:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-be862b89-cf52-4416-a0a2-d9c884044b35 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a62e7df-bec9-45e9-ac32-34a0dc674fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:22:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-be862b89-cf52-4416-a0a2-d9c884044b35 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a62e7df-bec9-45e9-ac32-34a0dc674fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4cbaf1a-df77-4cab-af3f-3142eb34ac70', 'volume_name': 'volume-b4cbaf1a-df77-4cab-af3f-3142eb34ac70', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:22:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-be862b89-cf52-4416-a0a2-d9c884044b35 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bada7112-d009-4e2f-829f-c3c1d809f34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:22:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-be862b89-cf52-4416-a0a2-d9c884044b35 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bada7112-d009-4e2f-829f-c3c1d809f34f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:22:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-be862b89-cf52-4416-a0a2-d9c884044b35 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66e74828-647c-4b51-82fa-6d6d87904bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:22:25 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-be862b89-cf52-4416-a0a2-d9c884044b35 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Volume b4cbaf1a-df77-4cab-af3f-3142eb34ac70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4cbaf1a-df77-4cab-af3f-3142eb34ac70', 'volume_size': 1} Nov 04 12:22:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-be862b89-cf52-4416-a0a2-d9c884044b35 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:22:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-be862b89-cf52-4416-a0a2-d9c884044b35 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:22:25 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-be862b89-cf52-4416-a0a2-d9c884044b35 tempest-CreateVolumesFromSnapshotTest-1883912193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:22:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1310443731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4cbaf1a-df77-4cab-af3f-3142eb34ac70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3974be693db744cdb79bc7e12c67b63b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:22:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:22:25Z,use_quota=True,user_id='71e1976370b642d8a8ee1d5d06da60cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:22:25 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-be862b89-cf52-4416-a0a2-d9c884044b35 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Creating volume b4cbaf1a-df77-4cab-af3f-3142eb34ac70 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:22:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-be862b89-cf52-4416-a0a2-d9c884044b35 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:22:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-be862b89-cf52-4416-a0a2-d9c884044b35 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:22:25 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-be862b89-cf52-4416-a0a2-d9c884044b35 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:22:25 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-be862b89-cf52-4416-a0a2-d9c884044b35 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:22:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-be862b89-cf52-4416-a0a2-d9c884044b35 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:22:25 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-be862b89-cf52-4416-a0a2-d9c884044b35 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:22:25 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-be862b89-cf52-4416-a0a2-d9c884044b35 tempest-CreateVolumesFromSnapshotTest-1883912193 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:22:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-be862b89-cf52-4416-a0a2-d9c884044b35 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b4cbaf1a-df77-4cab-af3f-3142eb34ac70 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:22:25 devstack sudo[99753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b4cbaf1a-df77-4cab-af3f-3142eb34ac70 1073741824 Nov 04 12:22:25 devstack sudo[99753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:22:25 devstack sudo[99753]: pam_unix(sudo:session): session closed for user root Nov 04 12:22:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-be862b89-cf52-4416-a0a2-d9c884044b35 tempest-CreateVolumesFromSnapshotTest-1883912193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b4cbaf1a-df77-4cab-af3f-3142eb34ac70 1073741824" returned: 0 in 0.484s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:22:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-be862b89-cf52-4416-a0a2-d9c884044b35 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b4cbaf1a-df77-4cab-af3f-3142eb34ac70 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:22:25 devstack sudo[99759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b4cbaf1a-df77-4cab-af3f-3142eb34ac70 Nov 04 12:22:25 devstack sudo[99759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:22:25 devstack sudo[99759]: pam_unix(sudo:session): session closed for user root Nov 04 12:22:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-be862b89-cf52-4416-a0a2-d9c884044b35 tempest-CreateVolumesFromSnapshotTest-1883912193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b4cbaf1a-df77-4cab-af3f-3142eb34ac70" returned: 0 in 0.250s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:22:25 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-be862b89-cf52-4416-a0a2-d9c884044b35 tempest-CreateVolumesFromSnapshotTest-1883912193 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:22:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-be862b89-cf52-4416-a0a2-d9c884044b35 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:22:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-be862b89-cf52-4416-a0a2-d9c884044b35 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66e74828-647c-4b51-82fa-6d6d87904bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4cbaf1a-df77-4cab-af3f-3142eb34ac70', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:22:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-be862b89-cf52-4416-a0a2-d9c884044b35 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0df9b584-3bd3-408b-8bf8-aa0c54fddeb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:22:25 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-be862b89-cf52-4416-a0a2-d9c884044b35 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Volume volume-b4cbaf1a-df77-4cab-af3f-3142eb34ac70 (b4cbaf1a-df77-4cab-af3f-3142eb34ac70): created successfully Nov 04 12:22:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-be862b89-cf52-4416-a0a2-d9c884044b35 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0df9b584-3bd3-408b-8bf8-aa0c54fddeb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:22:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-be862b89-cf52-4416-a0a2-d9c884044b35 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Flow 'volume_create_manager' (43467ead-8419-4a02-84bd-e7edbd7624d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:22:25 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-be862b89-cf52-4416-a0a2-d9c884044b35 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Created volume successfully. Nov 04 12:22:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-00782435-1365-4b08-8386-46e081318438 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:22:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-00782435-1365-4b08-8386-46e081318438 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:22:26 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-00782435-1365-4b08-8386-46e081318438 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Creating offline snapshot b8c3a578-cdbc-421a-a73b-bb39fb65f88e of volume b4cbaf1a-df77-4cab-af3f-3142eb34ac70 {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 12:22:26 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1ec0c1-b9ac-46bd-86ff-e4dd4707fdb3]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:22:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-00782435-1365-4b08-8386-46e081318438 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b4cbaf1a-df77-4cab-af3f-3142eb34ac70 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:22:26 devstack sudo[99762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b4cbaf1a-df77-4cab-af3f-3142eb34ac70 Nov 04 12:22:26 devstack sudo[99762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:22:26 devstack sudo[99762]: pam_unix(sudo:session): session closed for user root Nov 04 12:22:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-00782435-1365-4b08-8386-46e081318438 tempest-CreateVolumesFromSnapshotTest-1883912193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b4cbaf1a-df77-4cab-af3f-3142eb34ac70" returned: 0 in 0.616s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:22:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-00782435-1365-4b08-8386-46e081318438 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b4cbaf1a-df77-4cab-af3f-3142eb34ac70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b4cbaf1a-df77-4cab-af3f-3142eb34ac70.b8c3a578-cdbc-421a-a73b-bb39fb65f88e 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:22:26 devstack sudo[99805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b4cbaf1a-df77-4cab-af3f-3142eb34ac70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b4cbaf1a-df77-4cab-af3f-3142eb34ac70.b8c3a578-cdbc-421a-a73b-bb39fb65f88e 1G Nov 04 12:22:26 devstack sudo[99805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:22:27 devstack sudo[99805]: pam_unix(sudo:session): session closed for user root Nov 04 12:22:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-00782435-1365-4b08-8386-46e081318438 tempest-CreateVolumesFromSnapshotTest-1883912193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b4cbaf1a-df77-4cab-af3f-3142eb34ac70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b4cbaf1a-df77-4cab-af3f-3142eb34ac70.b8c3a578-cdbc-421a-a73b-bb39fb65f88e 1G" returned: 0 in 0.762s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:22:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-00782435-1365-4b08-8386-46e081318438 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4cbaf1a-df77-4cab-af3f-3142eb34ac70 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b4cbaf1a-df77-4cab-af3f-3142eb34ac70.b8c3a578-cdbc-421a-a73b-bb39fb65f88e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:22:27 devstack sudo[99812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4cbaf1a-df77-4cab-af3f-3142eb34ac70 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b4cbaf1a-df77-4cab-af3f-3142eb34ac70.b8c3a578-cdbc-421a-a73b-bb39fb65f88e Nov 04 12:22:27 devstack sudo[99812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:22:28 devstack sudo[99812]: pam_unix(sudo:session): session closed for user root Nov 04 12:22:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-00782435-1365-4b08-8386-46e081318438 tempest-CreateVolumesFromSnapshotTest-1883912193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4cbaf1a-df77-4cab-af3f-3142eb34ac70 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b4cbaf1a-df77-4cab-af3f-3142eb34ac70.b8c3a578-cdbc-421a-a73b-bb39fb65f88e" returned: 0 in 0.690s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:22:28 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-00782435-1365-4b08-8386-46e081318438 tempest-CreateVolumesFromSnapshotTest-1883912193 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b4cbaf1a-df77-4cab-af3f-3142eb34ac70.b8c3a578-cdbc-421a-a73b-bb39fb65f88e is being set with open permissions: ugo+rw Nov 04 12:22:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-00782435-1365-4b08-8386-46e081318438 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b4cbaf1a-df77-4cab-af3f-3142eb34ac70.b8c3a578-cdbc-421a-a73b-bb39fb65f88e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:22:28 devstack sudo[99845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b4cbaf1a-df77-4cab-af3f-3142eb34ac70.b8c3a578-cdbc-421a-a73b-bb39fb65f88e Nov 04 12:22:28 devstack sudo[99845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:22:28 devstack sudo[99845]: pam_unix(sudo:session): session closed for user root Nov 04 12:22:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-00782435-1365-4b08-8386-46e081318438 tempest-CreateVolumesFromSnapshotTest-1883912193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b4cbaf1a-df77-4cab-af3f-3142eb34ac70.b8c3a578-cdbc-421a-a73b-bb39fb65f88e" returned: 0 in 0.339s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:22:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-00782435-1365-4b08-8386-46e081318438 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b4cbaf1a-df77-4cab-af3f-3142eb34ac70.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:22:28 devstack sudo[99849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b4cbaf1a-df77-4cab-af3f-3142eb34ac70.info Nov 04 12:22:28 devstack sudo[99849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:22:29 devstack sudo[99849]: pam_unix(sudo:session): session closed for user root Nov 04 12:22:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-00782435-1365-4b08-8386-46e081318438 tempest-CreateVolumesFromSnapshotTest-1883912193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b4cbaf1a-df77-4cab-af3f-3142eb34ac70.info" returned: 0 in 0.317s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:22:29 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-00782435-1365-4b08-8386-46e081318438 tempest-CreateVolumesFromSnapshotTest-1883912193 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b4cbaf1a-df77-4cab-af3f-3142eb34ac70.info is being set with open permissions: ugo+rw Nov 04 12:22:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-00782435-1365-4b08-8386-46e081318438 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b4cbaf1a-df77-4cab-af3f-3142eb34ac70.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:22:29 devstack sudo[99852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b4cbaf1a-df77-4cab-af3f-3142eb34ac70.info Nov 04 12:22:29 devstack sudo[99852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:22:29 devstack sudo[99852]: pam_unix(sudo:session): session closed for user root Nov 04 12:22:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-00782435-1365-4b08-8386-46e081318438 tempest-CreateVolumesFromSnapshotTest-1883912193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b4cbaf1a-df77-4cab-af3f-3142eb34ac70.info" returned: 0 in 0.274s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:22:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-00782435-1365-4b08-8386-46e081318438 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.109s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:22:29 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-00782435-1365-4b08-8386-46e081318438 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Create snapshot completed successfully Nov 04 12:22:31 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ff39563-1ba2-43e3-8667-6b93b1e1ed1d tempest-CreateVolumesFromSnapshotTest-1883912193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:22:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1ff39563-1ba2-43e3-8667-6b93b1e1ed1d tempest-CreateVolumesFromSnapshotTest-1883912193 None] Flow 'volume_create_manager' (7c5ddf73-1789-490f-9a00-93f88d46b04a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:22:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1ff39563-1ba2-43e3-8667-6b93b1e1ed1d tempest-CreateVolumesFromSnapshotTest-1883912193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cbf0a9c-7fe5-4021-b8ce-40d06ad65683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:22:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1ff39563-1ba2-43e3-8667-6b93b1e1ed1d tempest-CreateVolumesFromSnapshotTest-1883912193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cbf0a9c-7fe5-4021-b8ce-40d06ad65683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1123952032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=657e3336-9802-4f09-8748-2dc0c884bb82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3974be693db744cdb79bc7e12c67b63b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:22:31Z,use_quota=True,user_id='71e1976370b642d8a8ee1d5d06da60cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:22:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1ff39563-1ba2-43e3-8667-6b93b1e1ed1d tempest-CreateVolumesFromSnapshotTest-1883912193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4382604-14bc-4f65-8a9b-2e97fffe625e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:22:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1ff39563-1ba2-43e3-8667-6b93b1e1ed1d tempest-CreateVolumesFromSnapshotTest-1883912193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4382604-14bc-4f65-8a9b-2e97fffe625e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:22:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1ff39563-1ba2-43e3-8667-6b93b1e1ed1d tempest-CreateVolumesFromSnapshotTest-1883912193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5211907-b2d6-48d6-afcb-0a1e9dc733c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:22:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1ff39563-1ba2-43e3-8667-6b93b1e1ed1d tempest-CreateVolumesFromSnapshotTest-1883912193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5211907-b2d6-48d6-afcb-0a1e9dc733c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '657e3336-9802-4f09-8748-2dc0c884bb82', 'volume_name': 'volume-657e3336-9802-4f09-8748-2dc0c884bb82', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:22:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1ff39563-1ba2-43e3-8667-6b93b1e1ed1d tempest-CreateVolumesFromSnapshotTest-1883912193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fcb086c-4bf8-4b12-9256-d97f6e4c3fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:22:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1ff39563-1ba2-43e3-8667-6b93b1e1ed1d tempest-CreateVolumesFromSnapshotTest-1883912193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fcb086c-4bf8-4b12-9256-d97f6e4c3fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:22:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1ff39563-1ba2-43e3-8667-6b93b1e1ed1d tempest-CreateVolumesFromSnapshotTest-1883912193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90489030-fc97-4ac2-b8ad-5ed8d4884e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:22:31 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-1ff39563-1ba2-43e3-8667-6b93b1e1ed1d tempest-CreateVolumesFromSnapshotTest-1883912193 None] Volume 657e3336-9802-4f09-8748-2dc0c884bb82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-657e3336-9802-4f09-8748-2dc0c884bb82', 'volume_size': 1} Nov 04 12:22:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1ff39563-1ba2-43e3-8667-6b93b1e1ed1d tempest-CreateVolumesFromSnapshotTest-1883912193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:22:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1ff39563-1ba2-43e3-8667-6b93b1e1ed1d tempest-CreateVolumesFromSnapshotTest-1883912193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:22:31 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1ff39563-1ba2-43e3-8667-6b93b1e1ed1d tempest-CreateVolumesFromSnapshotTest-1883912193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1123952032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=657e3336-9802-4f09-8748-2dc0c884bb82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3974be693db744cdb79bc7e12c67b63b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:22:31Z,use_quota=True,user_id='71e1976370b642d8a8ee1d5d06da60cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:22:31 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-1ff39563-1ba2-43e3-8667-6b93b1e1ed1d tempest-CreateVolumesFromSnapshotTest-1883912193 None] Creating volume 657e3336-9802-4f09-8748-2dc0c884bb82 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:22:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1ff39563-1ba2-43e3-8667-6b93b1e1ed1d tempest-CreateVolumesFromSnapshotTest-1883912193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:22:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1ff39563-1ba2-43e3-8667-6b93b1e1ed1d tempest-CreateVolumesFromSnapshotTest-1883912193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:22:31 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1ff39563-1ba2-43e3-8667-6b93b1e1ed1d tempest-CreateVolumesFromSnapshotTest-1883912193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:22:31 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1ff39563-1ba2-43e3-8667-6b93b1e1ed1d tempest-CreateVolumesFromSnapshotTest-1883912193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:22:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1ff39563-1ba2-43e3-8667-6b93b1e1ed1d tempest-CreateVolumesFromSnapshotTest-1883912193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:22:31 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1ff39563-1ba2-43e3-8667-6b93b1e1ed1d tempest-CreateVolumesFromSnapshotTest-1883912193 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:22:31 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-1ff39563-1ba2-43e3-8667-6b93b1e1ed1d tempest-CreateVolumesFromSnapshotTest-1883912193 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:22:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1ff39563-1ba2-43e3-8667-6b93b1e1ed1d tempest-CreateVolumesFromSnapshotTest-1883912193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-657e3336-9802-4f09-8748-2dc0c884bb82 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:22:31 devstack sudo[99868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-657e3336-9802-4f09-8748-2dc0c884bb82 1073741824 Nov 04 12:22:31 devstack sudo[99868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:22:31 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0e898f7-7265-423c-8cc0-2bd223fdedb0 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:22:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f0e898f7-7265-423c-8cc0-2bd223fdedb0 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Flow 'volume_create_manager' (a63bea31-9944-4470-b5b6-aca4864d3a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:22:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f0e898f7-7265-423c-8cc0-2bd223fdedb0 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4b6fdbf-e0f1-44c7-90be-21f8070e1a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:22:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f0e898f7-7265-423c-8cc0-2bd223fdedb0 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4b6fdbf-e0f1-44c7-90be-21f8070e1a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-679961553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=262c1dd6-fb86-4626-92a5-6f3ca03713ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3974be693db744cdb79bc7e12c67b63b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:22:32Z,use_quota=True,user_id='71e1976370b642d8a8ee1d5d06da60cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:22:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f0e898f7-7265-423c-8cc0-2bd223fdedb0 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf6eab28-6292-4492-a807-1f2fa56d0892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:22:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f0e898f7-7265-423c-8cc0-2bd223fdedb0 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf6eab28-6292-4492-a807-1f2fa56d0892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:22:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f0e898f7-7265-423c-8cc0-2bd223fdedb0 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fe7946d-1cde-403c-a8f2-15657239b8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:22:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f0e898f7-7265-423c-8cc0-2bd223fdedb0 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fe7946d-1cde-403c-a8f2-15657239b8bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '262c1dd6-fb86-4626-92a5-6f3ca03713ee', 'volume_name': 'volume-262c1dd6-fb86-4626-92a5-6f3ca03713ee', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:22:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f0e898f7-7265-423c-8cc0-2bd223fdedb0 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df31582b-a9a8-4170-a6b9-511adeb2d0cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:22:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f0e898f7-7265-423c-8cc0-2bd223fdedb0 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df31582b-a9a8-4170-a6b9-511adeb2d0cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:22:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f0e898f7-7265-423c-8cc0-2bd223fdedb0 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be6c6728-d090-4eca-ad2b-0c6959b928c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:22:32 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-f0e898f7-7265-423c-8cc0-2bd223fdedb0 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Volume 262c1dd6-fb86-4626-92a5-6f3ca03713ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-262c1dd6-fb86-4626-92a5-6f3ca03713ee', 'volume_size': 1} Nov 04 12:22:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f0e898f7-7265-423c-8cc0-2bd223fdedb0 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:22:32 devstack sudo[99868]: pam_unix(sudo:session): session closed for user root Nov 04 12:22:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1ff39563-1ba2-43e3-8667-6b93b1e1ed1d tempest-CreateVolumesFromSnapshotTest-1883912193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-657e3336-9802-4f09-8748-2dc0c884bb82 1073741824" returned: 0 in 0.874s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:22:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1ff39563-1ba2-43e3-8667-6b93b1e1ed1d tempest-CreateVolumesFromSnapshotTest-1883912193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-657e3336-9802-4f09-8748-2dc0c884bb82 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:22:32 devstack sudo[99897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-657e3336-9802-4f09-8748-2dc0c884bb82 Nov 04 12:22:32 devstack sudo[99897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:22:32 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-71e81fd2-db85-4490-ae8e-8409b0a91e1e tempest-CreateVolumesFromSnapshotTest-1883912193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:22:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-71e81fd2-db85-4490-ae8e-8409b0a91e1e tempest-CreateVolumesFromSnapshotTest-1883912193 None] Flow 'volume_create_manager' (aeeb4c93-2dee-48af-ac36-ad41429188f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:22:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-71e81fd2-db85-4490-ae8e-8409b0a91e1e tempest-CreateVolumesFromSnapshotTest-1883912193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e74397d-e35f-4ed8-adf8-517eb74305f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:22:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-71e81fd2-db85-4490-ae8e-8409b0a91e1e tempest-CreateVolumesFromSnapshotTest-1883912193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e74397d-e35f-4ed8-adf8-517eb74305f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:22:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2049791012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5904c559-8447-4a83-8261-a258ce39f5af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3974be693db744cdb79bc7e12c67b63b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:22:33Z,use_quota=True,user_id='71e1976370b642d8a8ee1d5d06da60cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:22:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-71e81fd2-db85-4490-ae8e-8409b0a91e1e tempest-CreateVolumesFromSnapshotTest-1883912193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2dd27b2-0795-4a5b-873d-77ad4f80ebaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:22:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-71e81fd2-db85-4490-ae8e-8409b0a91e1e tempest-CreateVolumesFromSnapshotTest-1883912193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2dd27b2-0795-4a5b-873d-77ad4f80ebaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:22:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-71e81fd2-db85-4490-ae8e-8409b0a91e1e tempest-CreateVolumesFromSnapshotTest-1883912193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5345bfa4-8ccf-4b4c-9d1e-2c1cf81207ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:22:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-71e81fd2-db85-4490-ae8e-8409b0a91e1e tempest-CreateVolumesFromSnapshotTest-1883912193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5345bfa4-8ccf-4b4c-9d1e-2c1cf81207ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5904c559-8447-4a83-8261-a258ce39f5af', 'volume_name': 'volume-5904c559-8447-4a83-8261-a258ce39f5af', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:22:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-71e81fd2-db85-4490-ae8e-8409b0a91e1e tempest-CreateVolumesFromSnapshotTest-1883912193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3cad0dc-61d3-4749-9d5f-51b9980bfbc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:22:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-71e81fd2-db85-4490-ae8e-8409b0a91e1e tempest-CreateVolumesFromSnapshotTest-1883912193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3cad0dc-61d3-4749-9d5f-51b9980bfbc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:22:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-71e81fd2-db85-4490-ae8e-8409b0a91e1e tempest-CreateVolumesFromSnapshotTest-1883912193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d15d867a-1fe4-4488-9384-8ad6700fe254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:22:32 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-71e81fd2-db85-4490-ae8e-8409b0a91e1e tempest-CreateVolumesFromSnapshotTest-1883912193 None] Volume 5904c559-8447-4a83-8261-a258ce39f5af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5904c559-8447-4a83-8261-a258ce39f5af', 'volume_size': 1} Nov 04 12:22:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-71e81fd2-db85-4490-ae8e-8409b0a91e1e tempest-CreateVolumesFromSnapshotTest-1883912193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:22:32 devstack sudo[99897]: pam_unix(sudo:session): session closed for user root Nov 04 12:22:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1ff39563-1ba2-43e3-8667-6b93b1e1ed1d tempest-CreateVolumesFromSnapshotTest-1883912193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-657e3336-9802-4f09-8748-2dc0c884bb82" returned: 0 in 0.461s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:22:32 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1ff39563-1ba2-43e3-8667-6b93b1e1ed1d tempest-CreateVolumesFromSnapshotTest-1883912193 None] <== create_volume: return (1479ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:22:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1ff39563-1ba2-43e3-8667-6b93b1e1ed1d tempest-CreateVolumesFromSnapshotTest-1883912193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.481s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:22:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f0e898f7-7265-423c-8cc0-2bd223fdedb0 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.843s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:22:32 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f0e898f7-7265-423c-8cc0-2bd223fdedb0 tempest-CreateVolumesFromSnapshotTest-1883912193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-679961553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=262c1dd6-fb86-4626-92a5-6f3ca03713ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3974be693db744cdb79bc7e12c67b63b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:22:32Z,use_quota=True,user_id='71e1976370b642d8a8ee1d5d06da60cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:22:32 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-f0e898f7-7265-423c-8cc0-2bd223fdedb0 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Creating volume 262c1dd6-fb86-4626-92a5-6f3ca03713ee {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:22:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f0e898f7-7265-423c-8cc0-2bd223fdedb0 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:22:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f0e898f7-7265-423c-8cc0-2bd223fdedb0 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:22:32 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f0e898f7-7265-423c-8cc0-2bd223fdedb0 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:22:32 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f0e898f7-7265-423c-8cc0-2bd223fdedb0 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:22:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f0e898f7-7265-423c-8cc0-2bd223fdedb0 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:22:32 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f0e898f7-7265-423c-8cc0-2bd223fdedb0 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:22:32 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-f0e898f7-7265-423c-8cc0-2bd223fdedb0 tempest-CreateVolumesFromSnapshotTest-1883912193 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:22:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f0e898f7-7265-423c-8cc0-2bd223fdedb0 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-262c1dd6-fb86-4626-92a5-6f3ca03713ee 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:22:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1ff39563-1ba2-43e3-8667-6b93b1e1ed1d tempest-CreateVolumesFromSnapshotTest-1883912193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90489030-fc97-4ac2-b8ad-5ed8d4884e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-657e3336-9802-4f09-8748-2dc0c884bb82', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:22:32 devstack sudo[99900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-262c1dd6-fb86-4626-92a5-6f3ca03713ee 1073741824 Nov 04 12:22:32 devstack sudo[99900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:22:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1ff39563-1ba2-43e3-8667-6b93b1e1ed1d tempest-CreateVolumesFromSnapshotTest-1883912193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f030654b-6e2f-4857-958c-6af1ef37ddd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:22:32 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-1ff39563-1ba2-43e3-8667-6b93b1e1ed1d tempest-CreateVolumesFromSnapshotTest-1883912193 None] Volume volume-657e3336-9802-4f09-8748-2dc0c884bb82 (657e3336-9802-4f09-8748-2dc0c884bb82): created successfully Nov 04 12:22:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1ff39563-1ba2-43e3-8667-6b93b1e1ed1d tempest-CreateVolumesFromSnapshotTest-1883912193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f030654b-6e2f-4857-958c-6af1ef37ddd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:22:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1ff39563-1ba2-43e3-8667-6b93b1e1ed1d tempest-CreateVolumesFromSnapshotTest-1883912193 None] Flow 'volume_create_manager' (7c5ddf73-1789-490f-9a00-93f88d46b04a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:22:33 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-1ff39563-1ba2-43e3-8667-6b93b1e1ed1d tempest-CreateVolumesFromSnapshotTest-1883912193 None] Created volume successfully. Nov 04 12:22:33 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef60d2ac-78a0-4c23-af28-fb69701c6c19 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:22:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ef60d2ac-78a0-4c23-af28-fb69701c6c19 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Flow 'volume_create_manager' (52f801a8-adc7-42ca-8cd3-59180de45ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:22:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ef60d2ac-78a0-4c23-af28-fb69701c6c19 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82b1af07-27dc-485d-b03b-44fc0c79f4c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:22:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ef60d2ac-78a0-4c23-af28-fb69701c6c19 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82b1af07-27dc-485d-b03b-44fc0c79f4c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:22:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1127253594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29f38b11-d12b-43fe-a930-5279b636b7e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3974be693db744cdb79bc7e12c67b63b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:22:33Z,use_quota=True,user_id='71e1976370b642d8a8ee1d5d06da60cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:22:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ef60d2ac-78a0-4c23-af28-fb69701c6c19 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc6d87b9-2f35-4155-9272-ff2a96d69aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:22:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ef60d2ac-78a0-4c23-af28-fb69701c6c19 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc6d87b9-2f35-4155-9272-ff2a96d69aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:22:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ef60d2ac-78a0-4c23-af28-fb69701c6c19 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6365115-314a-41e8-bcc6-6879b12e423f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:22:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ef60d2ac-78a0-4c23-af28-fb69701c6c19 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6365115-314a-41e8-bcc6-6879b12e423f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29f38b11-d12b-43fe-a930-5279b636b7e0', 'volume_name': 'volume-29f38b11-d12b-43fe-a930-5279b636b7e0', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:22:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ef60d2ac-78a0-4c23-af28-fb69701c6c19 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0af5cdc6-0d1c-45b1-9c80-bcc2a6319a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:22:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ef60d2ac-78a0-4c23-af28-fb69701c6c19 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0af5cdc6-0d1c-45b1-9c80-bcc2a6319a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:22:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ef60d2ac-78a0-4c23-af28-fb69701c6c19 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f249ca0e-e734-4509-9e91-074db14ca822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:22:33 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-ef60d2ac-78a0-4c23-af28-fb69701c6c19 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Volume 29f38b11-d12b-43fe-a930-5279b636b7e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29f38b11-d12b-43fe-a930-5279b636b7e0', 'volume_size': 1} Nov 04 12:22:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ef60d2ac-78a0-4c23-af28-fb69701c6c19 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:22:33 devstack sudo[99900]: pam_unix(sudo:session): session closed for user root Nov 04 12:22:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f0e898f7-7265-423c-8cc0-2bd223fdedb0 tempest-CreateVolumesFromSnapshotTest-1883912193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-262c1dd6-fb86-4626-92a5-6f3ca03713ee 1073741824" returned: 0 in 0.856s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:22:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f0e898f7-7265-423c-8cc0-2bd223fdedb0 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-262c1dd6-fb86-4626-92a5-6f3ca03713ee {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:22:33 devstack sudo[99906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-262c1dd6-fb86-4626-92a5-6f3ca03713ee Nov 04 12:22:33 devstack sudo[99906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:22:33 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-2687b093-57f4-4043-8edb-096e7879fc5d tempest-CreateVolumesFromSnapshotTest-1883912193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:22:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2687b093-57f4-4043-8edb-096e7879fc5d tempest-CreateVolumesFromSnapshotTest-1883912193 None] Flow 'volume_create_manager' (3c5e55cb-4b59-408f-acaa-5faa13d018a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:22:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2687b093-57f4-4043-8edb-096e7879fc5d tempest-CreateVolumesFromSnapshotTest-1883912193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cadbab09-8d11-4e4f-9fe9-1aa5a4a89773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:22:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2687b093-57f4-4043-8edb-096e7879fc5d tempest-CreateVolumesFromSnapshotTest-1883912193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cadbab09-8d11-4e4f-9fe9-1aa5a4a89773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:22:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2010373765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19c46663-103c-4d62-bd39-e75ed3df9ee0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3974be693db744cdb79bc7e12c67b63b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:22:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:22:34Z,use_quota=True,user_id='71e1976370b642d8a8ee1d5d06da60cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:22:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2687b093-57f4-4043-8edb-096e7879fc5d tempest-CreateVolumesFromSnapshotTest-1883912193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (035c38ba-a032-4906-9e87-1d725609a9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:22:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2687b093-57f4-4043-8edb-096e7879fc5d tempest-CreateVolumesFromSnapshotTest-1883912193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (035c38ba-a032-4906-9e87-1d725609a9be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:22:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2687b093-57f4-4043-8edb-096e7879fc5d tempest-CreateVolumesFromSnapshotTest-1883912193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba2c1f95-ef7d-472e-9a83-ab8925094951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:22:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2687b093-57f4-4043-8edb-096e7879fc5d tempest-CreateVolumesFromSnapshotTest-1883912193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba2c1f95-ef7d-472e-9a83-ab8925094951) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19c46663-103c-4d62-bd39-e75ed3df9ee0', 'volume_name': 'volume-19c46663-103c-4d62-bd39-e75ed3df9ee0', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:22:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2687b093-57f4-4043-8edb-096e7879fc5d tempest-CreateVolumesFromSnapshotTest-1883912193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adf4ec2d-4a68-47e3-ad56-4e4cb3213f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:22:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2687b093-57f4-4043-8edb-096e7879fc5d tempest-CreateVolumesFromSnapshotTest-1883912193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adf4ec2d-4a68-47e3-ad56-4e4cb3213f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:22:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2687b093-57f4-4043-8edb-096e7879fc5d tempest-CreateVolumesFromSnapshotTest-1883912193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (935cf19b-9d30-4a28-87ef-9f9071527df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:22:34 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-2687b093-57f4-4043-8edb-096e7879fc5d tempest-CreateVolumesFromSnapshotTest-1883912193 None] Volume 19c46663-103c-4d62-bd39-e75ed3df9ee0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19c46663-103c-4d62-bd39-e75ed3df9ee0', 'volume_size': 1} Nov 04 12:22:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2687b093-57f4-4043-8edb-096e7879fc5d tempest-CreateVolumesFromSnapshotTest-1883912193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:22:34 devstack sudo[99906]: pam_unix(sudo:session): session closed for user root Nov 04 12:22:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f0e898f7-7265-423c-8cc0-2bd223fdedb0 tempest-CreateVolumesFromSnapshotTest-1883912193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-262c1dd6-fb86-4626-92a5-6f3ca03713ee" returned: 0 in 0.446s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:22:34 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f0e898f7-7265-423c-8cc0-2bd223fdedb0 tempest-CreateVolumesFromSnapshotTest-1883912193 None] <== create_volume: return (1368ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:22:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f0e898f7-7265-423c-8cc0-2bd223fdedb0 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.371s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:22:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-71e81fd2-db85-4490-ae8e-8409b0a91e1e tempest-CreateVolumesFromSnapshotTest-1883912193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.420s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:22:34 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-71e81fd2-db85-4490-ae8e-8409b0a91e1e tempest-CreateVolumesFromSnapshotTest-1883912193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:22:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2049791012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5904c559-8447-4a83-8261-a258ce39f5af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3974be693db744cdb79bc7e12c67b63b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:22:33Z,use_quota=True,user_id='71e1976370b642d8a8ee1d5d06da60cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:22:34 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-71e81fd2-db85-4490-ae8e-8409b0a91e1e tempest-CreateVolumesFromSnapshotTest-1883912193 None] Creating volume 5904c559-8447-4a83-8261-a258ce39f5af {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:22:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-71e81fd2-db85-4490-ae8e-8409b0a91e1e tempest-CreateVolumesFromSnapshotTest-1883912193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:22:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-71e81fd2-db85-4490-ae8e-8409b0a91e1e tempest-CreateVolumesFromSnapshotTest-1883912193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:22:34 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-71e81fd2-db85-4490-ae8e-8409b0a91e1e tempest-CreateVolumesFromSnapshotTest-1883912193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:22:34 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-71e81fd2-db85-4490-ae8e-8409b0a91e1e tempest-CreateVolumesFromSnapshotTest-1883912193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:22:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-71e81fd2-db85-4490-ae8e-8409b0a91e1e tempest-CreateVolumesFromSnapshotTest-1883912193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:22:34 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-71e81fd2-db85-4490-ae8e-8409b0a91e1e tempest-CreateVolumesFromSnapshotTest-1883912193 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:22:34 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-71e81fd2-db85-4490-ae8e-8409b0a91e1e tempest-CreateVolumesFromSnapshotTest-1883912193 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:22:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-71e81fd2-db85-4490-ae8e-8409b0a91e1e tempest-CreateVolumesFromSnapshotTest-1883912193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-5904c559-8447-4a83-8261-a258ce39f5af 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:22:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f0e898f7-7265-423c-8cc0-2bd223fdedb0 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be6c6728-d090-4eca-ad2b-0c6959b928c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-262c1dd6-fb86-4626-92a5-6f3ca03713ee', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:22:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f0e898f7-7265-423c-8cc0-2bd223fdedb0 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27d3dc67-f4c4-4adc-98a6-d26687aacd55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:22:34 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-f0e898f7-7265-423c-8cc0-2bd223fdedb0 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Volume volume-262c1dd6-fb86-4626-92a5-6f3ca03713ee (262c1dd6-fb86-4626-92a5-6f3ca03713ee): created successfully Nov 04 12:22:34 devstack sudo[99913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-5904c559-8447-4a83-8261-a258ce39f5af 1073741824 Nov 04 12:22:34 devstack sudo[99913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:22:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f0e898f7-7265-423c-8cc0-2bd223fdedb0 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27d3dc67-f4c4-4adc-98a6-d26687aacd55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:22:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f0e898f7-7265-423c-8cc0-2bd223fdedb0 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Flow 'volume_create_manager' (a63bea31-9944-4470-b5b6-aca4864d3a8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:22:34 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-f0e898f7-7265-423c-8cc0-2bd223fdedb0 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Created volume successfully. Nov 04 12:22:34 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-dab8ba9d-0cde-4230-8bb2-ab21181024da req-f20b4629-26c4-4cec-8cd4-b0632ed6afc0 tempest-AttachVolumeNegativeTest-1833368782 None] Terminate volume connection completed successfully. Nov 04 12:22:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-dab8ba9d-0cde-4230-8bb2-ab21181024da req-f20b4629-26c4-4cec-8cd4-b0632ed6afc0 tempest-AttachVolumeNegativeTest-1833368782 None] Deleting attachment 2010f188-1955-40b7-a5e8-a7673ba38ba5. {{(pid=87095) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 12:22:34 devstack sudo[99913]: pam_unix(sudo:session): session closed for user root Nov 04 12:22:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-71e81fd2-db85-4490-ae8e-8409b0a91e1e tempest-CreateVolumesFromSnapshotTest-1883912193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-5904c559-8447-4a83-8261-a258ce39f5af 1073741824" returned: 0 in 0.681s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:22:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-71e81fd2-db85-4490-ae8e-8409b0a91e1e tempest-CreateVolumesFromSnapshotTest-1883912193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-5904c559-8447-4a83-8261-a258ce39f5af {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:22:35 devstack sudo[99925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-5904c559-8447-4a83-8261-a258ce39f5af Nov 04 12:22:35 devstack sudo[99925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:22:35 devstack sudo[99925]: pam_unix(sudo:session): session closed for user root Nov 04 12:22:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-71e81fd2-db85-4490-ae8e-8409b0a91e1e tempest-CreateVolumesFromSnapshotTest-1883912193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-5904c559-8447-4a83-8261-a258ce39f5af" returned: 0 in 0.266s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:22:35 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-71e81fd2-db85-4490-ae8e-8409b0a91e1e tempest-CreateVolumesFromSnapshotTest-1883912193 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:22:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-71e81fd2-db85-4490-ae8e-8409b0a91e1e tempest-CreateVolumesFromSnapshotTest-1883912193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:22:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ef60d2ac-78a0-4c23-af28-fb69701c6c19 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.887s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:22:35 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ef60d2ac-78a0-4c23-af28-fb69701c6c19 tempest-CreateVolumesFromSnapshotTest-1883912193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:22:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1127253594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29f38b11-d12b-43fe-a930-5279b636b7e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3974be693db744cdb79bc7e12c67b63b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:22:33Z,use_quota=True,user_id='71e1976370b642d8a8ee1d5d06da60cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:22:35 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-ef60d2ac-78a0-4c23-af28-fb69701c6c19 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Creating volume 29f38b11-d12b-43fe-a930-5279b636b7e0 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:22:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ef60d2ac-78a0-4c23-af28-fb69701c6c19 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:22:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ef60d2ac-78a0-4c23-af28-fb69701c6c19 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:22:35 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ef60d2ac-78a0-4c23-af28-fb69701c6c19 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:22:35 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ef60d2ac-78a0-4c23-af28-fb69701c6c19 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:22:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ef60d2ac-78a0-4c23-af28-fb69701c6c19 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:22:35 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ef60d2ac-78a0-4c23-af28-fb69701c6c19 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:22:35 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-ef60d2ac-78a0-4c23-af28-fb69701c6c19 tempest-CreateVolumesFromSnapshotTest-1883912193 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:22:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ef60d2ac-78a0-4c23-af28-fb69701c6c19 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-29f38b11-d12b-43fe-a930-5279b636b7e0 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:22:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-71e81fd2-db85-4490-ae8e-8409b0a91e1e tempest-CreateVolumesFromSnapshotTest-1883912193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d15d867a-1fe4-4488-9384-8ad6700fe254) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5904c559-8447-4a83-8261-a258ce39f5af', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:22:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-71e81fd2-db85-4490-ae8e-8409b0a91e1e tempest-CreateVolumesFromSnapshotTest-1883912193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e87e0f3-26ff-4578-a276-443c2949609a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:22:35 devstack sudo[99936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-29f38b11-d12b-43fe-a930-5279b636b7e0 1073741824 Nov 04 12:22:35 devstack sudo[99936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:22:35 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-71e81fd2-db85-4490-ae8e-8409b0a91e1e tempest-CreateVolumesFromSnapshotTest-1883912193 None] Volume volume-5904c559-8447-4a83-8261-a258ce39f5af (5904c559-8447-4a83-8261-a258ce39f5af): created successfully Nov 04 12:22:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-71e81fd2-db85-4490-ae8e-8409b0a91e1e tempest-CreateVolumesFromSnapshotTest-1883912193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e87e0f3-26ff-4578-a276-443c2949609a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:22:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-71e81fd2-db85-4490-ae8e-8409b0a91e1e tempest-CreateVolumesFromSnapshotTest-1883912193 None] Flow 'volume_create_manager' (aeeb4c93-2dee-48af-ac36-ad41429188f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:22:35 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-71e81fd2-db85-4490-ae8e-8409b0a91e1e tempest-CreateVolumesFromSnapshotTest-1883912193 None] Created volume successfully. Nov 04 12:22:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-b2126654-9c9c-469b-be1e-a7e7cccf4ffc req-7a7da1d1-9e38-47fe-91f0-9d60aaef6897 tempest-TestStampPattern-979127523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:22:35 devstack sudo[99936]: pam_unix(sudo:session): session closed for user root Nov 04 12:22:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ef60d2ac-78a0-4c23-af28-fb69701c6c19 tempest-CreateVolumesFromSnapshotTest-1883912193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-29f38b11-d12b-43fe-a930-5279b636b7e0 1073741824" returned: 0 in 0.654s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:22:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ef60d2ac-78a0-4c23-af28-fb69701c6c19 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-29f38b11-d12b-43fe-a930-5279b636b7e0 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:22:36 devstack sudo[99951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-29f38b11-d12b-43fe-a930-5279b636b7e0 Nov 04 12:22:36 devstack sudo[99951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:22:36 devstack sudo[99951]: pam_unix(sudo:session): session closed for user root Nov 04 12:22:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ef60d2ac-78a0-4c23-af28-fb69701c6c19 tempest-CreateVolumesFromSnapshotTest-1883912193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-29f38b11-d12b-43fe-a930-5279b636b7e0" returned: 0 in 0.355s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:22:36 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ef60d2ac-78a0-4c23-af28-fb69701c6c19 tempest-CreateVolumesFromSnapshotTest-1883912193 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:22:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ef60d2ac-78a0-4c23-af28-fb69701c6c19 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:22:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2687b093-57f4-4043-8edb-096e7879fc5d tempest-CreateVolumesFromSnapshotTest-1883912193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.271s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:22:36 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2687b093-57f4-4043-8edb-096e7879fc5d tempest-CreateVolumesFromSnapshotTest-1883912193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:22:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2010373765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19c46663-103c-4d62-bd39-e75ed3df9ee0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3974be693db744cdb79bc7e12c67b63b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:22:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:22:34Z,use_quota=True,user_id='71e1976370b642d8a8ee1d5d06da60cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:22:36 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-2687b093-57f4-4043-8edb-096e7879fc5d tempest-CreateVolumesFromSnapshotTest-1883912193 None] Creating volume 19c46663-103c-4d62-bd39-e75ed3df9ee0 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:22:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2687b093-57f4-4043-8edb-096e7879fc5d tempest-CreateVolumesFromSnapshotTest-1883912193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:22:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2687b093-57f4-4043-8edb-096e7879fc5d tempest-CreateVolumesFromSnapshotTest-1883912193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:22:36 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2687b093-57f4-4043-8edb-096e7879fc5d tempest-CreateVolumesFromSnapshotTest-1883912193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:22:36 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2687b093-57f4-4043-8edb-096e7879fc5d tempest-CreateVolumesFromSnapshotTest-1883912193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:22:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2687b093-57f4-4043-8edb-096e7879fc5d tempest-CreateVolumesFromSnapshotTest-1883912193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:22:36 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2687b093-57f4-4043-8edb-096e7879fc5d tempest-CreateVolumesFromSnapshotTest-1883912193 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:22:36 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-2687b093-57f4-4043-8edb-096e7879fc5d tempest-CreateVolumesFromSnapshotTest-1883912193 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:22:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2687b093-57f4-4043-8edb-096e7879fc5d tempest-CreateVolumesFromSnapshotTest-1883912193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-19c46663-103c-4d62-bd39-e75ed3df9ee0 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:22:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ef60d2ac-78a0-4c23-af28-fb69701c6c19 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f249ca0e-e734-4509-9e91-074db14ca822) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29f38b11-d12b-43fe-a930-5279b636b7e0', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:22:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ef60d2ac-78a0-4c23-af28-fb69701c6c19 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e442ba3-8df4-48e9-a8c1-535a3e6a1a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:22:36 devstack sudo[99964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-19c46663-103c-4d62-bd39-e75ed3df9ee0 1073741824 Nov 04 12:22:36 devstack sudo[99964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:22:36 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-ef60d2ac-78a0-4c23-af28-fb69701c6c19 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Volume volume-29f38b11-d12b-43fe-a930-5279b636b7e0 (29f38b11-d12b-43fe-a930-5279b636b7e0): created successfully Nov 04 12:22:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ef60d2ac-78a0-4c23-af28-fb69701c6c19 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e442ba3-8df4-48e9-a8c1-535a3e6a1a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:22:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ef60d2ac-78a0-4c23-af28-fb69701c6c19 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Flow 'volume_create_manager' (52f801a8-adc7-42ca-8cd3-59180de45ca4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:22:36 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-ef60d2ac-78a0-4c23-af28-fb69701c6c19 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Created volume successfully. Nov 04 12:22:36 devstack sudo[99964]: pam_unix(sudo:session): session closed for user root Nov 04 12:22:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2687b093-57f4-4043-8edb-096e7879fc5d tempest-CreateVolumesFromSnapshotTest-1883912193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-19c46663-103c-4d62-bd39-e75ed3df9ee0 1073741824" returned: 0 in 0.606s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:22:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2687b093-57f4-4043-8edb-096e7879fc5d tempest-CreateVolumesFromSnapshotTest-1883912193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-19c46663-103c-4d62-bd39-e75ed3df9ee0 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:22:37 devstack sudo[99972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-19c46663-103c-4d62-bd39-e75ed3df9ee0 Nov 04 12:22:37 devstack sudo[99972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:22:37 devstack sudo[99972]: pam_unix(sudo:session): session closed for user root Nov 04 12:22:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2687b093-57f4-4043-8edb-096e7879fc5d tempest-CreateVolumesFromSnapshotTest-1883912193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-19c46663-103c-4d62-bd39-e75ed3df9ee0" returned: 0 in 0.308s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:22:37 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2687b093-57f4-4043-8edb-096e7879fc5d tempest-CreateVolumesFromSnapshotTest-1883912193 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:22:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2687b093-57f4-4043-8edb-096e7879fc5d tempest-CreateVolumesFromSnapshotTest-1883912193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:22:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-b2126654-9c9c-469b-be1e-a7e7cccf4ffc req-7a7da1d1-9e38-47fe-91f0-9d60aaef6897 tempest-TestStampPattern-979127523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.951s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:22:37 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2687b093-57f4-4043-8edb-096e7879fc5d tempest-CreateVolumesFromSnapshotTest-1883912193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (935cf19b-9d30-4a28-87ef-9f9071527df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19c46663-103c-4d62-bd39-e75ed3df9ee0', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:22:37 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2687b093-57f4-4043-8edb-096e7879fc5d tempest-CreateVolumesFromSnapshotTest-1883912193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa12ef9e-81c5-4a68-85f0-96730a51772e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:22:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-b2126654-9c9c-469b-be1e-a7e7cccf4ffc req-7a7da1d1-9e38-47fe-91f0-9d60aaef6897 tempest-TestStampPattern-979127523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:22:37 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-2687b093-57f4-4043-8edb-096e7879fc5d tempest-CreateVolumesFromSnapshotTest-1883912193 None] Volume volume-19c46663-103c-4d62-bd39-e75ed3df9ee0 (19c46663-103c-4d62-bd39-e75ed3df9ee0): created successfully Nov 04 12:22:37 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2687b093-57f4-4043-8edb-096e7879fc5d tempest-CreateVolumesFromSnapshotTest-1883912193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa12ef9e-81c5-4a68-85f0-96730a51772e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:22:37 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2687b093-57f4-4043-8edb-096e7879fc5d tempest-CreateVolumesFromSnapshotTest-1883912193 None] Flow 'volume_create_manager' (3c5e55cb-4b59-408f-acaa-5faa13d018a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:22:37 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-2687b093-57f4-4043-8edb-096e7879fc5d tempest-CreateVolumesFromSnapshotTest-1883912193 None] Created volume successfully. Nov 04 12:22:37 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-b2126654-9c9c-469b-be1e-a7e7cccf4ffc req-7a7da1d1-9e38-47fe-91f0-9d60aaef6897 tempest-TestStampPattern-979127523 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784', 'name': 'volume-ff7aff92-ea95-4882-b1bd-9a444df50764', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4b274df9-bce1-45d6-a5fb-a69670a59288', 'enforce_multipath': True} {{(pid=87095) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 12:22:37 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-b2126654-9c9c-469b-be1e-a7e7cccf4ffc req-7a7da1d1-9e38-47fe-91f0-9d60aaef6897 tempest-TestStampPattern-979127523 None] attachment_update completed successfully. Nov 04 12:22:37 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a4f7b1a8-d80b-42a4-a547-4aa59d2c87e8 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Acquiring lock "cinder-19c46663-103c-4d62-bd39-e75ed3df9ee0-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:22:37 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a4f7b1a8-d80b-42a4-a547-4aa59d2c87e8 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Lock "cinder-19c46663-103c-4d62-bd39-e75ed3df9ee0-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:22:37 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a4f7b1a8-d80b-42a4-a547-4aa59d2c87e8 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Acquiring lock "cinder-quobyte-19c46663-103c-4d62-bd39-e75ed3df9ee0" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:22:37 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a4f7b1a8-d80b-42a4-a547-4aa59d2c87e8 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Lock "cinder-quobyte-19c46663-103c-4d62-bd39-e75ed3df9ee0" acquired by "delete_volume" :: waited 0.019s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:22:37 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c0849f-bbab-4002-acdd-caab3386eacc]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:22:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a4f7b1a8-d80b-42a4-a547-4aa59d2c87e8 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-19c46663-103c-4d62-bd39-e75ed3df9ee0 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:22:37 devstack sudo[100052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-19c46663-103c-4d62-bd39-e75ed3df9ee0 Nov 04 12:22:37 devstack sudo[100052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:22:38 devstack sudo[100052]: pam_unix(sudo:session): session closed for user root Nov 04 12:22:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a4f7b1a8-d80b-42a4-a547-4aa59d2c87e8 tempest-CreateVolumesFromSnapshotTest-1883912193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-19c46663-103c-4d62-bd39-e75ed3df9ee0" returned: 0 in 0.556s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:22:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a4f7b1a8-d80b-42a4-a547-4aa59d2c87e8 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-19c46663-103c-4d62-bd39-e75ed3df9ee0 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:22:38 devstack sudo[100395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-19c46663-103c-4d62-bd39-e75ed3df9ee0 Nov 04 12:22:38 devstack sudo[100395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:22:38 devstack sudo[100395]: pam_unix(sudo:session): session closed for user root Nov 04 12:22:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a4f7b1a8-d80b-42a4-a547-4aa59d2c87e8 tempest-CreateVolumesFromSnapshotTest-1883912193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-19c46663-103c-4d62-bd39-e75ed3df9ee0" returned: 0 in 0.325s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:22:38 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a4f7b1a8-d80b-42a4-a547-4aa59d2c87e8 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Lock "cinder-quobyte-19c46663-103c-4d62-bd39-e75ed3df9ee0" released by "delete_volume" :: held 0.967s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:22:38 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-a4f7b1a8-d80b-42a4-a547-4aa59d2c87e8 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Created reservations ['39c20892-ce2a-45a2-adb1-ececfddf7f99', '7fc3833b-4dc4-422d-9177-83989c4d65bd', '721fe01d-afd9-4275-82fb-03befd189a05', '66fda0e3-75f6-43aa-87b6-75fdd3963466'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:22:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a4f7b1a8-d80b-42a4-a547-4aa59d2c87e8 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:22:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a4f7b1a8-d80b-42a4-a547-4aa59d2c87e8 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:22:38 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a4f7b1a8-d80b-42a4-a547-4aa59d2c87e8 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:22:38 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a4f7b1a8-d80b-42a4-a547-4aa59d2c87e8 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:22:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a4f7b1a8-d80b-42a4-a547-4aa59d2c87e8 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:22:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a4f7b1a8-d80b-42a4-a547-4aa59d2c87e8 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:22:38 devstack sudo[100399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:22:38 devstack sudo[100399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:22:39 devstack sudo[100399]: pam_unix(sudo:session): session closed for user root Nov 04 12:22:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a4f7b1a8-d80b-42a4-a547-4aa59d2c87e8 tempest-CreateVolumesFromSnapshotTest-1883912193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.271s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:22:39 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-a4f7b1a8-d80b-42a4-a547-4aa59d2c87e8 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:22:39 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-a4f7b1a8-d80b-42a4-a547-4aa59d2c87e8 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Deleted volume successfully. Nov 04 12:22:39 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a4f7b1a8-d80b-42a4-a547-4aa59d2c87e8 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Lock "cinder-19c46663-103c-4d62-bd39-e75ed3df9ee0-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:22:39 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-450f21a2-95fe-45f1-be8d-32f3d5c24491 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Acquiring lock "cinder-29f38b11-d12b-43fe-a930-5279b636b7e0-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:22:39 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-450f21a2-95fe-45f1-be8d-32f3d5c24491 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Lock "cinder-29f38b11-d12b-43fe-a930-5279b636b7e0-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:22:40 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-450f21a2-95fe-45f1-be8d-32f3d5c24491 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Acquiring lock "cinder-quobyte-29f38b11-d12b-43fe-a930-5279b636b7e0" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:22:40 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-450f21a2-95fe-45f1-be8d-32f3d5c24491 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Lock "cinder-quobyte-29f38b11-d12b-43fe-a930-5279b636b7e0" acquired by "delete_volume" :: waited 0.023s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:22:40 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[63887e5d-b275-46c1-8915-163479f6765b]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:22:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-450f21a2-95fe-45f1-be8d-32f3d5c24491 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-29f38b11-d12b-43fe-a930-5279b636b7e0 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:22:40 devstack sudo[100412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-29f38b11-d12b-43fe-a930-5279b636b7e0 Nov 04 12:22:40 devstack sudo[100412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:22:40 devstack sudo[100412]: pam_unix(sudo:session): session closed for user root Nov 04 12:22:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-450f21a2-95fe-45f1-be8d-32f3d5c24491 tempest-CreateVolumesFromSnapshotTest-1883912193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-29f38b11-d12b-43fe-a930-5279b636b7e0" returned: 0 in 0.493s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:22:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-450f21a2-95fe-45f1-be8d-32f3d5c24491 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-29f38b11-d12b-43fe-a930-5279b636b7e0 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:22:40 devstack sudo[100417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-29f38b11-d12b-43fe-a930-5279b636b7e0 Nov 04 12:22:40 devstack sudo[100417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:22:40 devstack sudo[100417]: pam_unix(sudo:session): session closed for user root Nov 04 12:22:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-450f21a2-95fe-45f1-be8d-32f3d5c24491 tempest-CreateVolumesFromSnapshotTest-1883912193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-29f38b11-d12b-43fe-a930-5279b636b7e0" returned: 0 in 0.336s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:22:40 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-450f21a2-95fe-45f1-be8d-32f3d5c24491 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Lock "cinder-quobyte-29f38b11-d12b-43fe-a930-5279b636b7e0" released by "delete_volume" :: held 0.892s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:22:41 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-450f21a2-95fe-45f1-be8d-32f3d5c24491 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Created reservations ['bb1e15ee-3474-4ea2-b3f1-0de6ac9d902c', '3b391e06-5af7-4a7b-b382-05118b106751', 'c20566e4-afa2-496b-ac8a-65dfc3f387d8', '89865691-a4ef-430a-9640-ed653bce05d9'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:22:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-450f21a2-95fe-45f1-be8d-32f3d5c24491 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:22:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-450f21a2-95fe-45f1-be8d-32f3d5c24491 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:22:41 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-450f21a2-95fe-45f1-be8d-32f3d5c24491 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:22:41 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-450f21a2-95fe-45f1-be8d-32f3d5c24491 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:22:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-450f21a2-95fe-45f1-be8d-32f3d5c24491 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:22:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-450f21a2-95fe-45f1-be8d-32f3d5c24491 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:22:41 devstack sudo[100420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:22:41 devstack sudo[100420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:22:41 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6605c5b7-9f3b-4b35-a37a-2b2d598b2942 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Acquiring lock "cinder-5904c559-8447-4a83-8261-a258ce39f5af-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:22:41 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6605c5b7-9f3b-4b35-a37a-2b2d598b2942 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Lock "cinder-5904c559-8447-4a83-8261-a258ce39f5af-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:22:41 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6605c5b7-9f3b-4b35-a37a-2b2d598b2942 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Acquiring lock "cinder-quobyte-5904c559-8447-4a83-8261-a258ce39f5af" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:22:41 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6605c5b7-9f3b-4b35-a37a-2b2d598b2942 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Lock "cinder-quobyte-5904c559-8447-4a83-8261-a258ce39f5af" acquired by "delete_volume" :: waited 0.041s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:22:41 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[88dad665-a649-4af0-986e-0dc66f80bf68]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:22:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6605c5b7-9f3b-4b35-a37a-2b2d598b2942 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-5904c559-8447-4a83-8261-a258ce39f5af {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:22:41 devstack sudo[100420]: pam_unix(sudo:session): session closed for user root Nov 04 12:22:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-450f21a2-95fe-45f1-be8d-32f3d5c24491 tempest-CreateVolumesFromSnapshotTest-1883912193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.362s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:22:41 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-450f21a2-95fe-45f1-be8d-32f3d5c24491 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:22:41 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-450f21a2-95fe-45f1-be8d-32f3d5c24491 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Deleted volume successfully. Nov 04 12:22:41 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-450f21a2-95fe-45f1-be8d-32f3d5c24491 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Lock "cinder-29f38b11-d12b-43fe-a930-5279b636b7e0-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:22:41 devstack sudo[100423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-5904c559-8447-4a83-8261-a258ce39f5af Nov 04 12:22:41 devstack sudo[100423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:22:41 devstack sudo[100423]: pam_unix(sudo:session): session closed for user root Nov 04 12:22:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6605c5b7-9f3b-4b35-a37a-2b2d598b2942 tempest-CreateVolumesFromSnapshotTest-1883912193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-5904c559-8447-4a83-8261-a258ce39f5af" returned: 0 in 0.512s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:22:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6605c5b7-9f3b-4b35-a37a-2b2d598b2942 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-5904c559-8447-4a83-8261-a258ce39f5af {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:22:41 devstack sudo[100428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-5904c559-8447-4a83-8261-a258ce39f5af Nov 04 12:22:41 devstack sudo[100428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:22:42 devstack sudo[100428]: pam_unix(sudo:session): session closed for user root Nov 04 12:22:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6605c5b7-9f3b-4b35-a37a-2b2d598b2942 tempest-CreateVolumesFromSnapshotTest-1883912193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-5904c559-8447-4a83-8261-a258ce39f5af" returned: 0 in 0.368s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:22:42 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6605c5b7-9f3b-4b35-a37a-2b2d598b2942 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Lock "cinder-quobyte-5904c559-8447-4a83-8261-a258ce39f5af" released by "delete_volume" :: held 0.988s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:22:42 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-6605c5b7-9f3b-4b35-a37a-2b2d598b2942 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Created reservations ['4d62cb82-4d8c-424d-a54c-0d6bf9978845', 'ac3ca837-55b8-49fa-ab7e-b45e4078b7b5', '2091f94f-90a2-4b28-8773-286b0309940f', '09b9b3c7-39ac-4595-aad8-26c6e70efe56'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:22:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6605c5b7-9f3b-4b35-a37a-2b2d598b2942 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:22:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6605c5b7-9f3b-4b35-a37a-2b2d598b2942 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:22:42 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6605c5b7-9f3b-4b35-a37a-2b2d598b2942 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:22:42 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6605c5b7-9f3b-4b35-a37a-2b2d598b2942 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:22:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6605c5b7-9f3b-4b35-a37a-2b2d598b2942 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:22:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6605c5b7-9f3b-4b35-a37a-2b2d598b2942 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:22:42 devstack sudo[100431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:22:42 devstack sudo[100431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:22:42 devstack sudo[100431]: pam_unix(sudo:session): session closed for user root Nov 04 12:22:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6605c5b7-9f3b-4b35-a37a-2b2d598b2942 tempest-CreateVolumesFromSnapshotTest-1883912193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.362s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:22:42 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-6605c5b7-9f3b-4b35-a37a-2b2d598b2942 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:22:42 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-6605c5b7-9f3b-4b35-a37a-2b2d598b2942 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Deleted volume successfully. Nov 04 12:22:43 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6605c5b7-9f3b-4b35-a37a-2b2d598b2942 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Lock "cinder-5904c559-8447-4a83-8261-a258ce39f5af-delete_volume" released by "delete_volume" :: held 1.717s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:22:43 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-61554c64-c8fe-4a8e-9c0e-a16d80e8e98a tempest-CreateVolumesFromSnapshotTest-1883912193 None] Acquiring lock "cinder-262c1dd6-fb86-4626-92a5-6f3ca03713ee-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:22:43 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-61554c64-c8fe-4a8e-9c0e-a16d80e8e98a tempest-CreateVolumesFromSnapshotTest-1883912193 None] Lock "cinder-262c1dd6-fb86-4626-92a5-6f3ca03713ee-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:22:44 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-61554c64-c8fe-4a8e-9c0e-a16d80e8e98a tempest-CreateVolumesFromSnapshotTest-1883912193 None] Acquiring lock "cinder-quobyte-262c1dd6-fb86-4626-92a5-6f3ca03713ee" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:22:44 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-61554c64-c8fe-4a8e-9c0e-a16d80e8e98a tempest-CreateVolumesFromSnapshotTest-1883912193 None] Lock "cinder-quobyte-262c1dd6-fb86-4626-92a5-6f3ca03713ee" acquired by "delete_volume" :: waited 0.016s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:22:44 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1600c319-571f-448f-89ec-40ffc9ee028d]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:22:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-61554c64-c8fe-4a8e-9c0e-a16d80e8e98a tempest-CreateVolumesFromSnapshotTest-1883912193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-262c1dd6-fb86-4626-92a5-6f3ca03713ee {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:22:44 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-728b7240-3247-436b-996d-1a7cf08f49ff req-c161fdb2-ed96-4633-99f1-532ecac75941 tempest-TestStampPattern-979127523 None] Terminate volume connection completed successfully. Nov 04 12:22:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-728b7240-3247-436b-996d-1a7cf08f49ff req-c161fdb2-ed96-4633-99f1-532ecac75941 tempest-TestStampPattern-979127523 None] Deleting attachment 4b274df9-bce1-45d6-a5fb-a69670a59288. {{(pid=87095) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 12:22:44 devstack sudo[100474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-262c1dd6-fb86-4626-92a5-6f3ca03713ee Nov 04 12:22:44 devstack sudo[100474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:22:44 devstack sudo[100474]: pam_unix(sudo:session): session closed for user root Nov 04 12:22:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-61554c64-c8fe-4a8e-9c0e-a16d80e8e98a tempest-CreateVolumesFromSnapshotTest-1883912193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-262c1dd6-fb86-4626-92a5-6f3ca03713ee" returned: 0 in 0.473s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:22:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-61554c64-c8fe-4a8e-9c0e-a16d80e8e98a tempest-CreateVolumesFromSnapshotTest-1883912193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-262c1dd6-fb86-4626-92a5-6f3ca03713ee {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:22:44 devstack sudo[100479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-262c1dd6-fb86-4626-92a5-6f3ca03713ee Nov 04 12:22:44 devstack sudo[100479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:22:44 devstack sudo[100479]: pam_unix(sudo:session): session closed for user root Nov 04 12:22:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-61554c64-c8fe-4a8e-9c0e-a16d80e8e98a tempest-CreateVolumesFromSnapshotTest-1883912193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-262c1dd6-fb86-4626-92a5-6f3ca03713ee" returned: 0 in 0.324s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:22:44 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-61554c64-c8fe-4a8e-9c0e-a16d80e8e98a tempest-CreateVolumesFromSnapshotTest-1883912193 None] Lock "cinder-quobyte-262c1dd6-fb86-4626-92a5-6f3ca03713ee" released by "delete_volume" :: held 0.887s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:22:45 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-61554c64-c8fe-4a8e-9c0e-a16d80e8e98a tempest-CreateVolumesFromSnapshotTest-1883912193 None] Created reservations ['d224b290-c442-48a4-997f-23b3f9f4ca57', 'f61711d9-627b-4e5d-b226-6a02e4c51a2f', '6fcb89e0-3bf9-4339-a77f-2a51ca926009', '3f3e9797-7370-4dff-bfb3-70068e079a12'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:22:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-61554c64-c8fe-4a8e-9c0e-a16d80e8e98a tempest-CreateVolumesFromSnapshotTest-1883912193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:22:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-61554c64-c8fe-4a8e-9c0e-a16d80e8e98a tempest-CreateVolumesFromSnapshotTest-1883912193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:22:45 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-61554c64-c8fe-4a8e-9c0e-a16d80e8e98a tempest-CreateVolumesFromSnapshotTest-1883912193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:22:45 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-61554c64-c8fe-4a8e-9c0e-a16d80e8e98a tempest-CreateVolumesFromSnapshotTest-1883912193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:22:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-61554c64-c8fe-4a8e-9c0e-a16d80e8e98a tempest-CreateVolumesFromSnapshotTest-1883912193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:22:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-61554c64-c8fe-4a8e-9c0e-a16d80e8e98a tempest-CreateVolumesFromSnapshotTest-1883912193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:22:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7bd62d51-e2dd-4c5c-bc0b-87d7fc2a9d05 tempest-TestStampPattern-979127523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:22:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7bd62d51-e2dd-4c5c-bc0b-87d7fc2a9d05 tempest-TestStampPattern-979127523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:22:45 devstack sudo[100482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:22:45 devstack sudo[100482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:22:45 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-7bd62d51-e2dd-4c5c-bc0b-87d7fc2a9d05 tempest-TestStampPattern-979127523 None] Creating offline snapshot f0db180a-2367-4655-b69d-b30fce457998 of volume ff7aff92-ea95-4882-b1bd-9a444df50764 {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 12:22:45 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[18412c1d-c40c-4a36-8a8c-7e8fc7ba87f7]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:22:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7bd62d51-e2dd-4c5c-bc0b-87d7fc2a9d05 tempest-TestStampPattern-979127523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ff7aff92-ea95-4882-b1bd-9a444df50764 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:22:45 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-63f84529-47c7-4561-95af-297ed2187733 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Acquiring lock "cinder-657e3336-9802-4f09-8748-2dc0c884bb82-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:22:45 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-63f84529-47c7-4561-95af-297ed2187733 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Lock "cinder-657e3336-9802-4f09-8748-2dc0c884bb82-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:22:45 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-63f84529-47c7-4561-95af-297ed2187733 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Acquiring lock "cinder-quobyte-657e3336-9802-4f09-8748-2dc0c884bb82" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:22:45 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-63f84529-47c7-4561-95af-297ed2187733 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Lock "cinder-quobyte-657e3336-9802-4f09-8748-2dc0c884bb82" acquired by "delete_volume" :: waited 0.032s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:22:45 devstack sudo[100484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ff7aff92-ea95-4882-b1bd-9a444df50764 Nov 04 12:22:45 devstack sudo[100484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:22:45 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d57958c0-15ab-4de1-a802-fac7757ea6c8]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:22:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-63f84529-47c7-4561-95af-297ed2187733 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-657e3336-9802-4f09-8748-2dc0c884bb82 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:22:45 devstack sudo[100482]: pam_unix(sudo:session): session closed for user root Nov 04 12:22:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-61554c64-c8fe-4a8e-9c0e-a16d80e8e98a tempest-CreateVolumesFromSnapshotTest-1883912193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.337s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:22:45 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-61554c64-c8fe-4a8e-9c0e-a16d80e8e98a tempest-CreateVolumesFromSnapshotTest-1883912193 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:22:45 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-61554c64-c8fe-4a8e-9c0e-a16d80e8e98a tempest-CreateVolumesFromSnapshotTest-1883912193 None] Deleted volume successfully. Nov 04 12:22:45 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-61554c64-c8fe-4a8e-9c0e-a16d80e8e98a tempest-CreateVolumesFromSnapshotTest-1883912193 None] Lock "cinder-262c1dd6-fb86-4626-92a5-6f3ca03713ee-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:22:45 devstack sudo[100487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-657e3336-9802-4f09-8748-2dc0c884bb82 Nov 04 12:22:45 devstack sudo[100487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:22:45 devstack sudo[100484]: pam_unix(sudo:session): session closed for user root Nov 04 12:22:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7bd62d51-e2dd-4c5c-bc0b-87d7fc2a9d05 tempest-TestStampPattern-979127523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ff7aff92-ea95-4882-b1bd-9a444df50764" returned: 0 in 0.648s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:22:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7bd62d51-e2dd-4c5c-bc0b-87d7fc2a9d05 tempest-TestStampPattern-979127523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ff7aff92-ea95-4882-b1bd-9a444df50764,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ff7aff92-ea95-4882-b1bd-9a444df50764.f0db180a-2367-4655-b69d-b30fce457998 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:22:45 devstack sudo[100498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ff7aff92-ea95-4882-b1bd-9a444df50764,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ff7aff92-ea95-4882-b1bd-9a444df50764.f0db180a-2367-4655-b69d-b30fce457998 1G Nov 04 12:22:45 devstack sudo[100498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:22:45 devstack sudo[100487]: pam_unix(sudo:session): session closed for user root Nov 04 12:22:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-63f84529-47c7-4561-95af-297ed2187733 tempest-CreateVolumesFromSnapshotTest-1883912193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-657e3336-9802-4f09-8748-2dc0c884bb82" returned: 0 in 0.535s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:22:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-63f84529-47c7-4561-95af-297ed2187733 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-657e3336-9802-4f09-8748-2dc0c884bb82 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:22:46 devstack sudo[100501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-657e3336-9802-4f09-8748-2dc0c884bb82 Nov 04 12:22:46 devstack sudo[100501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:22:46 devstack sudo[100501]: pam_unix(sudo:session): session closed for user root Nov 04 12:22:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-63f84529-47c7-4561-95af-297ed2187733 tempest-CreateVolumesFromSnapshotTest-1883912193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-657e3336-9802-4f09-8748-2dc0c884bb82" returned: 0 in 0.343s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:22:46 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-63f84529-47c7-4561-95af-297ed2187733 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Lock "cinder-quobyte-657e3336-9802-4f09-8748-2dc0c884bb82" released by "delete_volume" :: held 0.957s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:22:46 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-63f84529-47c7-4561-95af-297ed2187733 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Created reservations ['a2eb77ef-377c-4a1a-9760-b28baf70ae03', 'f2139809-e569-464e-be29-57e757fa9865', '02c3ec6f-f97c-4def-998f-66a14929143e', '975ae7ea-8d0e-4568-8694-5cb331d27834'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:22:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-63f84529-47c7-4561-95af-297ed2187733 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:22:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-63f84529-47c7-4561-95af-297ed2187733 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:22:46 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-63f84529-47c7-4561-95af-297ed2187733 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:22:46 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-63f84529-47c7-4561-95af-297ed2187733 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:22:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-63f84529-47c7-4561-95af-297ed2187733 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:22:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-63f84529-47c7-4561-95af-297ed2187733 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:22:46 devstack sudo[100498]: pam_unix(sudo:session): session closed for user root Nov 04 12:22:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7bd62d51-e2dd-4c5c-bc0b-87d7fc2a9d05 tempest-TestStampPattern-979127523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ff7aff92-ea95-4882-b1bd-9a444df50764,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ff7aff92-ea95-4882-b1bd-9a444df50764.f0db180a-2367-4655-b69d-b30fce457998 1G" returned: 0 in 0.700s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:22:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7bd62d51-e2dd-4c5c-bc0b-87d7fc2a9d05 tempest-TestStampPattern-979127523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff7aff92-ea95-4882-b1bd-9a444df50764 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ff7aff92-ea95-4882-b1bd-9a444df50764.f0db180a-2367-4655-b69d-b30fce457998 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:22:46 devstack sudo[100508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:22:46 devstack sudo[100508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:22:46 devstack sudo[100509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff7aff92-ea95-4882-b1bd-9a444df50764 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ff7aff92-ea95-4882-b1bd-9a444df50764.f0db180a-2367-4655-b69d-b30fce457998 Nov 04 12:22:46 devstack sudo[100509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:22:46 devstack sudo[100508]: pam_unix(sudo:session): session closed for user root Nov 04 12:22:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-63f84529-47c7-4561-95af-297ed2187733 tempest-CreateVolumesFromSnapshotTest-1883912193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.404s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:22:46 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-63f84529-47c7-4561-95af-297ed2187733 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:22:46 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-63f84529-47c7-4561-95af-297ed2187733 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Deleted volume successfully. Nov 04 12:22:46 devstack sudo[100509]: pam_unix(sudo:session): session closed for user root Nov 04 12:22:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7bd62d51-e2dd-4c5c-bc0b-87d7fc2a9d05 tempest-TestStampPattern-979127523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff7aff92-ea95-4882-b1bd-9a444df50764 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ff7aff92-ea95-4882-b1bd-9a444df50764.f0db180a-2367-4655-b69d-b30fce457998" returned: 0 in 0.407s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:22:46 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-7bd62d51-e2dd-4c5c-bc0b-87d7fc2a9d05 tempest-TestStampPattern-979127523 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ff7aff92-ea95-4882-b1bd-9a444df50764.f0db180a-2367-4655-b69d-b30fce457998 is being set with open permissions: ugo+rw Nov 04 12:22:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7bd62d51-e2dd-4c5c-bc0b-87d7fc2a9d05 tempest-TestStampPattern-979127523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ff7aff92-ea95-4882-b1bd-9a444df50764.f0db180a-2367-4655-b69d-b30fce457998 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:22:47 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-63f84529-47c7-4561-95af-297ed2187733 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Lock "cinder-657e3336-9802-4f09-8748-2dc0c884bb82-delete_volume" released by "delete_volume" :: held 1.741s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:22:47 devstack sudo[100517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ff7aff92-ea95-4882-b1bd-9a444df50764.f0db180a-2367-4655-b69d-b30fce457998 Nov 04 12:22:47 devstack sudo[100517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:22:47 devstack sudo[100517]: pam_unix(sudo:session): session closed for user root Nov 04 12:22:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7bd62d51-e2dd-4c5c-bc0b-87d7fc2a9d05 tempest-TestStampPattern-979127523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ff7aff92-ea95-4882-b1bd-9a444df50764.f0db180a-2367-4655-b69d-b30fce457998" returned: 0 in 0.350s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:22:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7bd62d51-e2dd-4c5c-bc0b-87d7fc2a9d05 tempest-TestStampPattern-979127523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ff7aff92-ea95-4882-b1bd-9a444df50764.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:22:47 devstack sudo[100520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ff7aff92-ea95-4882-b1bd-9a444df50764.info Nov 04 12:22:47 devstack sudo[100520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:22:47 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-432de2ac-63f6-4f44-8c0a-c32a236cd637 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Acquiring lock "cinder-b8c3a578-cdbc-421a-a73b-bb39fb65f88e-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:22:47 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-432de2ac-63f6-4f44-8c0a-c32a236cd637 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Lock "cinder-b8c3a578-cdbc-421a-a73b-bb39fb65f88e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:22:47 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-432de2ac-63f6-4f44-8c0a-c32a236cd637 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Acquiring lock "cinder-quobyte-b4cbaf1a-df77-4cab-af3f-3142eb34ac70" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:22:47 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-432de2ac-63f6-4f44-8c0a-c32a236cd637 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Lock "cinder-quobyte-b4cbaf1a-df77-4cab-af3f-3142eb34ac70" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:22:47 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-432de2ac-63f6-4f44-8c0a-c32a236cd637 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Acquiring lock "cinder-quobyte-b8c3a578-cdbc-421a-a73b-bb39fb65f88e" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:22:47 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-432de2ac-63f6-4f44-8c0a-c32a236cd637 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Lock "cinder-quobyte-b8c3a578-cdbc-421a-a73b-bb39fb65f88e" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:22:47 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-432de2ac-63f6-4f44-8c0a-c32a236cd637 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Deleting offline snapshot b8c3a578-cdbc-421a-a73b-bb39fb65f88e of volume b4cbaf1a-df77-4cab-af3f-3142eb34ac70 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 12:22:47 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-432de2ac-63f6-4f44-8c0a-c32a236cd637 tempest-CreateVolumesFromSnapshotTest-1883912193 None] snapshot_file for this snap is: volume-b4cbaf1a-df77-4cab-af3f-3142eb34ac70.b8c3a578-cdbc-421a-a73b-bb39fb65f88e {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 12:22:47 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c72e10-2b84-4173-8489-3b01b6d073e9]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:22:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-432de2ac-63f6-4f44-8c0a-c32a236cd637 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b4cbaf1a-df77-4cab-af3f-3142eb34ac70.b8c3a578-cdbc-421a-a73b-bb39fb65f88e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:22:47 devstack sudo[100520]: pam_unix(sudo:session): session closed for user root Nov 04 12:22:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7bd62d51-e2dd-4c5c-bc0b-87d7fc2a9d05 tempest-TestStampPattern-979127523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ff7aff92-ea95-4882-b1bd-9a444df50764.info" returned: 0 in 0.588s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:22:47 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-7bd62d51-e2dd-4c5c-bc0b-87d7fc2a9d05 tempest-TestStampPattern-979127523 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ff7aff92-ea95-4882-b1bd-9a444df50764.info is being set with open permissions: ugo+rw Nov 04 12:22:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7bd62d51-e2dd-4c5c-bc0b-87d7fc2a9d05 tempest-TestStampPattern-979127523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ff7aff92-ea95-4882-b1bd-9a444df50764.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:22:48 devstack sudo[100525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b4cbaf1a-df77-4cab-af3f-3142eb34ac70.b8c3a578-cdbc-421a-a73b-bb39fb65f88e Nov 04 12:22:48 devstack sudo[100525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:22:48 devstack sudo[100529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ff7aff92-ea95-4882-b1bd-9a444df50764.info Nov 04 12:22:48 devstack sudo[100529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:22:48 devstack sudo[100529]: pam_unix(sudo:session): session closed for user root Nov 04 12:22:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7bd62d51-e2dd-4c5c-bc0b-87d7fc2a9d05 tempest-TestStampPattern-979127523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ff7aff92-ea95-4882-b1bd-9a444df50764.info" returned: 0 in 0.383s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:22:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7bd62d51-e2dd-4c5c-bc0b-87d7fc2a9d05 tempest-TestStampPattern-979127523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.232s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:22:48 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-7bd62d51-e2dd-4c5c-bc0b-87d7fc2a9d05 tempest-TestStampPattern-979127523 None] Create snapshot completed successfully Nov 04 12:22:48 devstack sudo[100525]: pam_unix(sudo:session): session closed for user root Nov 04 12:22:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-432de2ac-63f6-4f44-8c0a-c32a236cd637 tempest-CreateVolumesFromSnapshotTest-1883912193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b4cbaf1a-df77-4cab-af3f-3142eb34ac70.b8c3a578-cdbc-421a-a73b-bb39fb65f88e" returned: 0 in 0.771s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:22:48 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-432de2ac-63f6-4f44-8c0a-c32a236cd637 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4cbaf1a-df77-4cab-af3f-3142eb34ac70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 12:22:48 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[af14d70a-ec3d-4fe8-8d6e-64da2cbe0f56]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:22:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-432de2ac-63f6-4f44-8c0a-c32a236cd637 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b4cbaf1a-df77-4cab-af3f-3142eb34ac70 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:22:48 devstack sudo[100552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b4cbaf1a-df77-4cab-af3f-3142eb34ac70 Nov 04 12:22:48 devstack sudo[100552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:22:49 devstack sudo[100552]: pam_unix(sudo:session): session closed for user root Nov 04 12:22:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-432de2ac-63f6-4f44-8c0a-c32a236cd637 tempest-CreateVolumesFromSnapshotTest-1883912193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b4cbaf1a-df77-4cab-af3f-3142eb34ac70" returned: 0 in 0.436s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:22:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-432de2ac-63f6-4f44-8c0a-c32a236cd637 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b4cbaf1a-df77-4cab-af3f-3142eb34ac70.b8c3a578-cdbc-421a-a73b-bb39fb65f88e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:22:49 devstack sudo[100557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b4cbaf1a-df77-4cab-af3f-3142eb34ac70.b8c3a578-cdbc-421a-a73b-bb39fb65f88e Nov 04 12:22:49 devstack sudo[100557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:22:49 devstack sudo[100557]: pam_unix(sudo:session): session closed for user root Nov 04 12:22:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-432de2ac-63f6-4f44-8c0a-c32a236cd637 tempest-CreateVolumesFromSnapshotTest-1883912193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b4cbaf1a-df77-4cab-af3f-3142eb34ac70.b8c3a578-cdbc-421a-a73b-bb39fb65f88e" returned: 0 in 0.466s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:22:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-432de2ac-63f6-4f44-8c0a-c32a236cd637 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b4cbaf1a-df77-4cab-af3f-3142eb34ac70.b8c3a578-cdbc-421a-a73b-bb39fb65f88e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:22:49 devstack sudo[100563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b4cbaf1a-df77-4cab-af3f-3142eb34ac70.b8c3a578-cdbc-421a-a73b-bb39fb65f88e Nov 04 12:22:49 devstack sudo[100563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:22:49 devstack sudo[100563]: pam_unix(sudo:session): session closed for user root Nov 04 12:22:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-432de2ac-63f6-4f44-8c0a-c32a236cd637 tempest-CreateVolumesFromSnapshotTest-1883912193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b4cbaf1a-df77-4cab-af3f-3142eb34ac70.b8c3a578-cdbc-421a-a73b-bb39fb65f88e" returned: 0 in 0.307s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:22:49 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-432de2ac-63f6-4f44-8c0a-c32a236cd637 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Lock "cinder-quobyte-b8c3a578-cdbc-421a-a73b-bb39fb65f88e" released by "_delete_snapshot" :: held 2.239s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:22:49 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-432de2ac-63f6-4f44-8c0a-c32a236cd637 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Lock "cinder-quobyte-b4cbaf1a-df77-4cab-af3f-3142eb34ac70" released by "delete_snapshot" :: held 2.281s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:22:50 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-432de2ac-63f6-4f44-8c0a-c32a236cd637 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Created reservations ['3028e3f7-2bc3-4071-b84d-5400cdb348fe', 'd3e1a891-97ff-4bcd-bec7-9baa525311c4', '53c7790a-1cbc-406b-bc95-84d55fd533b4', '94c351bc-4763-4977-93a5-f9777ed814f3'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:22:50 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-432de2ac-63f6-4f44-8c0a-c32a236cd637 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Delete snapshot completed successfully. Nov 04 12:22:50 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-432de2ac-63f6-4f44-8c0a-c32a236cd637 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Lock "cinder-b8c3a578-cdbc-421a-a73b-bb39fb65f88e-delete_snapshot" released by "delete_snapshot" :: held 2.528s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:22:51 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9de7165a-17df-4d79-b0c6-057959c6f149 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Acquiring lock "cinder-b4cbaf1a-df77-4cab-af3f-3142eb34ac70-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:22:51 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9de7165a-17df-4d79-b0c6-057959c6f149 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Lock "cinder-b4cbaf1a-df77-4cab-af3f-3142eb34ac70-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:22:51 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9de7165a-17df-4d79-b0c6-057959c6f149 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Acquiring lock "cinder-quobyte-b4cbaf1a-df77-4cab-af3f-3142eb34ac70" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:22:51 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9de7165a-17df-4d79-b0c6-057959c6f149 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Lock "cinder-quobyte-b4cbaf1a-df77-4cab-af3f-3142eb34ac70" acquired by "delete_volume" :: waited 0.032s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:22:51 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0762894-4fef-441a-b3a1-5f76667bc733]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:22:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9de7165a-17df-4d79-b0c6-057959c6f149 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b4cbaf1a-df77-4cab-af3f-3142eb34ac70 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:22:51 devstack sudo[100622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b4cbaf1a-df77-4cab-af3f-3142eb34ac70 Nov 04 12:22:51 devstack sudo[100622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:22:52 devstack sudo[100622]: pam_unix(sudo:session): session closed for user root Nov 04 12:22:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9de7165a-17df-4d79-b0c6-057959c6f149 tempest-CreateVolumesFromSnapshotTest-1883912193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b4cbaf1a-df77-4cab-af3f-3142eb34ac70" returned: 0 in 0.682s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:22:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9de7165a-17df-4d79-b0c6-057959c6f149 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b4cbaf1a-df77-4cab-af3f-3142eb34ac70 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:22:52 devstack sudo[100639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b4cbaf1a-df77-4cab-af3f-3142eb34ac70 Nov 04 12:22:52 devstack sudo[100639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:22:52 devstack sudo[100639]: pam_unix(sudo:session): session closed for user root Nov 04 12:22:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9de7165a-17df-4d79-b0c6-057959c6f149 tempest-CreateVolumesFromSnapshotTest-1883912193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b4cbaf1a-df77-4cab-af3f-3142eb34ac70" returned: 0 in 0.404s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:22:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9de7165a-17df-4d79-b0c6-057959c6f149 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Lock "cinder-quobyte-b4cbaf1a-df77-4cab-af3f-3142eb34ac70" released by "delete_volume" :: held 1.227s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:22:52 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-9de7165a-17df-4d79-b0c6-057959c6f149 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Created reservations ['4adc3b12-0258-4059-b070-150b3c38b765', '8495c267-d121-4376-a30b-b738956cd974', '7a9dc2e9-2a31-4452-aa60-85a9ee11f0b3', '8822342b-8885-4415-9ca2-09d7134aab05'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:22:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9de7165a-17df-4d79-b0c6-057959c6f149 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:22:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9de7165a-17df-4d79-b0c6-057959c6f149 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:22:52 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9de7165a-17df-4d79-b0c6-057959c6f149 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:22:52 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9de7165a-17df-4d79-b0c6-057959c6f149 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:22:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9de7165a-17df-4d79-b0c6-057959c6f149 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:22:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9de7165a-17df-4d79-b0c6-057959c6f149 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:22:52 devstack sudo[100660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:22:52 devstack sudo[100660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:22:53 devstack sudo[100660]: pam_unix(sudo:session): session closed for user root Nov 04 12:22:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9de7165a-17df-4d79-b0c6-057959c6f149 tempest-CreateVolumesFromSnapshotTest-1883912193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.500s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:22:53 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-9de7165a-17df-4d79-b0c6-057959c6f149 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:22:53 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-9de7165a-17df-4d79-b0c6-057959c6f149 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Deleted volume successfully. Nov 04 12:22:53 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9de7165a-17df-4d79-b0c6-057959c6f149 tempest-CreateVolumesFromSnapshotTest-1883912193 None] Lock "cinder-b4cbaf1a-df77-4cab-af3f-3142eb34ac70-delete_volume" released by "delete_volume" :: held 2.217s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:23:01 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 12:23:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:23:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:23:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:23:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:23:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:23:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:23:01 devstack sudo[100677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:23:01 devstack sudo[100677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:23:01 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9ace6e1-0b41-4e93-801f-d5be903c6b86 tempest-TestStampPattern-979127523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:23:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e9ace6e1-0b41-4e93-801f-d5be903c6b86 tempest-TestStampPattern-979127523 None] Flow 'volume_create_manager' (66c4b640-6aee-43b7-99d8-d9b5f99326f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:23:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e9ace6e1-0b41-4e93-801f-d5be903c6b86 tempest-TestStampPattern-979127523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e6d68f9-f0c5-481c-90c1-122a9ab212f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:23:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e9ace6e1-0b41-4e93-801f-d5be903c6b86 tempest-TestStampPattern-979127523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e6d68f9-f0c5-481c-90c1-122a9ab212f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:23:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1336017192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94ff4973-e3d7-4058-b904-8d14ef929429,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69bf40c8da1c4c37af1dc60e68fa5952',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:23:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f0db180a-2367-4655-b69d-b30fce457998,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:23:02Z,use_quota=True,user_id='2122ba2073114df49f55c8ab2b281018',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:23:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e9ace6e1-0b41-4e93-801f-d5be903c6b86 tempest-TestStampPattern-979127523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48a12fe7-b1e0-41c2-9d41-288581b74b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:23:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e9ace6e1-0b41-4e93-801f-d5be903c6b86 tempest-TestStampPattern-979127523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48a12fe7-b1e0-41c2-9d41-288581b74b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:23:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e9ace6e1-0b41-4e93-801f-d5be903c6b86 tempest-TestStampPattern-979127523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (952e4b3f-ffc7-4418-8d63-88a302f6eff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:23:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e9ace6e1-0b41-4e93-801f-d5be903c6b86 tempest-TestStampPattern-979127523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (952e4b3f-ffc7-4418-8d63-88a302f6eff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '94ff4973-e3d7-4058-b904-8d14ef929429', 'volume_name': 'volume-94ff4973-e3d7-4058-b904-8d14ef929429', 'volume_size': 1, 'snapshot_id': 'f0db180a-2367-4655-b69d-b30fce457998'}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:23:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e9ace6e1-0b41-4e93-801f-d5be903c6b86 tempest-TestStampPattern-979127523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0a48862-b3bf-4816-9391-1173e7bbb112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:23:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e9ace6e1-0b41-4e93-801f-d5be903c6b86 tempest-TestStampPattern-979127523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0a48862-b3bf-4816-9391-1173e7bbb112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:23:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e9ace6e1-0b41-4e93-801f-d5be903c6b86 tempest-TestStampPattern-979127523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (645f3e75-8510-4b0e-b9ac-8de94fc6004d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:23:02 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-e9ace6e1-0b41-4e93-801f-d5be903c6b86 tempest-TestStampPattern-979127523 None] Volume 94ff4973-e3d7-4058-b904-8d14ef929429: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-94ff4973-e3d7-4058-b904-8d14ef929429', 'volume_size': 1, 'snapshot_id': 'f0db180a-2367-4655-b69d-b30fce457998'} Nov 04 12:23:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e9ace6e1-0b41-4e93-801f-d5be903c6b86 tempest-TestStampPattern-979127523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:23:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e9ace6e1-0b41-4e93-801f-d5be903c6b86 tempest-TestStampPattern-979127523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:23:02 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e9ace6e1-0b41-4e93-801f-d5be903c6b86 tempest-TestStampPattern-979127523 None] Acquiring lock "cinder-quobyte-f0db180a-2367-4655-b69d-b30fce457998-94ff4973-e3d7-4058-b904-8d14ef929429" by "_create_volume_from_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:23:02 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e9ace6e1-0b41-4e93-801f-d5be903c6b86 tempest-TestStampPattern-979127523 None] Lock "cinder-quobyte-f0db180a-2367-4655-b69d-b30fce457998-94ff4973-e3d7-4058-b904-8d14ef929429" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:23:02 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e9ace6e1-0b41-4e93-801f-d5be903c6b86 tempest-TestStampPattern-979127523 None] Creating volume 94ff4973-e3d7-4058-b904-8d14ef929429 from snapshot f0db180a-2367-4655-b69d-b30fce457998 {{(pid=87095) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 04 12:23:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e9ace6e1-0b41-4e93-801f-d5be903c6b86 tempest-TestStampPattern-979127523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:23:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e9ace6e1-0b41-4e93-801f-d5be903c6b86 tempest-TestStampPattern-979127523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:23:02 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e9ace6e1-0b41-4e93-801f-d5be903c6b86 tempest-TestStampPattern-979127523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:23:02 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e9ace6e1-0b41-4e93-801f-d5be903c6b86 tempest-TestStampPattern-979127523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:23:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e9ace6e1-0b41-4e93-801f-d5be903c6b86 tempest-TestStampPattern-979127523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:23:02 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e9ace6e1-0b41-4e93-801f-d5be903c6b86 tempest-TestStampPattern-979127523 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:23:02 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e9ace6e1-0b41-4e93-801f-d5be903c6b86 tempest-TestStampPattern-979127523 None] Acquiring lock "cinder-quobyte-94ff4973-e3d7-4058-b904-8d14ef929429" by "_copy_volume_from_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:23:02 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e9ace6e1-0b41-4e93-801f-d5be903c6b86 tempest-TestStampPattern-979127523 None] Lock "cinder-quobyte-94ff4973-e3d7-4058-b904-8d14ef929429" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:23:02 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e9ace6e1-0b41-4e93-801f-d5be903c6b86 tempest-TestStampPattern-979127523 None] snapshot: f0db180a-2367-4655-b69d-b30fce457998, volume: 94ff4973-e3d7-4058-b904-8d14ef929429, {{(pid=87095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 12:23:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e9ace6e1-0b41-4e93-801f-d5be903c6b86 tempest-TestStampPattern-979127523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:23:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e9ace6e1-0b41-4e93-801f-d5be903c6b86 tempest-TestStampPattern-979127523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:23:02 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e9ace6e1-0b41-4e93-801f-d5be903c6b86 tempest-TestStampPattern-979127523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:23:02 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e9ace6e1-0b41-4e93-801f-d5be903c6b86 tempest-TestStampPattern-979127523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:23:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e9ace6e1-0b41-4e93-801f-d5be903c6b86 tempest-TestStampPattern-979127523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:23:02 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1fa40a-6535-47a8-92a8-98f30307c6ad]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:23:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e9ace6e1-0b41-4e93-801f-d5be903c6b86 tempest-TestStampPattern-979127523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ff7aff92-ea95-4882-b1bd-9a444df50764.f0db180a-2367-4655-b69d-b30fce457998 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:23:02 devstack sudo[100677]: pam_unix(sudo:session): session closed for user root Nov 04 12:23:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.539s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:23:02 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:23:02 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Running periodic task VolumeManager._thread_info {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 12:23:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] thread count: 28 {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 12:23:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] thread info: [<_MainThread(MainThread, started 140610387472512)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 12:23:02 devstack sudo[100680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ff7aff92-ea95-4882-b1bd-9a444df50764.f0db180a-2367-4655-b69d-b30fce457998 Nov 04 12:23:02 devstack sudo[100680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:23:03 devstack sudo[100680]: pam_unix(sudo:session): session closed for user root Nov 04 12:23:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e9ace6e1-0b41-4e93-801f-d5be903c6b86 tempest-TestStampPattern-979127523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ff7aff92-ea95-4882-b1bd-9a444df50764.f0db180a-2367-4655-b69d-b30fce457998" returned: 0 in 0.817s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:23:03 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-e9ace6e1-0b41-4e93-801f-d5be903c6b86 tempest-TestStampPattern-979127523 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff7aff92-ea95-4882-b1bd-9a444df50764(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 12:23:03 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd919ad-9a4e-4e5e-903a-4fd8bba97b92]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:23:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e9ace6e1-0b41-4e93-801f-d5be903c6b86 tempest-TestStampPattern-979127523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ff7aff92-ea95-4882-b1bd-9a444df50764 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:23:03 devstack sudo[100689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ff7aff92-ea95-4882-b1bd-9a444df50764 Nov 04 12:23:03 devstack sudo[100689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:23:03 devstack sudo[100689]: pam_unix(sudo:session): session closed for user root Nov 04 12:23:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e9ace6e1-0b41-4e93-801f-d5be903c6b86 tempest-TestStampPattern-979127523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ff7aff92-ea95-4882-b1bd-9a444df50764" returned: 0 in 0.711s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:23:03 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e9ace6e1-0b41-4e93-801f-d5be903c6b86 tempest-TestStampPattern-979127523 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ff7aff92-ea95-4882-b1bd-9a444df50764 {{(pid=87095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 12:23:03 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e9ace6e1-0b41-4e93-801f-d5be903c6b86 tempest-TestStampPattern-979127523 None] Creating direct copy from snapshot {{(pid=87095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 12:23:03 devstack cinder-volume[87095]: DEBUG cinder.utils [None req-e9ace6e1-0b41-4e93-801f-d5be903c6b86 tempest-TestStampPattern-979127523 None] Path /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-94ff4973-e3d7-4058-b904-8d14ef929429 not found in is_blk_device check {{(pid=87095) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 04 12:23:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e9ace6e1-0b41-4e93-801f-d5be903c6b86 tempest-TestStampPattern-979127523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ff7aff92-ea95-4882-b1bd-9a444df50764 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-94ff4973-e3d7-4058-b904-8d14ef929429 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:23:03 devstack sudo[100697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ff7aff92-ea95-4882-b1bd-9a444df50764 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-94ff4973-e3d7-4058-b904-8d14ef929429 Nov 04 12:23:03 devstack sudo[100697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:23:07 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=81,cinder:UPDATE=89,cinder:INSERT=25,cinder:DELETE=10 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 12:23:07 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=76,cinder:INSERT=26,cinder:UPDATE=90,cinder:DELETE=6 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 12:23:07 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-03981246-39f0-4133-9e5d-742aacb1b185 tempest-VolumeImageDependencyTests-722485005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:23:07 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-03981246-39f0-4133-9e5d-742aacb1b185 tempest-VolumeImageDependencyTests-722485005 None] Flow 'volume_create_manager' (38f6ea96-1e32-4d9e-b78b-a1ffc6827696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:23:07 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-03981246-39f0-4133-9e5d-742aacb1b185 tempest-VolumeImageDependencyTests-722485005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fe0eb34-be34-421e-83dc-df10a609dcd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:23:07 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-03981246-39f0-4133-9e5d-742aacb1b185 tempest-VolumeImageDependencyTests-722485005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fe0eb34-be34-421e-83dc-df10a609dcd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:23:06Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e361c91-672b-408a-afa1-89e604e07f5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc36ce3a75c342b8936d7c9bce40f602',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:23:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:23:07Z,use_quota=True,user_id='f58e38b17f554b088bf39084d617f182',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:23:07 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-03981246-39f0-4133-9e5d-742aacb1b185 tempest-VolumeImageDependencyTests-722485005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (780b7867-f04a-49b4-9b38-958147d41025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:23:07 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-03981246-39f0-4133-9e5d-742aacb1b185 tempest-VolumeImageDependencyTests-722485005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (780b7867-f04a-49b4-9b38-958147d41025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:23:07 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-03981246-39f0-4133-9e5d-742aacb1b185 tempest-VolumeImageDependencyTests-722485005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1108108-c08a-4fda-9c46-71000998300d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:23:07 devstack cinder-volume[87095]: DEBUG cinder.image.glance [None req-03981246-39f0-4133-9e5d-742aacb1b185 tempest-VolumeImageDependencyTests-722485005 None] Creating Keystone auth plugin from conf {{(pid=87095) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 04 12:23:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-03981246-39f0-4133-9e5d-742aacb1b185 tempest-VolumeImageDependencyTests-722485005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1108108-c08a-4fda-9c46-71000998300d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2e361c91-672b-408a-afa1-89e604e07f5b', 'volume_name': 'volume-2e361c91-672b-408a-afa1-89e604e07f5b', 'volume_size': 1, 'image_id': 'dc13fc9f-849b-4086-91d2-91cf496ef7cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dc13fc9f-849b-4086-91d2-91cf496ef7cf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '54300a56e122f0237b0397dfdd307cf2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cc36ce3a75c342b8936d7c9bce40f602', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5364161420799f7cf4ca2a2af1b1541b566d8a41cbf926d1b340c607894500bde72e4c00de0f20c821157b56683c8bdc1930a2bed7ad3266a3f4d2af85f461c0', 'id': 'dc13fc9f-849b-4086-91d2-91cf496ef7cf', 'created_at': datetime.datetime(2026, 11, 4, 11, 23, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 11, 23, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dc13fc9f-849b-4086-91d2-91cf496ef7cf/file', 'properties': {}}, 'image_service': }' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:23:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-03981246-39f0-4133-9e5d-742aacb1b185 tempest-VolumeImageDependencyTests-722485005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a84c2796-dba1-461a-be33-53967c95722d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:23:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-03981246-39f0-4133-9e5d-742aacb1b185 tempest-VolumeImageDependencyTests-722485005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a84c2796-dba1-461a-be33-53967c95722d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:23:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-03981246-39f0-4133-9e5d-742aacb1b185 tempest-VolumeImageDependencyTests-722485005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc9ac7a0-e185-44eb-8faa-299b36844d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:23:08 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-03981246-39f0-4133-9e5d-742aacb1b185 tempest-VolumeImageDependencyTests-722485005 None] Volume 2e361c91-672b-408a-afa1-89e604e07f5b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2e361c91-672b-408a-afa1-89e604e07f5b', 'volume_size': 1, 'image_id': 'dc13fc9f-849b-4086-91d2-91cf496ef7cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dc13fc9f-849b-4086-91d2-91cf496ef7cf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '54300a56e122f0237b0397dfdd307cf2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cc36ce3a75c342b8936d7c9bce40f602', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5364161420799f7cf4ca2a2af1b1541b566d8a41cbf926d1b340c607894500bde72e4c00de0f20c821157b56683c8bdc1930a2bed7ad3266a3f4d2af85f461c0', 'id': 'dc13fc9f-849b-4086-91d2-91cf496ef7cf', 'created_at': datetime.datetime(2026, 11, 4, 11, 23, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 11, 23, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dc13fc9f-849b-4086-91d2-91cf496ef7cf/file', 'properties': {}}, 'image_service': } Nov 04 12:23:08 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-03981246-39f0-4133-9e5d-742aacb1b185 tempest-VolumeImageDependencyTests-722485005 None] Trying to clone 2e361c91-672b-408a-afa1-89e604e07f5b from image dc13fc9f-849b-4086-91d2-91cf496ef7cf at location (None, [{'url': 'file:///opt/stack/data/glance/images/dc13fc9f-849b-4086-91d2-91cf496ef7cf', 'metadata': {}}]). {{(pid=87095) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 04 12:23:08 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-03981246-39f0-4133-9e5d-742aacb1b185 tempest-VolumeImageDependencyTests-722485005 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_dc13fc9f-849b-4086-91d2-91cf496ef7cf_9z1pwyw0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87095) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 04 12:23:08 devstack cinder-volume[87095]: INFO cinder.image.image_utils [None req-03981246-39f0-4133-9e5d-742aacb1b185 tempest-VolumeImageDependencyTests-722485005 None] Image download 0.00 MB at 0.00 MB/s Nov 04 12:23:08 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d41f5ce-3a33-45dc-b665-f9d136c6c957]: (4, 'raw') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:23:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-03981246-39f0-4133-9e5d-742aacb1b185 tempest-VolumeImageDependencyTests-722485005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dc13fc9f-849b-4086-91d2-91cf496ef7cf_9z1pwyw0devstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:23:09 devstack sudo[100751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dc13fc9f-849b-4086-91d2-91cf496ef7cf_9z1pwyw0devstack@QuobyteHD Nov 04 12:23:09 devstack sudo[100751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:23:09 devstack sudo[100751]: pam_unix(sudo:session): session closed for user root Nov 04 12:23:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-03981246-39f0-4133-9e5d-742aacb1b185 tempest-VolumeImageDependencyTests-722485005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dc13fc9f-849b-4086-91d2-91cf496ef7cf_9z1pwyw0devstack@QuobyteHD" returned: 0 in 0.881s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:23:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-03981246-39f0-4133-9e5d-742aacb1b185 tempest-VolumeImageDependencyTests-722485005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dc13fc9f-849b-4086-91d2-91cf496ef7cf_9z1pwyw0devstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:23:10 devstack sudo[100755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dc13fc9f-849b-4086-91d2-91cf496ef7cf_9z1pwyw0devstack@QuobyteHD Nov 04 12:23:10 devstack sudo[100755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:23:10 devstack sudo[100755]: pam_unix(sudo:session): session closed for user root Nov 04 12:23:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-03981246-39f0-4133-9e5d-742aacb1b185 tempest-VolumeImageDependencyTests-722485005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dc13fc9f-849b-4086-91d2-91cf496ef7cf_9z1pwyw0devstack@QuobyteHD" returned: 1 in 1.106s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:23:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-03981246-39f0-4133-9e5d-742aacb1b185 tempest-VolumeImageDependencyTests-722485005 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dc13fc9f-849b-4086-91d2-91cf496ef7cf_9z1pwyw0devstack@QuobyteHD' failed. Not Retrying. {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 12:23:10 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-03981246-39f0-4133-9e5d-742aacb1b185 tempest-VolumeImageDependencyTests-722485005 None] Temporary image dc13fc9f-849b-4086-91d2-91cf496ef7cf is fetched for user f58e38b17f554b088bf39084d617f182. {{(pid=87095) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 04 12:23:10 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3209fb7a-ff2b-4799-853d-2e284caace94]: (4, 'raw') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:23:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-03981246-39f0-4133-9e5d-742aacb1b185 tempest-VolumeImageDependencyTests-722485005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dc13fc9f-849b-4086-91d2-91cf496ef7cf_9z1pwyw0devstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:23:11 devstack sudo[100760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dc13fc9f-849b-4086-91d2-91cf496ef7cf_9z1pwyw0devstack@QuobyteHD Nov 04 12:23:11 devstack sudo[100760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:23:11 devstack sudo[100760]: pam_unix(sudo:session): session closed for user root Nov 04 12:23:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-03981246-39f0-4133-9e5d-742aacb1b185 tempest-VolumeImageDependencyTests-722485005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dc13fc9f-849b-4086-91d2-91cf496ef7cf_9z1pwyw0devstack@QuobyteHD" returned: 0 in 0.959s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:23:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-03981246-39f0-4133-9e5d-742aacb1b185 tempest-VolumeImageDependencyTests-722485005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dc13fc9f-849b-4086-91d2-91cf496ef7cf_9z1pwyw0devstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:23:12 devstack sudo[100764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dc13fc9f-849b-4086-91d2-91cf496ef7cf_9z1pwyw0devstack@QuobyteHD Nov 04 12:23:12 devstack sudo[100764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:23:12 devstack sudo[100764]: pam_unix(sudo:session): session closed for user root Nov 04 12:23:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-03981246-39f0-4133-9e5d-742aacb1b185 tempest-VolumeImageDependencyTests-722485005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dc13fc9f-849b-4086-91d2-91cf496ef7cf_9z1pwyw0devstack@QuobyteHD" returned: 1 in 0.995s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:23:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-03981246-39f0-4133-9e5d-742aacb1b185 tempest-VolumeImageDependencyTests-722485005 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dc13fc9f-849b-4086-91d2-91cf496ef7cf_9z1pwyw0devstack@QuobyteHD' failed. Not Retrying. {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 12:23:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-03981246-39f0-4133-9e5d-742aacb1b185 tempest-VolumeImageDependencyTests-722485005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:23:15 devstack sudo[100697]: pam_unix(sudo:session): session closed for user root Nov 04 12:23:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e9ace6e1-0b41-4e93-801f-d5be903c6b86 tempest-TestStampPattern-979127523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ff7aff92-ea95-4882-b1bd-9a444df50764 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-94ff4973-e3d7-4058-b904-8d14ef929429" returned: 0 in 11.539s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:23:15 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-e9ace6e1-0b41-4e93-801f-d5be903c6b86 tempest-TestStampPattern-979127523 None] Image conversion details: src /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ff7aff92-ea95-4882-b1bd-9a444df50764, size 1024.00 MB, duration 11.54 sec, destination /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-94ff4973-e3d7-4058-b904-8d14ef929429 {{(pid=87095) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 12:23:15 devstack cinder-volume[87095]: INFO cinder.image.image_utils [None req-e9ace6e1-0b41-4e93-801f-d5be903c6b86 tempest-TestStampPattern-979127523 None] Converted 1024.00 MB image at 88.74 MB/s Nov 04 12:23:15 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-e9ace6e1-0b41-4e93-801f-d5be903c6b86 tempest-TestStampPattern-979127523 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-94ff4973-e3d7-4058-b904-8d14ef929429 is being set with open permissions: ugo+rw Nov 04 12:23:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e9ace6e1-0b41-4e93-801f-d5be903c6b86 tempest-TestStampPattern-979127523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-94ff4973-e3d7-4058-b904-8d14ef929429 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:23:15 devstack sudo[100820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-94ff4973-e3d7-4058-b904-8d14ef929429 Nov 04 12:23:15 devstack sudo[100820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:23:15 devstack sudo[100820]: pam_unix(sudo:session): session closed for user root Nov 04 12:23:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e9ace6e1-0b41-4e93-801f-d5be903c6b86 tempest-TestStampPattern-979127523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-94ff4973-e3d7-4058-b904-8d14ef929429" returned: 0 in 0.538s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:23:16 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e9ace6e1-0b41-4e93-801f-d5be903c6b86 tempest-TestStampPattern-979127523 None] Lock "cinder-quobyte-94ff4973-e3d7-4058-b904-8d14ef929429" released by "_copy_volume_from_snapshot" :: held 13.808s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:23:16 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e9ace6e1-0b41-4e93-801f-d5be903c6b86 tempest-TestStampPattern-979127523 None] Lock "cinder-quobyte-f0db180a-2367-4655-b69d-b30fce457998-94ff4973-e3d7-4058-b904-8d14ef929429" released by "_create_volume_from_snapshot" :: held 13.958s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:23:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e9ace6e1-0b41-4e93-801f-d5be903c6b86 tempest-TestStampPattern-979127523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.984s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:23:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-03981246-39f0-4133-9e5d-742aacb1b185 tempest-VolumeImageDependencyTests-722485005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.201s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:23:16 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-03981246-39f0-4133-9e5d-742aacb1b185 tempest-VolumeImageDependencyTests-722485005 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:23:06Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e361c91-672b-408a-afa1-89e604e07f5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc36ce3a75c342b8936d7c9bce40f602',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:23:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:23:07Z,use_quota=True,user_id='f58e38b17f554b088bf39084d617f182',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:23:16 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-03981246-39f0-4133-9e5d-742aacb1b185 tempest-VolumeImageDependencyTests-722485005 None] Creating volume 2e361c91-672b-408a-afa1-89e604e07f5b {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:23:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-03981246-39f0-4133-9e5d-742aacb1b185 tempest-VolumeImageDependencyTests-722485005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:23:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-03981246-39f0-4133-9e5d-742aacb1b185 tempest-VolumeImageDependencyTests-722485005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:23:16 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-03981246-39f0-4133-9e5d-742aacb1b185 tempest-VolumeImageDependencyTests-722485005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:23:16 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-03981246-39f0-4133-9e5d-742aacb1b185 tempest-VolumeImageDependencyTests-722485005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:23:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-03981246-39f0-4133-9e5d-742aacb1b185 tempest-VolumeImageDependencyTests-722485005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:23:16 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-03981246-39f0-4133-9e5d-742aacb1b185 tempest-VolumeImageDependencyTests-722485005 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:23:16 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-03981246-39f0-4133-9e5d-742aacb1b185 tempest-VolumeImageDependencyTests-722485005 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:23:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-03981246-39f0-4133-9e5d-742aacb1b185 tempest-VolumeImageDependencyTests-722485005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2e361c91-672b-408a-afa1-89e604e07f5b 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:23:16 devstack sudo[100858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2e361c91-672b-408a-afa1-89e604e07f5b 1073741824 Nov 04 12:23:16 devstack sudo[100858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:23:16 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e9ace6e1-0b41-4e93-801f-d5be903c6b86 tempest-TestStampPattern-979127523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (645f3e75-8510-4b0e-b9ac-8de94fc6004d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94ff4973-e3d7-4058-b904-8d14ef929429', 'volume_size': 1, 'snapshot_id': 'f0db180a-2367-4655-b69d-b30fce457998'}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:23:16 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e9ace6e1-0b41-4e93-801f-d5be903c6b86 tempest-TestStampPattern-979127523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (427ad8a8-3ca7-48b4-9f08-a1d717cf4f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:23:16 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-e9ace6e1-0b41-4e93-801f-d5be903c6b86 tempest-TestStampPattern-979127523 None] Volume volume-94ff4973-e3d7-4058-b904-8d14ef929429 (94ff4973-e3d7-4058-b904-8d14ef929429): created successfully Nov 04 12:23:16 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e9ace6e1-0b41-4e93-801f-d5be903c6b86 tempest-TestStampPattern-979127523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (427ad8a8-3ca7-48b4-9f08-a1d717cf4f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:23:16 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e9ace6e1-0b41-4e93-801f-d5be903c6b86 tempest-TestStampPattern-979127523 None] Flow 'volume_create_manager' (66c4b640-6aee-43b7-99d8-d9b5f99326f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:23:16 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-e9ace6e1-0b41-4e93-801f-d5be903c6b86 tempest-TestStampPattern-979127523 None] Created volume successfully. Nov 04 12:23:17 devstack sudo[100858]: pam_unix(sudo:session): session closed for user root Nov 04 12:23:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-03981246-39f0-4133-9e5d-742aacb1b185 tempest-VolumeImageDependencyTests-722485005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2e361c91-672b-408a-afa1-89e604e07f5b 1073741824" returned: 0 in 1.130s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:23:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-03981246-39f0-4133-9e5d-742aacb1b185 tempest-VolumeImageDependencyTests-722485005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2e361c91-672b-408a-afa1-89e604e07f5b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:23:17 devstack sudo[100904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2e361c91-672b-408a-afa1-89e604e07f5b Nov 04 12:23:17 devstack sudo[100904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:23:18 devstack sudo[100904]: pam_unix(sudo:session): session closed for user root Nov 04 12:23:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-03981246-39f0-4133-9e5d-742aacb1b185 tempest-VolumeImageDependencyTests-722485005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2e361c91-672b-408a-afa1-89e604e07f5b" returned: 0 in 0.629s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:23:18 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-03981246-39f0-4133-9e5d-742aacb1b185 tempest-VolumeImageDependencyTests-722485005 None] <== create_volume: return (1887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:23:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-03981246-39f0-4133-9e5d-742aacb1b185 tempest-VolumeImageDependencyTests-722485005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.890s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:23:18 devstack cinder-volume[87095]: DEBUG cinder.volume.volume_utils [None req-03981246-39f0-4133-9e5d-742aacb1b185 tempest-VolumeImageDependencyTests-722485005 None] Attempting download of dc13fc9f-849b-4086-91d2-91cf496ef7cf ((None, [{'url': 'file:///opt/stack/data/glance/images/dc13fc9f-849b-4086-91d2-91cf496ef7cf', 'metadata': {}}])) to volume 2e361c91-672b-408a-afa1-89e604e07f5b. {{(pid=87095) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 04 12:23:18 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9241bb21-1b6e-46c1-8e69-86882dda5178]: (4, 'raw') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:23:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-03981246-39f0-4133-9e5d-742aacb1b185 tempest-VolumeImageDependencyTests-722485005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dc13fc9f-849b-4086-91d2-91cf496ef7cf_9c8pw3s8 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:23:18 devstack sudo[100916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dc13fc9f-849b-4086-91d2-91cf496ef7cf_9c8pw3s8 Nov 04 12:23:18 devstack sudo[100916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:23:18 devstack sudo[100916]: pam_unix(sudo:session): session closed for user root Nov 04 12:23:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-03981246-39f0-4133-9e5d-742aacb1b185 tempest-VolumeImageDependencyTests-722485005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dc13fc9f-849b-4086-91d2-91cf496ef7cf_9c8pw3s8" returned: 0 in 0.621s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:23:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-03981246-39f0-4133-9e5d-742aacb1b185 tempest-VolumeImageDependencyTests-722485005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dc13fc9f-849b-4086-91d2-91cf496ef7cf_9c8pw3s8 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:23:18 devstack sudo[100923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dc13fc9f-849b-4086-91d2-91cf496ef7cf_9c8pw3s8 Nov 04 12:23:18 devstack sudo[100923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:23:19 devstack sudo[100923]: pam_unix(sudo:session): session closed for user root Nov 04 12:23:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-03981246-39f0-4133-9e5d-742aacb1b185 tempest-VolumeImageDependencyTests-722485005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dc13fc9f-849b-4086-91d2-91cf496ef7cf_9c8pw3s8" returned: 1 in 0.811s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:23:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-03981246-39f0-4133-9e5d-742aacb1b185 tempest-VolumeImageDependencyTests-722485005 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dc13fc9f-849b-4086-91d2-91cf496ef7cf_9c8pw3s8' failed. Not Retrying. {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 12:23:19 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a554a620-5e42-4a18-900e-3b9ef431b1b9]: (4, 'raw') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:23:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-03981246-39f0-4133-9e5d-742aacb1b185 tempest-VolumeImageDependencyTests-722485005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dc13fc9f-849b-4086-91d2-91cf496ef7cf_9z1pwyw0devstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:23:19 devstack sudo[100931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dc13fc9f-849b-4086-91d2-91cf496ef7cf_9z1pwyw0devstack@QuobyteHD Nov 04 12:23:19 devstack sudo[100931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:23:20 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-249a4c8a-3cde-4959-ab21-814d6c760358 tempest-AttachVolumeNegativeTest-1833368782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:23:20 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-249a4c8a-3cde-4959-ab21-814d6c760358 tempest-AttachVolumeNegativeTest-1833368782 None] Flow 'volume_create_manager' (704919fb-da05-4ad0-8562-88f3667b9211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:23:20 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-249a4c8a-3cde-4959-ab21-814d6c760358 tempest-AttachVolumeNegativeTest-1833368782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e61a0f5-a733-4047-88c1-ae0e05e37dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:23:20 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-249a4c8a-3cde-4959-ab21-814d6c760358 tempest-AttachVolumeNegativeTest-1833368782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e61a0f5-a733-4047-88c1-ae0e05e37dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-298081111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f25dd80-370f-4f73-b1bf-bcbc0b8f41ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af841f214471418c9e103670562e75a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:23:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:23:20Z,use_quota=True,user_id='c5a5a0abad934484bdf8be54400a7185',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:23:20 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-249a4c8a-3cde-4959-ab21-814d6c760358 tempest-AttachVolumeNegativeTest-1833368782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e709e3d-2869-435a-8b9a-1027f8e642f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:23:20 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-249a4c8a-3cde-4959-ab21-814d6c760358 tempest-AttachVolumeNegativeTest-1833368782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e709e3d-2869-435a-8b9a-1027f8e642f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:23:20 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-249a4c8a-3cde-4959-ab21-814d6c760358 tempest-AttachVolumeNegativeTest-1833368782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9200c1bf-9807-465c-ad25-175236d6649a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:23:20 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-249a4c8a-3cde-4959-ab21-814d6c760358 tempest-AttachVolumeNegativeTest-1833368782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9200c1bf-9807-465c-ad25-175236d6649a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f25dd80-370f-4f73-b1bf-bcbc0b8f41ca', 'volume_name': 'volume-9f25dd80-370f-4f73-b1bf-bcbc0b8f41ca', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:23:20 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-249a4c8a-3cde-4959-ab21-814d6c760358 tempest-AttachVolumeNegativeTest-1833368782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3986dee7-9a7a-4ce9-a6e8-c4bdd040666d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:23:20 devstack sudo[100931]: pam_unix(sudo:session): session closed for user root Nov 04 12:23:20 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-249a4c8a-3cde-4959-ab21-814d6c760358 tempest-AttachVolumeNegativeTest-1833368782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3986dee7-9a7a-4ce9-a6e8-c4bdd040666d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:23:20 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-249a4c8a-3cde-4959-ab21-814d6c760358 tempest-AttachVolumeNegativeTest-1833368782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eff065c6-1ca0-43a9-ae13-05ec2db4824f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:23:20 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-249a4c8a-3cde-4959-ab21-814d6c760358 tempest-AttachVolumeNegativeTest-1833368782 None] Volume 9f25dd80-370f-4f73-b1bf-bcbc0b8f41ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f25dd80-370f-4f73-b1bf-bcbc0b8f41ca', 'volume_size': 1} Nov 04 12:23:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-249a4c8a-3cde-4959-ab21-814d6c760358 tempest-AttachVolumeNegativeTest-1833368782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:23:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-249a4c8a-3cde-4959-ab21-814d6c760358 tempest-AttachVolumeNegativeTest-1833368782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:23:20 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-249a4c8a-3cde-4959-ab21-814d6c760358 tempest-AttachVolumeNegativeTest-1833368782 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-298081111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f25dd80-370f-4f73-b1bf-bcbc0b8f41ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af841f214471418c9e103670562e75a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:23:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:23:20Z,use_quota=True,user_id='c5a5a0abad934484bdf8be54400a7185',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:23:20 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-249a4c8a-3cde-4959-ab21-814d6c760358 tempest-AttachVolumeNegativeTest-1833368782 None] Creating volume 9f25dd80-370f-4f73-b1bf-bcbc0b8f41ca {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:23:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-249a4c8a-3cde-4959-ab21-814d6c760358 tempest-AttachVolumeNegativeTest-1833368782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:23:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-249a4c8a-3cde-4959-ab21-814d6c760358 tempest-AttachVolumeNegativeTest-1833368782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:23:20 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-249a4c8a-3cde-4959-ab21-814d6c760358 tempest-AttachVolumeNegativeTest-1833368782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:23:20 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-249a4c8a-3cde-4959-ab21-814d6c760358 tempest-AttachVolumeNegativeTest-1833368782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:23:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-249a4c8a-3cde-4959-ab21-814d6c760358 tempest-AttachVolumeNegativeTest-1833368782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:23:20 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-249a4c8a-3cde-4959-ab21-814d6c760358 tempest-AttachVolumeNegativeTest-1833368782 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:23:20 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-249a4c8a-3cde-4959-ab21-814d6c760358 tempest-AttachVolumeNegativeTest-1833368782 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:23:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-249a4c8a-3cde-4959-ab21-814d6c760358 tempest-AttachVolumeNegativeTest-1833368782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9f25dd80-370f-4f73-b1bf-bcbc0b8f41ca 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:23:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-03981246-39f0-4133-9e5d-742aacb1b185 tempest-VolumeImageDependencyTests-722485005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dc13fc9f-849b-4086-91d2-91cf496ef7cf_9z1pwyw0devstack@QuobyteHD" returned: 0 in 0.750s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:23:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-03981246-39f0-4133-9e5d-742aacb1b185 tempest-VolumeImageDependencyTests-722485005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dc13fc9f-849b-4086-91d2-91cf496ef7cf_9z1pwyw0devstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:23:20 devstack sudo[100935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9f25dd80-370f-4f73-b1bf-bcbc0b8f41ca 1073741824 Nov 04 12:23:20 devstack sudo[100935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:23:20 devstack sudo[100936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dc13fc9f-849b-4086-91d2-91cf496ef7cf_9z1pwyw0devstack@QuobyteHD Nov 04 12:23:20 devstack sudo[100936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:23:21 devstack sudo[100936]: pam_unix(sudo:session): session closed for user root Nov 04 12:23:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-03981246-39f0-4133-9e5d-742aacb1b185 tempest-VolumeImageDependencyTests-722485005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dc13fc9f-849b-4086-91d2-91cf496ef7cf_9z1pwyw0devstack@QuobyteHD" returned: 1 in 0.653s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:23:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-03981246-39f0-4133-9e5d-742aacb1b185 tempest-VolumeImageDependencyTests-722485005 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dc13fc9f-849b-4086-91d2-91cf496ef7cf_9z1pwyw0devstack@QuobyteHD' failed. Not Retrying. {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 12:23:21 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-03981246-39f0-4133-9e5d-742aacb1b185 tempest-VolumeImageDependencyTests-722485005 None] dc13fc9f-849b-4086-91d2-91cf496ef7cf was raw, converting to qcow2 {{(pid=87095) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 04 12:23:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-03981246-39f0-4133-9e5d-742aacb1b185 tempest-VolumeImageDependencyTests-722485005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_dc13fc9f-849b-4086-91d2-91cf496ef7cf_9z1pwyw0devstack@QuobyteHD /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2e361c91-672b-408a-afa1-89e604e07f5b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:23:21 devstack sudo[100935]: pam_unix(sudo:session): session closed for user root Nov 04 12:23:21 devstack sudo[100946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_dc13fc9f-849b-4086-91d2-91cf496ef7cf_9z1pwyw0devstack@QuobyteHD /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2e361c91-672b-408a-afa1-89e604e07f5b Nov 04 12:23:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-249a4c8a-3cde-4959-ab21-814d6c760358 tempest-AttachVolumeNegativeTest-1833368782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9f25dd80-370f-4f73-b1bf-bcbc0b8f41ca 1073741824" returned: 0 in 0.823s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:23:21 devstack sudo[100946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:23:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-249a4c8a-3cde-4959-ab21-814d6c760358 tempest-AttachVolumeNegativeTest-1833368782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9f25dd80-370f-4f73-b1bf-bcbc0b8f41ca {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:23:21 devstack sudo[100948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9f25dd80-370f-4f73-b1bf-bcbc0b8f41ca Nov 04 12:23:21 devstack sudo[100948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:23:21 devstack sudo[100948]: pam_unix(sudo:session): session closed for user root Nov 04 12:23:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-249a4c8a-3cde-4959-ab21-814d6c760358 tempest-AttachVolumeNegativeTest-1833368782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9f25dd80-370f-4f73-b1bf-bcbc0b8f41ca" returned: 0 in 0.616s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:23:21 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-249a4c8a-3cde-4959-ab21-814d6c760358 tempest-AttachVolumeNegativeTest-1833368782 None] <== create_volume: return (1622ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:23:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-249a4c8a-3cde-4959-ab21-814d6c760358 tempest-AttachVolumeNegativeTest-1833368782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.627s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:23:21 devstack sudo[100946]: pam_unix(sudo:session): session closed for user root Nov 04 12:23:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-03981246-39f0-4133-9e5d-742aacb1b185 tempest-VolumeImageDependencyTests-722485005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_dc13fc9f-849b-4086-91d2-91cf496ef7cf_9z1pwyw0devstack@QuobyteHD /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2e361c91-672b-408a-afa1-89e604e07f5b" returned: 0 in 0.931s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:23:21 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-03981246-39f0-4133-9e5d-742aacb1b185 tempest-VolumeImageDependencyTests-722485005 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_dc13fc9f-849b-4086-91d2-91cf496ef7cf_9z1pwyw0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2e361c91-672b-408a-afa1-89e604e07f5b {{(pid=87095) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 12:23:21 devstack cinder-volume[87095]: INFO cinder.image.image_utils [None req-03981246-39f0-4133-9e5d-742aacb1b185 tempest-VolumeImageDependencyTests-722485005 None] Converted 0.00 MB image at 0.00 MB/s Nov 04 12:23:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-03981246-39f0-4133-9e5d-742aacb1b185 tempest-VolumeImageDependencyTests-722485005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2e361c91-672b-408a-afa1-89e604e07f5b 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:23:22 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-249a4c8a-3cde-4959-ab21-814d6c760358 tempest-AttachVolumeNegativeTest-1833368782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eff065c6-1ca0-43a9-ae13-05ec2db4824f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f25dd80-370f-4f73-b1bf-bcbc0b8f41ca', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:23:22 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-249a4c8a-3cde-4959-ab21-814d6c760358 tempest-AttachVolumeNegativeTest-1833368782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f34d6f1-51f9-4d8f-a0dd-77a89f8cc4a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:23:22 devstack sudo[100956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2e361c91-672b-408a-afa1-89e604e07f5b 1G Nov 04 12:23:22 devstack sudo[100956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:23:22 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-249a4c8a-3cde-4959-ab21-814d6c760358 tempest-AttachVolumeNegativeTest-1833368782 None] Volume volume-9f25dd80-370f-4f73-b1bf-bcbc0b8f41ca (9f25dd80-370f-4f73-b1bf-bcbc0b8f41ca): created successfully Nov 04 12:23:22 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-249a4c8a-3cde-4959-ab21-814d6c760358 tempest-AttachVolumeNegativeTest-1833368782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f34d6f1-51f9-4d8f-a0dd-77a89f8cc4a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:23:22 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-249a4c8a-3cde-4959-ab21-814d6c760358 tempest-AttachVolumeNegativeTest-1833368782 None] Flow 'volume_create_manager' (704919fb-da05-4ad0-8562-88f3667b9211) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:23:22 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-249a4c8a-3cde-4959-ab21-814d6c760358 tempest-AttachVolumeNegativeTest-1833368782 None] Created volume successfully. Nov 04 12:23:22 devstack sudo[100956]: pam_unix(sudo:session): session closed for user root Nov 04 12:23:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-03981246-39f0-4133-9e5d-742aacb1b185 tempest-VolumeImageDependencyTests-722485005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2e361c91-672b-408a-afa1-89e604e07f5b 1G" returned: 0 in 0.526s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:23:22 devstack cinder-volume[87095]: DEBUG cinder.volume.volume_utils [None req-03981246-39f0-4133-9e5d-742aacb1b185 tempest-VolumeImageDependencyTests-722485005 None] Downloaded image dc13fc9f-849b-4086-91d2-91cf496ef7cf ((None, [{'url': 'file:///opt/stack/data/glance/images/dc13fc9f-849b-4086-91d2-91cf496ef7cf', 'metadata': {}}])) to volume 2e361c91-672b-408a-afa1-89e604e07f5b successfully. {{(pid=87095) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 04 12:23:22 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-03981246-39f0-4133-9e5d-742aacb1b185 tempest-VolumeImageDependencyTests-722485005 None] Temporary image dc13fc9f-849b-4086-91d2-91cf496ef7cf for user f58e38b17f554b088bf39084d617f182 is deleted. {{(pid=87095) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 04 12:23:22 devstack cinder-volume[87095]: DEBUG cinder.volume.volume_utils [None req-03981246-39f0-4133-9e5d-742aacb1b185 tempest-VolumeImageDependencyTests-722485005 None] Marking volume 2e361c91-672b-408a-afa1-89e604e07f5b as bootable. {{(pid=87095) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 04 12:23:22 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-03981246-39f0-4133-9e5d-742aacb1b185 tempest-VolumeImageDependencyTests-722485005 None] Copying metadata from image dc13fc9f-849b-4086-91d2-91cf496ef7cf to 2e361c91-672b-408a-afa1-89e604e07f5b. {{(pid=87095) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 04 12:23:22 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-03981246-39f0-4133-9e5d-742aacb1b185 tempest-VolumeImageDependencyTests-722485005 None] Creating volume glance metadata for volume 2e361c91-672b-408a-afa1-89e604e07f5b backed by image dc13fc9f-849b-4086-91d2-91cf496ef7cf with: {'image_id': 'dc13fc9f-849b-4086-91d2-91cf496ef7cf', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '54300a56e122f0237b0397dfdd307cf2', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87095) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 04 12:23:22 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-03981246-39f0-4133-9e5d-742aacb1b185 tempest-VolumeImageDependencyTests-722485005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc9ac7a0-e185-44eb-8faa-299b36844d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e361c91-672b-408a-afa1-89e604e07f5b', 'volume_size': 1, 'image_id': 'dc13fc9f-849b-4086-91d2-91cf496ef7cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dc13fc9f-849b-4086-91d2-91cf496ef7cf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '54300a56e122f0237b0397dfdd307cf2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cc36ce3a75c342b8936d7c9bce40f602', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5364161420799f7cf4ca2a2af1b1541b566d8a41cbf926d1b340c607894500bde72e4c00de0f20c821157b56683c8bdc1930a2bed7ad3266a3f4d2af85f461c0', 'id': 'dc13fc9f-849b-4086-91d2-91cf496ef7cf', 'created_at': datetime.datetime(2026, 11, 4, 11, 23, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 11, 23, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dc13fc9f-849b-4086-91d2-91cf496ef7cf/file', 'properties': {}}, 'image_service': }' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:23:22 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-03981246-39f0-4133-9e5d-742aacb1b185 tempest-VolumeImageDependencyTests-722485005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab57d37e-42e0-4895-ace9-e6552de33115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:23:22 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-03981246-39f0-4133-9e5d-742aacb1b185 tempest-VolumeImageDependencyTests-722485005 None] Volume volume-2e361c91-672b-408a-afa1-89e604e07f5b (2e361c91-672b-408a-afa1-89e604e07f5b): created successfully Nov 04 12:23:22 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-03981246-39f0-4133-9e5d-742aacb1b185 tempest-VolumeImageDependencyTests-722485005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab57d37e-42e0-4895-ace9-e6552de33115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:23:22 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-03981246-39f0-4133-9e5d-742aacb1b185 tempest-VolumeImageDependencyTests-722485005 None] Flow 'volume_create_manager' (38f6ea96-1e32-4d9e-b78b-a1ffc6827696) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:23:22 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-03981246-39f0-4133-9e5d-742aacb1b185 tempest-VolumeImageDependencyTests-722485005 None] Created volume successfully. Nov 04 12:23:23 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-86cb19fe-5105-4733-a0ec-c22de68fc78d tempest-VolumeImageDependencyTests-722485005 None] Acquiring lock "cinder-2e361c91-672b-408a-afa1-89e604e07f5b-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:23:23 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-86cb19fe-5105-4733-a0ec-c22de68fc78d tempest-VolumeImageDependencyTests-722485005 None] Lock "cinder-2e361c91-672b-408a-afa1-89e604e07f5b-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:23:23 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-86cb19fe-5105-4733-a0ec-c22de68fc78d tempest-VolumeImageDependencyTests-722485005 None] Acquiring lock "cinder-quobyte-2e361c91-672b-408a-afa1-89e604e07f5b" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:23:23 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-86cb19fe-5105-4733-a0ec-c22de68fc78d tempest-VolumeImageDependencyTests-722485005 None] Lock "cinder-quobyte-2e361c91-672b-408a-afa1-89e604e07f5b" acquired by "delete_volume" :: waited 0.053s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:23:23 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc01f64-6c56-4ee0-9a10-0be6e1877e0a]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:23:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-86cb19fe-5105-4733-a0ec-c22de68fc78d tempest-VolumeImageDependencyTests-722485005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2e361c91-672b-408a-afa1-89e604e07f5b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:23:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-937416b8-b527-4080-992f-8f120ad46488 req-408d46b0-38fd-4b02-84fd-0f745bb69f79 tempest-AttachVolumeNegativeTest-1833368782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:23:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-937416b8-b527-4080-992f-8f120ad46488 req-408d46b0-38fd-4b02-84fd-0f745bb69f79 tempest-AttachVolumeNegativeTest-1833368782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:23:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-937416b8-b527-4080-992f-8f120ad46488 req-408d46b0-38fd-4b02-84fd-0f745bb69f79 tempest-AttachVolumeNegativeTest-1833368782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:23:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-937416b8-b527-4080-992f-8f120ad46488 req-408d46b0-38fd-4b02-84fd-0f745bb69f79 tempest-AttachVolumeNegativeTest-1833368782 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784', 'name': 'volume-9f25dd80-370f-4f73-b1bf-bcbc0b8f41ca', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '013b0781-1dc0-47e0-9ce8-60f4a7ae4219', 'enforce_multipath': True} {{(pid=87095) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 12:23:24 devstack sudo[100973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2e361c91-672b-408a-afa1-89e604e07f5b Nov 04 12:23:24 devstack sudo[100973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:23:24 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-937416b8-b527-4080-992f-8f120ad46488 req-408d46b0-38fd-4b02-84fd-0f745bb69f79 tempest-AttachVolumeNegativeTest-1833368782 None] attachment_update completed successfully. Nov 04 12:23:24 devstack sudo[100973]: pam_unix(sudo:session): session closed for user root Nov 04 12:23:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-86cb19fe-5105-4733-a0ec-c22de68fc78d tempest-VolumeImageDependencyTests-722485005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2e361c91-672b-408a-afa1-89e604e07f5b" returned: 0 in 0.861s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:23:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-86cb19fe-5105-4733-a0ec-c22de68fc78d tempest-VolumeImageDependencyTests-722485005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2e361c91-672b-408a-afa1-89e604e07f5b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:23:24 devstack sudo[101052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2e361c91-672b-408a-afa1-89e604e07f5b Nov 04 12:23:24 devstack sudo[101052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:23:25 devstack sudo[101052]: pam_unix(sudo:session): session closed for user root Nov 04 12:23:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-86cb19fe-5105-4733-a0ec-c22de68fc78d tempest-VolumeImageDependencyTests-722485005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2e361c91-672b-408a-afa1-89e604e07f5b" returned: 0 in 0.653s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:23:25 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-86cb19fe-5105-4733-a0ec-c22de68fc78d tempest-VolumeImageDependencyTests-722485005 None] Lock "cinder-quobyte-2e361c91-672b-408a-afa1-89e604e07f5b" released by "delete_volume" :: held 1.636s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:23:25 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-86cb19fe-5105-4733-a0ec-c22de68fc78d tempest-VolumeImageDependencyTests-722485005 None] Created reservations ['954d0bf1-6ef6-466d-bbb1-82d112c6ca58', '3eddee92-31cd-43a4-a073-84ddccad160e', '2712ca55-e19e-463e-a585-058322eeba86', 'd3c4863b-4843-4a31-9eb4-0d5099788863'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:23:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-86cb19fe-5105-4733-a0ec-c22de68fc78d tempest-VolumeImageDependencyTests-722485005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:23:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-86cb19fe-5105-4733-a0ec-c22de68fc78d tempest-VolumeImageDependencyTests-722485005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:23:25 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-86cb19fe-5105-4733-a0ec-c22de68fc78d tempest-VolumeImageDependencyTests-722485005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:23:25 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-86cb19fe-5105-4733-a0ec-c22de68fc78d tempest-VolumeImageDependencyTests-722485005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:23:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-86cb19fe-5105-4733-a0ec-c22de68fc78d tempest-VolumeImageDependencyTests-722485005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:23:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-86cb19fe-5105-4733-a0ec-c22de68fc78d tempest-VolumeImageDependencyTests-722485005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:23:25 devstack sudo[101396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:23:25 devstack sudo[101396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:23:26 devstack sudo[101396]: pam_unix(sudo:session): session closed for user root Nov 04 12:23:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-86cb19fe-5105-4733-a0ec-c22de68fc78d tempest-VolumeImageDependencyTests-722485005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.542s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:23:26 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-86cb19fe-5105-4733-a0ec-c22de68fc78d tempest-VolumeImageDependencyTests-722485005 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:23:26 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-86cb19fe-5105-4733-a0ec-c22de68fc78d tempest-VolumeImageDependencyTests-722485005 None] Deleted volume successfully. Nov 04 12:23:26 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-86cb19fe-5105-4733-a0ec-c22de68fc78d tempest-VolumeImageDependencyTests-722485005 None] Lock "cinder-2e361c91-672b-408a-afa1-89e604e07f5b-delete_volume" released by "delete_volume" :: held 2.779s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:23:28 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-c32a7038-a908-44e5-a262-eb8859fad459 req-29a1fea3-3883-4429-b117-5bcfe8420cb9 tempest-AttachVolumeNegativeTest-1833368782 None] Terminate volume connection completed successfully. Nov 04 12:23:28 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-c32a7038-a908-44e5-a262-eb8859fad459 req-29a1fea3-3883-4429-b117-5bcfe8420cb9 tempest-AttachVolumeNegativeTest-1833368782 None] Deleting attachment 013b0781-1dc0-47e0-9ce8-60f4a7ae4219. {{(pid=87095) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 12:23:34 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-9eab81b7-4675-4ad8-a012-d1a9106dbd40 tempest-ProjectReaderTests-1637176165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:23:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9eab81b7-4675-4ad8-a012-d1a9106dbd40 tempest-ProjectReaderTests-1637176165 None] Flow 'volume_create_manager' (a8055594-b654-4d3f-a2cc-5b07d0ceb7a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:23:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9eab81b7-4675-4ad8-a012-d1a9106dbd40 tempest-ProjectReaderTests-1637176165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd42091c-b569-40c5-add3-2075b876743d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:23:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9eab81b7-4675-4ad8-a012-d1a9106dbd40 tempest-ProjectReaderTests-1637176165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd42091c-b569-40c5-add3-2075b876743d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:23:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-742856699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7adb36a-d8fc-4ca6-b927-4e257385bd58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0626e2fa0d1b466ea90f590ed97276ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:23:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:23:34Z,use_quota=True,user_id='10687887fe6b44f98b54a33659e259ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:23:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9eab81b7-4675-4ad8-a012-d1a9106dbd40 tempest-ProjectReaderTests-1637176165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f662e606-1ca7-4992-9ea7-1d39cc7cebac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:23:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9eab81b7-4675-4ad8-a012-d1a9106dbd40 tempest-ProjectReaderTests-1637176165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f662e606-1ca7-4992-9ea7-1d39cc7cebac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:23:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9eab81b7-4675-4ad8-a012-d1a9106dbd40 tempest-ProjectReaderTests-1637176165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17c19f15-a8d0-4108-b348-91bdc9dcc258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:23:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9eab81b7-4675-4ad8-a012-d1a9106dbd40 tempest-ProjectReaderTests-1637176165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17c19f15-a8d0-4108-b348-91bdc9dcc258) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7adb36a-d8fc-4ca6-b927-4e257385bd58', 'volume_name': 'volume-c7adb36a-d8fc-4ca6-b927-4e257385bd58', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:23:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9eab81b7-4675-4ad8-a012-d1a9106dbd40 tempest-ProjectReaderTests-1637176165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc6aff9f-eb27-44af-803d-12803f044b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:23:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9eab81b7-4675-4ad8-a012-d1a9106dbd40 tempest-ProjectReaderTests-1637176165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc6aff9f-eb27-44af-803d-12803f044b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:23:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9eab81b7-4675-4ad8-a012-d1a9106dbd40 tempest-ProjectReaderTests-1637176165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43cadd37-0a20-4990-af63-e91de203339b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:23:34 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-9eab81b7-4675-4ad8-a012-d1a9106dbd40 tempest-ProjectReaderTests-1637176165 None] Volume c7adb36a-d8fc-4ca6-b927-4e257385bd58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7adb36a-d8fc-4ca6-b927-4e257385bd58', 'volume_size': 1} Nov 04 12:23:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9eab81b7-4675-4ad8-a012-d1a9106dbd40 tempest-ProjectReaderTests-1637176165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:23:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9eab81b7-4675-4ad8-a012-d1a9106dbd40 tempest-ProjectReaderTests-1637176165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:23:34 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9eab81b7-4675-4ad8-a012-d1a9106dbd40 tempest-ProjectReaderTests-1637176165 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:23:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-742856699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7adb36a-d8fc-4ca6-b927-4e257385bd58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0626e2fa0d1b466ea90f590ed97276ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:23:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:23:34Z,use_quota=True,user_id='10687887fe6b44f98b54a33659e259ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:23:34 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-9eab81b7-4675-4ad8-a012-d1a9106dbd40 tempest-ProjectReaderTests-1637176165 None] Creating volume c7adb36a-d8fc-4ca6-b927-4e257385bd58 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:23:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9eab81b7-4675-4ad8-a012-d1a9106dbd40 tempest-ProjectReaderTests-1637176165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:23:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9eab81b7-4675-4ad8-a012-d1a9106dbd40 tempest-ProjectReaderTests-1637176165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:23:34 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9eab81b7-4675-4ad8-a012-d1a9106dbd40 tempest-ProjectReaderTests-1637176165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:23:34 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9eab81b7-4675-4ad8-a012-d1a9106dbd40 tempest-ProjectReaderTests-1637176165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:23:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9eab81b7-4675-4ad8-a012-d1a9106dbd40 tempest-ProjectReaderTests-1637176165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:23:34 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9eab81b7-4675-4ad8-a012-d1a9106dbd40 tempest-ProjectReaderTests-1637176165 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:23:34 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-9eab81b7-4675-4ad8-a012-d1a9106dbd40 tempest-ProjectReaderTests-1637176165 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:23:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9eab81b7-4675-4ad8-a012-d1a9106dbd40 tempest-ProjectReaderTests-1637176165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c7adb36a-d8fc-4ca6-b927-4e257385bd58 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:23:34 devstack sudo[101558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c7adb36a-d8fc-4ca6-b927-4e257385bd58 1073741824 Nov 04 12:23:34 devstack sudo[101558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:23:34 devstack sudo[101558]: pam_unix(sudo:session): session closed for user root Nov 04 12:23:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9eab81b7-4675-4ad8-a012-d1a9106dbd40 tempest-ProjectReaderTests-1637176165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c7adb36a-d8fc-4ca6-b927-4e257385bd58 1073741824" returned: 0 in 0.466s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:23:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9eab81b7-4675-4ad8-a012-d1a9106dbd40 tempest-ProjectReaderTests-1637176165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c7adb36a-d8fc-4ca6-b927-4e257385bd58 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:23:34 devstack sudo[101564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c7adb36a-d8fc-4ca6-b927-4e257385bd58 Nov 04 12:23:34 devstack sudo[101564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:23:34 devstack sudo[101564]: pam_unix(sudo:session): session closed for user root Nov 04 12:23:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9eab81b7-4675-4ad8-a012-d1a9106dbd40 tempest-ProjectReaderTests-1637176165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c7adb36a-d8fc-4ca6-b927-4e257385bd58" returned: 0 in 0.259s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:23:34 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9eab81b7-4675-4ad8-a012-d1a9106dbd40 tempest-ProjectReaderTests-1637176165 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:23:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9eab81b7-4675-4ad8-a012-d1a9106dbd40 tempest-ProjectReaderTests-1637176165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:23:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9eab81b7-4675-4ad8-a012-d1a9106dbd40 tempest-ProjectReaderTests-1637176165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43cadd37-0a20-4990-af63-e91de203339b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7adb36a-d8fc-4ca6-b927-4e257385bd58', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:23:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9eab81b7-4675-4ad8-a012-d1a9106dbd40 tempest-ProjectReaderTests-1637176165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f426015c-e75f-4e97-b748-30701d404bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:23:35 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-9eab81b7-4675-4ad8-a012-d1a9106dbd40 tempest-ProjectReaderTests-1637176165 None] Volume volume-c7adb36a-d8fc-4ca6-b927-4e257385bd58 (c7adb36a-d8fc-4ca6-b927-4e257385bd58): created successfully Nov 04 12:23:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9eab81b7-4675-4ad8-a012-d1a9106dbd40 tempest-ProjectReaderTests-1637176165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f426015c-e75f-4e97-b748-30701d404bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:23:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9eab81b7-4675-4ad8-a012-d1a9106dbd40 tempest-ProjectReaderTests-1637176165 None] Flow 'volume_create_manager' (a8055594-b654-4d3f-a2cc-5b07d0ceb7a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:23:35 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-9eab81b7-4675-4ad8-a012-d1a9106dbd40 tempest-ProjectReaderTests-1637176165 None] Created volume successfully. Nov 04 12:23:36 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-191671aa-9d3b-49f3-af95-3f7d387fe447 tempest-ProjectReaderTests-1637176165 None] Acquiring lock "cinder-c7adb36a-d8fc-4ca6-b927-4e257385bd58-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:23:36 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-191671aa-9d3b-49f3-af95-3f7d387fe447 tempest-ProjectReaderTests-1637176165 None] Lock "cinder-c7adb36a-d8fc-4ca6-b927-4e257385bd58-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:23:36 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-191671aa-9d3b-49f3-af95-3f7d387fe447 tempest-ProjectReaderTests-1637176165 None] Acquiring lock "cinder-quobyte-c7adb36a-d8fc-4ca6-b927-4e257385bd58" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:23:36 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-191671aa-9d3b-49f3-af95-3f7d387fe447 tempest-ProjectReaderTests-1637176165 None] Lock "cinder-quobyte-c7adb36a-d8fc-4ca6-b927-4e257385bd58" acquired by "delete_volume" :: waited 0.020s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:23:36 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[816833f9-77e7-41b8-8995-1fc801d28f81]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:23:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-191671aa-9d3b-49f3-af95-3f7d387fe447 tempest-ProjectReaderTests-1637176165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c7adb36a-d8fc-4ca6-b927-4e257385bd58 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:23:36 devstack sudo[101568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c7adb36a-d8fc-4ca6-b927-4e257385bd58 Nov 04 12:23:36 devstack sudo[101568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:23:36 devstack sudo[101568]: pam_unix(sudo:session): session closed for user root Nov 04 12:23:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-191671aa-9d3b-49f3-af95-3f7d387fe447 tempest-ProjectReaderTests-1637176165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c7adb36a-d8fc-4ca6-b927-4e257385bd58" returned: 0 in 0.393s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:23:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-191671aa-9d3b-49f3-af95-3f7d387fe447 tempest-ProjectReaderTests-1637176165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c7adb36a-d8fc-4ca6-b927-4e257385bd58 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:23:36 devstack sudo[101573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c7adb36a-d8fc-4ca6-b927-4e257385bd58 Nov 04 12:23:36 devstack sudo[101573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:23:37 devstack sudo[101573]: pam_unix(sudo:session): session closed for user root Nov 04 12:23:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-191671aa-9d3b-49f3-af95-3f7d387fe447 tempest-ProjectReaderTests-1637176165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c7adb36a-d8fc-4ca6-b927-4e257385bd58" returned: 0 in 0.256s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:23:37 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-191671aa-9d3b-49f3-af95-3f7d387fe447 tempest-ProjectReaderTests-1637176165 None] Lock "cinder-quobyte-c7adb36a-d8fc-4ca6-b927-4e257385bd58" released by "delete_volume" :: held 0.696s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:23:37 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-191671aa-9d3b-49f3-af95-3f7d387fe447 tempest-ProjectReaderTests-1637176165 None] Created reservations ['08375a45-35e6-47f7-8103-25169a79e9df', '93485674-b673-45aa-b099-943b06614ec5', 'd2d67719-8073-42fc-8165-b0bf9142fdfe', '47d40afd-8b67-4fe0-b592-1d0fa54262b2'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:23:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-191671aa-9d3b-49f3-af95-3f7d387fe447 tempest-ProjectReaderTests-1637176165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:23:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-191671aa-9d3b-49f3-af95-3f7d387fe447 tempest-ProjectReaderTests-1637176165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:23:37 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-191671aa-9d3b-49f3-af95-3f7d387fe447 tempest-ProjectReaderTests-1637176165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:23:37 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-191671aa-9d3b-49f3-af95-3f7d387fe447 tempest-ProjectReaderTests-1637176165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:23:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-191671aa-9d3b-49f3-af95-3f7d387fe447 tempest-ProjectReaderTests-1637176165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:23:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-191671aa-9d3b-49f3-af95-3f7d387fe447 tempest-ProjectReaderTests-1637176165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:23:37 devstack sudo[101576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:23:37 devstack sudo[101576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:23:37 devstack sudo[101576]: pam_unix(sudo:session): session closed for user root Nov 04 12:23:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-191671aa-9d3b-49f3-af95-3f7d387fe447 tempest-ProjectReaderTests-1637176165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.256s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:23:37 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-191671aa-9d3b-49f3-af95-3f7d387fe447 tempest-ProjectReaderTests-1637176165 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:23:37 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-191671aa-9d3b-49f3-af95-3f7d387fe447 tempest-ProjectReaderTests-1637176165 None] Deleted volume successfully. Nov 04 12:23:37 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-191671aa-9d3b-49f3-af95-3f7d387fe447 tempest-ProjectReaderTests-1637176165 None] Lock "cinder-c7adb36a-d8fc-4ca6-b927-4e257385bd58-delete_volume" released by "delete_volume" :: held 1.187s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:23:37 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-27810f07-d501-4a02-831d-2f11cc11f554 tempest-ProjectReaderTests-1637176165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:23:37 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-27810f07-d501-4a02-831d-2f11cc11f554 tempest-ProjectReaderTests-1637176165 None] Flow 'volume_create_manager' (5fd0c8d7-5c3a-4f61-897c-b805cef4a79d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:23:38 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-27810f07-d501-4a02-831d-2f11cc11f554 tempest-ProjectReaderTests-1637176165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f8a8d9c-52fc-4c93-a951-d0171d9c5395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:23:38 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-27810f07-d501-4a02-831d-2f11cc11f554 tempest-ProjectReaderTests-1637176165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f8a8d9c-52fc-4c93-a951-d0171d9c5395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-373961827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b47787e-c6a2-47e4-be5b-735972072425,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0626e2fa0d1b466ea90f590ed97276ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:23:38Z,use_quota=True,user_id='10687887fe6b44f98b54a33659e259ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:23:38 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-27810f07-d501-4a02-831d-2f11cc11f554 tempest-ProjectReaderTests-1637176165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2730b9ac-817e-4fcb-9af6-caef387a7f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:23:38 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-27810f07-d501-4a02-831d-2f11cc11f554 tempest-ProjectReaderTests-1637176165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2730b9ac-817e-4fcb-9af6-caef387a7f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:23:38 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-27810f07-d501-4a02-831d-2f11cc11f554 tempest-ProjectReaderTests-1637176165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae61b468-1035-4e57-8515-f5e03b7459ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:23:38 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-27810f07-d501-4a02-831d-2f11cc11f554 tempest-ProjectReaderTests-1637176165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae61b468-1035-4e57-8515-f5e03b7459ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b47787e-c6a2-47e4-be5b-735972072425', 'volume_name': 'volume-6b47787e-c6a2-47e4-be5b-735972072425', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:23:38 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-27810f07-d501-4a02-831d-2f11cc11f554 tempest-ProjectReaderTests-1637176165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (685add5c-9b02-49cc-98b2-1b5b6bc88b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:23:38 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-27810f07-d501-4a02-831d-2f11cc11f554 tempest-ProjectReaderTests-1637176165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (685add5c-9b02-49cc-98b2-1b5b6bc88b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:23:38 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-27810f07-d501-4a02-831d-2f11cc11f554 tempest-ProjectReaderTests-1637176165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57750857-2169-4dd8-832d-bb7c66907a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:23:38 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-27810f07-d501-4a02-831d-2f11cc11f554 tempest-ProjectReaderTests-1637176165 None] Volume 6b47787e-c6a2-47e4-be5b-735972072425: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b47787e-c6a2-47e4-be5b-735972072425', 'volume_size': 1} Nov 04 12:23:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-27810f07-d501-4a02-831d-2f11cc11f554 tempest-ProjectReaderTests-1637176165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:23:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-27810f07-d501-4a02-831d-2f11cc11f554 tempest-ProjectReaderTests-1637176165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:23:38 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-27810f07-d501-4a02-831d-2f11cc11f554 tempest-ProjectReaderTests-1637176165 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-373961827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b47787e-c6a2-47e4-be5b-735972072425,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0626e2fa0d1b466ea90f590ed97276ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:23:38Z,use_quota=True,user_id='10687887fe6b44f98b54a33659e259ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:23:38 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-27810f07-d501-4a02-831d-2f11cc11f554 tempest-ProjectReaderTests-1637176165 None] Creating volume 6b47787e-c6a2-47e4-be5b-735972072425 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:23:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-27810f07-d501-4a02-831d-2f11cc11f554 tempest-ProjectReaderTests-1637176165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:23:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-27810f07-d501-4a02-831d-2f11cc11f554 tempest-ProjectReaderTests-1637176165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:23:38 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-27810f07-d501-4a02-831d-2f11cc11f554 tempest-ProjectReaderTests-1637176165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:23:38 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-27810f07-d501-4a02-831d-2f11cc11f554 tempest-ProjectReaderTests-1637176165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:23:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-27810f07-d501-4a02-831d-2f11cc11f554 tempest-ProjectReaderTests-1637176165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:23:38 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-27810f07-d501-4a02-831d-2f11cc11f554 tempest-ProjectReaderTests-1637176165 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:23:38 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-27810f07-d501-4a02-831d-2f11cc11f554 tempest-ProjectReaderTests-1637176165 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:23:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-27810f07-d501-4a02-831d-2f11cc11f554 tempest-ProjectReaderTests-1637176165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6b47787e-c6a2-47e4-be5b-735972072425 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:23:38 devstack sudo[101579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6b47787e-c6a2-47e4-be5b-735972072425 1073741824 Nov 04 12:23:38 devstack sudo[101579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:23:38 devstack sudo[101579]: pam_unix(sudo:session): session closed for user root Nov 04 12:23:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-27810f07-d501-4a02-831d-2f11cc11f554 tempest-ProjectReaderTests-1637176165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6b47787e-c6a2-47e4-be5b-735972072425 1073741824" returned: 0 in 0.459s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:23:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-27810f07-d501-4a02-831d-2f11cc11f554 tempest-ProjectReaderTests-1637176165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6b47787e-c6a2-47e4-be5b-735972072425 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:23:38 devstack sudo[101588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6b47787e-c6a2-47e4-be5b-735972072425 Nov 04 12:23:38 devstack sudo[101588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:23:38 devstack sudo[101588]: pam_unix(sudo:session): session closed for user root Nov 04 12:23:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-27810f07-d501-4a02-831d-2f11cc11f554 tempest-ProjectReaderTests-1637176165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6b47787e-c6a2-47e4-be5b-735972072425" returned: 0 in 0.269s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:23:38 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-27810f07-d501-4a02-831d-2f11cc11f554 tempest-ProjectReaderTests-1637176165 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:23:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-27810f07-d501-4a02-831d-2f11cc11f554 tempest-ProjectReaderTests-1637176165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:23:38 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-27810f07-d501-4a02-831d-2f11cc11f554 tempest-ProjectReaderTests-1637176165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57750857-2169-4dd8-832d-bb7c66907a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b47787e-c6a2-47e4-be5b-735972072425', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:23:38 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-27810f07-d501-4a02-831d-2f11cc11f554 tempest-ProjectReaderTests-1637176165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (102a6981-d7b6-4534-874e-1f49bcd2ccb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:23:38 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-27810f07-d501-4a02-831d-2f11cc11f554 tempest-ProjectReaderTests-1637176165 None] Volume volume-6b47787e-c6a2-47e4-be5b-735972072425 (6b47787e-c6a2-47e4-be5b-735972072425): created successfully Nov 04 12:23:38 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-27810f07-d501-4a02-831d-2f11cc11f554 tempest-ProjectReaderTests-1637176165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (102a6981-d7b6-4534-874e-1f49bcd2ccb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:23:38 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-27810f07-d501-4a02-831d-2f11cc11f554 tempest-ProjectReaderTests-1637176165 None] Flow 'volume_create_manager' (5fd0c8d7-5c3a-4f61-897c-b805cef4a79d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:23:38 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-27810f07-d501-4a02-831d-2f11cc11f554 tempest-ProjectReaderTests-1637176165 None] Created volume successfully. Nov 04 12:23:39 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7f51d57f-f623-4f4b-8fe1-dfaa7c7673ff tempest-ProjectReaderTests-1637176165 None] Acquiring lock "cinder-6b47787e-c6a2-47e4-be5b-735972072425-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:23:39 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7f51d57f-f623-4f4b-8fe1-dfaa7c7673ff tempest-ProjectReaderTests-1637176165 None] Lock "cinder-6b47787e-c6a2-47e4-be5b-735972072425-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:23:39 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7f51d57f-f623-4f4b-8fe1-dfaa7c7673ff tempest-ProjectReaderTests-1637176165 None] Acquiring lock "cinder-quobyte-6b47787e-c6a2-47e4-be5b-735972072425" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:23:39 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7f51d57f-f623-4f4b-8fe1-dfaa7c7673ff tempest-ProjectReaderTests-1637176165 None] Lock "cinder-quobyte-6b47787e-c6a2-47e4-be5b-735972072425" acquired by "delete_volume" :: waited 0.013s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:23:39 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8146fc5-ca7d-435f-bddd-5c8a21326112]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:23:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7f51d57f-f623-4f4b-8fe1-dfaa7c7673ff tempest-ProjectReaderTests-1637176165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6b47787e-c6a2-47e4-be5b-735972072425 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:23:39 devstack sudo[101591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6b47787e-c6a2-47e4-be5b-735972072425 Nov 04 12:23:39 devstack sudo[101591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:23:39 devstack sudo[101591]: pam_unix(sudo:session): session closed for user root Nov 04 12:23:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7f51d57f-f623-4f4b-8fe1-dfaa7c7673ff tempest-ProjectReaderTests-1637176165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6b47787e-c6a2-47e4-be5b-735972072425" returned: 0 in 0.481s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:23:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7f51d57f-f623-4f4b-8fe1-dfaa7c7673ff tempest-ProjectReaderTests-1637176165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6b47787e-c6a2-47e4-be5b-735972072425 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:23:39 devstack sudo[101596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6b47787e-c6a2-47e4-be5b-735972072425 Nov 04 12:23:39 devstack sudo[101596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:23:39 devstack sudo[101596]: pam_unix(sudo:session): session closed for user root Nov 04 12:23:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7f51d57f-f623-4f4b-8fe1-dfaa7c7673ff tempest-ProjectReaderTests-1637176165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6b47787e-c6a2-47e4-be5b-735972072425" returned: 0 in 0.305s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:23:39 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7f51d57f-f623-4f4b-8fe1-dfaa7c7673ff tempest-ProjectReaderTests-1637176165 None] Lock "cinder-quobyte-6b47787e-c6a2-47e4-be5b-735972072425" released by "delete_volume" :: held 0.846s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:23:40 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-7f51d57f-f623-4f4b-8fe1-dfaa7c7673ff tempest-ProjectReaderTests-1637176165 None] Created reservations ['126c76dc-7368-4e8a-a7fe-76f9e1f316fc', '04e6ec82-3ec0-4889-b134-94bd104b8034', '54dfaa0a-380f-4047-8db8-4731e2c59f41', 'fd5991f9-1df6-43d9-95ce-79c427d4c550'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:23:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7f51d57f-f623-4f4b-8fe1-dfaa7c7673ff tempest-ProjectReaderTests-1637176165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:23:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7f51d57f-f623-4f4b-8fe1-dfaa7c7673ff tempest-ProjectReaderTests-1637176165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:23:40 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7f51d57f-f623-4f4b-8fe1-dfaa7c7673ff tempest-ProjectReaderTests-1637176165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:23:40 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7f51d57f-f623-4f4b-8fe1-dfaa7c7673ff tempest-ProjectReaderTests-1637176165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:23:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7f51d57f-f623-4f4b-8fe1-dfaa7c7673ff tempest-ProjectReaderTests-1637176165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:23:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7f51d57f-f623-4f4b-8fe1-dfaa7c7673ff tempest-ProjectReaderTests-1637176165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:23:40 devstack sudo[101610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:23:40 devstack sudo[101610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:23:40 devstack sudo[101610]: pam_unix(sudo:session): session closed for user root Nov 04 12:23:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7f51d57f-f623-4f4b-8fe1-dfaa7c7673ff tempest-ProjectReaderTests-1637176165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.556s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:23:40 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-7f51d57f-f623-4f4b-8fe1-dfaa7c7673ff tempest-ProjectReaderTests-1637176165 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:23:40 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-7f51d57f-f623-4f4b-8fe1-dfaa7c7673ff tempest-ProjectReaderTests-1637176165 None] Deleted volume successfully. Nov 04 12:23:40 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7f51d57f-f623-4f4b-8fe1-dfaa7c7673ff tempest-ProjectReaderTests-1637176165 None] Lock "cinder-6b47787e-c6a2-47e4-be5b-735972072425-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:23:45 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a958945-45fb-4d79-a8a0-f4c96a99769c tempest-TestServerVolumeAttachScenarioOldVersion-1574132057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:23:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9a958945-45fb-4d79-a8a0-f4c96a99769c tempest-TestServerVolumeAttachScenarioOldVersion-1574132057 None] Flow 'volume_create_manager' (39cc29af-f4bf-4781-87de-b5c64130c3cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:23:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9a958945-45fb-4d79-a8a0-f4c96a99769c tempest-TestServerVolumeAttachScenarioOldVersion-1574132057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0edb9822-274e-4d57-8bd0-5f590bfa2271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:23:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9a958945-45fb-4d79-a8a0-f4c96a99769c tempest-TestServerVolumeAttachScenarioOldVersion-1574132057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0edb9822-274e-4d57-8bd0-5f590bfa2271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:23:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-932989138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36c00b28-75e5-43d8-a2d0-0bc4bf2a7659,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6544eff3a23747bc83ea310ea8e78ef8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:23:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:23:45Z,use_quota=True,user_id='769eb76861384d9b8bdb2561f322bedd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:23:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9a958945-45fb-4d79-a8a0-f4c96a99769c tempest-TestServerVolumeAttachScenarioOldVersion-1574132057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bed95290-5d40-4967-871a-78154db4ca87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:23:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9a958945-45fb-4d79-a8a0-f4c96a99769c tempest-TestServerVolumeAttachScenarioOldVersion-1574132057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bed95290-5d40-4967-871a-78154db4ca87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:23:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9a958945-45fb-4d79-a8a0-f4c96a99769c tempest-TestServerVolumeAttachScenarioOldVersion-1574132057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f62cd7f4-6983-4d89-8062-c9cf16273d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:23:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9a958945-45fb-4d79-a8a0-f4c96a99769c tempest-TestServerVolumeAttachScenarioOldVersion-1574132057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f62cd7f4-6983-4d89-8062-c9cf16273d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36c00b28-75e5-43d8-a2d0-0bc4bf2a7659', 'volume_name': 'volume-36c00b28-75e5-43d8-a2d0-0bc4bf2a7659', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:23:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9a958945-45fb-4d79-a8a0-f4c96a99769c tempest-TestServerVolumeAttachScenarioOldVersion-1574132057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76f3a270-a38e-433e-a1a9-db17f99e6665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:23:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9a958945-45fb-4d79-a8a0-f4c96a99769c tempest-TestServerVolumeAttachScenarioOldVersion-1574132057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76f3a270-a38e-433e-a1a9-db17f99e6665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:23:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9a958945-45fb-4d79-a8a0-f4c96a99769c tempest-TestServerVolumeAttachScenarioOldVersion-1574132057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec23472d-be5a-405b-b479-2a96715808da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:23:45 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-9a958945-45fb-4d79-a8a0-f4c96a99769c tempest-TestServerVolumeAttachScenarioOldVersion-1574132057 None] Volume 36c00b28-75e5-43d8-a2d0-0bc4bf2a7659: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36c00b28-75e5-43d8-a2d0-0bc4bf2a7659', 'volume_size': 1} Nov 04 12:23:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9a958945-45fb-4d79-a8a0-f4c96a99769c tempest-TestServerVolumeAttachScenarioOldVersion-1574132057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:23:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9a958945-45fb-4d79-a8a0-f4c96a99769c tempest-TestServerVolumeAttachScenarioOldVersion-1574132057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:23:45 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9a958945-45fb-4d79-a8a0-f4c96a99769c tempest-TestServerVolumeAttachScenarioOldVersion-1574132057 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:23:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-932989138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36c00b28-75e5-43d8-a2d0-0bc4bf2a7659,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6544eff3a23747bc83ea310ea8e78ef8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:23:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:23:45Z,use_quota=True,user_id='769eb76861384d9b8bdb2561f322bedd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:23:45 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-9a958945-45fb-4d79-a8a0-f4c96a99769c tempest-TestServerVolumeAttachScenarioOldVersion-1574132057 None] Creating volume 36c00b28-75e5-43d8-a2d0-0bc4bf2a7659 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:23:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9a958945-45fb-4d79-a8a0-f4c96a99769c tempest-TestServerVolumeAttachScenarioOldVersion-1574132057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:23:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9a958945-45fb-4d79-a8a0-f4c96a99769c tempest-TestServerVolumeAttachScenarioOldVersion-1574132057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:23:45 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9a958945-45fb-4d79-a8a0-f4c96a99769c tempest-TestServerVolumeAttachScenarioOldVersion-1574132057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:23:45 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9a958945-45fb-4d79-a8a0-f4c96a99769c tempest-TestServerVolumeAttachScenarioOldVersion-1574132057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:23:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9a958945-45fb-4d79-a8a0-f4c96a99769c tempest-TestServerVolumeAttachScenarioOldVersion-1574132057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:23:45 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9a958945-45fb-4d79-a8a0-f4c96a99769c tempest-TestServerVolumeAttachScenarioOldVersion-1574132057 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:23:45 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-9a958945-45fb-4d79-a8a0-f4c96a99769c tempest-TestServerVolumeAttachScenarioOldVersion-1574132057 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:23:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9a958945-45fb-4d79-a8a0-f4c96a99769c tempest-TestServerVolumeAttachScenarioOldVersion-1574132057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-36c00b28-75e5-43d8-a2d0-0bc4bf2a7659 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:23:45 devstack sudo[101692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-36c00b28-75e5-43d8-a2d0-0bc4bf2a7659 1073741824 Nov 04 12:23:45 devstack sudo[101692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:23:46 devstack sudo[101692]: pam_unix(sudo:session): session closed for user root Nov 04 12:23:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9a958945-45fb-4d79-a8a0-f4c96a99769c tempest-TestServerVolumeAttachScenarioOldVersion-1574132057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-36c00b28-75e5-43d8-a2d0-0bc4bf2a7659 1073741824" returned: 0 in 0.614s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:23:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9a958945-45fb-4d79-a8a0-f4c96a99769c tempest-TestServerVolumeAttachScenarioOldVersion-1574132057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-36c00b28-75e5-43d8-a2d0-0bc4bf2a7659 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:23:46 devstack sudo[101698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-36c00b28-75e5-43d8-a2d0-0bc4bf2a7659 Nov 04 12:23:46 devstack sudo[101698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:23:46 devstack sudo[101698]: pam_unix(sudo:session): session closed for user root Nov 04 12:23:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9a958945-45fb-4d79-a8a0-f4c96a99769c tempest-TestServerVolumeAttachScenarioOldVersion-1574132057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-36c00b28-75e5-43d8-a2d0-0bc4bf2a7659" returned: 0 in 0.421s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:23:46 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9a958945-45fb-4d79-a8a0-f4c96a99769c tempest-TestServerVolumeAttachScenarioOldVersion-1574132057 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:23:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9a958945-45fb-4d79-a8a0-f4c96a99769c tempest-TestServerVolumeAttachScenarioOldVersion-1574132057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:23:46 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9a958945-45fb-4d79-a8a0-f4c96a99769c tempest-TestServerVolumeAttachScenarioOldVersion-1574132057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec23472d-be5a-405b-b479-2a96715808da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36c00b28-75e5-43d8-a2d0-0bc4bf2a7659', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:23:46 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9a958945-45fb-4d79-a8a0-f4c96a99769c tempest-TestServerVolumeAttachScenarioOldVersion-1574132057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a621112-862a-483c-8089-95e3aae2acee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:23:46 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-9a958945-45fb-4d79-a8a0-f4c96a99769c tempest-TestServerVolumeAttachScenarioOldVersion-1574132057 None] Volume volume-36c00b28-75e5-43d8-a2d0-0bc4bf2a7659 (36c00b28-75e5-43d8-a2d0-0bc4bf2a7659): created successfully Nov 04 12:23:46 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9a958945-45fb-4d79-a8a0-f4c96a99769c tempest-TestServerVolumeAttachScenarioOldVersion-1574132057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a621112-862a-483c-8089-95e3aae2acee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:23:46 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9a958945-45fb-4d79-a8a0-f4c96a99769c tempest-TestServerVolumeAttachScenarioOldVersion-1574132057 None] Flow 'volume_create_manager' (39cc29af-f4bf-4781-87de-b5c64130c3cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:23:46 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-9a958945-45fb-4d79-a8a0-f4c96a99769c tempest-TestServerVolumeAttachScenarioOldVersion-1574132057 None] Created volume successfully. Nov 04 12:23:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-7afd3d57-7316-4974-8672-c2b3f86e694c req-a873ab98-6695-431b-b4a1-b2dda4bcb9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1574132057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:23:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-7afd3d57-7316-4974-8672-c2b3f86e694c req-a873ab98-6695-431b-b4a1-b2dda4bcb9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1574132057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:23:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-7afd3d57-7316-4974-8672-c2b3f86e694c req-a873ab98-6695-431b-b4a1-b2dda4bcb9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1574132057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:23:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-7afd3d57-7316-4974-8672-c2b3f86e694c req-a873ab98-6695-431b-b4a1-b2dda4bcb9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1574132057 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784', 'name': 'volume-36c00b28-75e5-43d8-a2d0-0bc4bf2a7659', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '74edb421-73f8-4060-a715-0243ca4062c2', 'enforce_multipath': True} {{(pid=87095) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 12:23:49 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-7afd3d57-7316-4974-8672-c2b3f86e694c req-a873ab98-6695-431b-b4a1-b2dda4bcb9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1574132057 None] attachment_update completed successfully. Nov 04 12:23:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-1aa85c84-8965-473a-a179-2db42e4e109d req-3e237135-60d6-4643-b1d2-74784a3598dc tempest-TestStampPattern-979127523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:23:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-1aa85c84-8965-473a-a179-2db42e4e109d req-3e237135-60d6-4643-b1d2-74784a3598dc tempest-TestStampPattern-979127523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:23:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-1aa85c84-8965-473a-a179-2db42e4e109d req-3e237135-60d6-4643-b1d2-74784a3598dc tempest-TestStampPattern-979127523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:23:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-1aa85c84-8965-473a-a179-2db42e4e109d req-3e237135-60d6-4643-b1d2-74784a3598dc tempest-TestStampPattern-979127523 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784', 'name': 'volume-94ff4973-e3d7-4058-b904-8d14ef929429', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5b56025d-0b37-40b7-8f91-9feefd40b596', 'enforce_multipath': True} {{(pid=87095) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 12:23:51 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-1aa85c84-8965-473a-a179-2db42e4e109d req-3e237135-60d6-4643-b1d2-74784a3598dc tempest-TestStampPattern-979127523 None] attachment_update completed successfully. Nov 04 12:23:53 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-ac850d67-00ef-4e72-bc66-228ff894bf62 req-beb9ca3e-1778-4001-8f6e-11985fff7514 tempest-TestServerVolumeAttachScenarioOldVersion-1574132057 None] Terminate volume connection completed successfully. Nov 04 12:23:53 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-ac850d67-00ef-4e72-bc66-228ff894bf62 req-beb9ca3e-1778-4001-8f6e-11985fff7514 tempest-TestServerVolumeAttachScenarioOldVersion-1574132057 None] Deleting attachment 74edb421-73f8-4060-a715-0243ca4062c2. {{(pid=87095) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 12:23:54 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f0bd6ed4-1fe7-4491-8b33-6480e145df6c tempest-TestServerVolumeAttachScenarioOldVersion-1574132057 None] Acquiring lock "cinder-36c00b28-75e5-43d8-a2d0-0bc4bf2a7659-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:23:54 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f0bd6ed4-1fe7-4491-8b33-6480e145df6c tempest-TestServerVolumeAttachScenarioOldVersion-1574132057 None] Lock "cinder-36c00b28-75e5-43d8-a2d0-0bc4bf2a7659-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:23:54 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f0bd6ed4-1fe7-4491-8b33-6480e145df6c tempest-TestServerVolumeAttachScenarioOldVersion-1574132057 None] Acquiring lock "cinder-quobyte-36c00b28-75e5-43d8-a2d0-0bc4bf2a7659" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:23:54 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f0bd6ed4-1fe7-4491-8b33-6480e145df6c tempest-TestServerVolumeAttachScenarioOldVersion-1574132057 None] Lock "cinder-quobyte-36c00b28-75e5-43d8-a2d0-0bc4bf2a7659" acquired by "delete_volume" :: waited 0.024s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:23:54 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[705d3ffc-3cbb-414f-a3f8-74decf2ed01e]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:23:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f0bd6ed4-1fe7-4491-8b33-6480e145df6c tempest-TestServerVolumeAttachScenarioOldVersion-1574132057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-36c00b28-75e5-43d8-a2d0-0bc4bf2a7659 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:23:54 devstack sudo[102168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-36c00b28-75e5-43d8-a2d0-0bc4bf2a7659 Nov 04 12:23:54 devstack sudo[102168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:23:54 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-7c41c671-36e2-460d-82a2-853e77b413be req-2dacaae2-0d90-4835-b428-1647863952c0 tempest-TestStampPattern-979127523 None] Terminate volume connection completed successfully. Nov 04 12:23:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-7c41c671-36e2-460d-82a2-853e77b413be req-2dacaae2-0d90-4835-b428-1647863952c0 tempest-TestStampPattern-979127523 None] Deleting attachment 5b56025d-0b37-40b7-8f91-9feefd40b596. {{(pid=87095) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 12:23:55 devstack sudo[102168]: pam_unix(sudo:session): session closed for user root Nov 04 12:23:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f0bd6ed4-1fe7-4491-8b33-6480e145df6c tempest-TestServerVolumeAttachScenarioOldVersion-1574132057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-36c00b28-75e5-43d8-a2d0-0bc4bf2a7659" returned: 0 in 0.515s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:23:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f0bd6ed4-1fe7-4491-8b33-6480e145df6c tempest-TestServerVolumeAttachScenarioOldVersion-1574132057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-36c00b28-75e5-43d8-a2d0-0bc4bf2a7659 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:23:55 devstack sudo[102200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-36c00b28-75e5-43d8-a2d0-0bc4bf2a7659 Nov 04 12:23:55 devstack sudo[102200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:23:55 devstack sudo[102200]: pam_unix(sudo:session): session closed for user root Nov 04 12:23:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f0bd6ed4-1fe7-4491-8b33-6480e145df6c tempest-TestServerVolumeAttachScenarioOldVersion-1574132057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-36c00b28-75e5-43d8-a2d0-0bc4bf2a7659" returned: 0 in 0.363s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:23:55 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f0bd6ed4-1fe7-4491-8b33-6480e145df6c tempest-TestServerVolumeAttachScenarioOldVersion-1574132057 None] Lock "cinder-quobyte-36c00b28-75e5-43d8-a2d0-0bc4bf2a7659" released by "delete_volume" :: held 0.966s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:23:55 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-f0bd6ed4-1fe7-4491-8b33-6480e145df6c tempest-TestServerVolumeAttachScenarioOldVersion-1574132057 None] Created reservations ['9083ef00-9885-4e29-8630-3de15cc4e55f', 'aa1459e4-24ed-4b54-ab9b-eb7551688531', 'b7892120-38b4-41aa-b987-00ecd9a25a60', '0cde87ff-8d96-4fb7-9ef6-2610dd6cdc23'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:23:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f0bd6ed4-1fe7-4491-8b33-6480e145df6c tempest-TestServerVolumeAttachScenarioOldVersion-1574132057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:23:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f0bd6ed4-1fe7-4491-8b33-6480e145df6c tempest-TestServerVolumeAttachScenarioOldVersion-1574132057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:23:55 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f0bd6ed4-1fe7-4491-8b33-6480e145df6c tempest-TestServerVolumeAttachScenarioOldVersion-1574132057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:23:55 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f0bd6ed4-1fe7-4491-8b33-6480e145df6c tempest-TestServerVolumeAttachScenarioOldVersion-1574132057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:23:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f0bd6ed4-1fe7-4491-8b33-6480e145df6c tempest-TestServerVolumeAttachScenarioOldVersion-1574132057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:23:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f0bd6ed4-1fe7-4491-8b33-6480e145df6c tempest-TestServerVolumeAttachScenarioOldVersion-1574132057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:23:55 devstack sudo[102203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:23:55 devstack sudo[102203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:23:56 devstack sudo[102203]: pam_unix(sudo:session): session closed for user root Nov 04 12:23:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f0bd6ed4-1fe7-4491-8b33-6480e145df6c tempest-TestServerVolumeAttachScenarioOldVersion-1574132057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.532s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:23:56 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-f0bd6ed4-1fe7-4491-8b33-6480e145df6c tempest-TestServerVolumeAttachScenarioOldVersion-1574132057 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:23:56 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-f0bd6ed4-1fe7-4491-8b33-6480e145df6c tempest-TestServerVolumeAttachScenarioOldVersion-1574132057 None] Deleted volume successfully. Nov 04 12:23:56 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f0bd6ed4-1fe7-4491-8b33-6480e145df6c tempest-TestServerVolumeAttachScenarioOldVersion-1574132057 None] Lock "cinder-36c00b28-75e5-43d8-a2d0-0bc4bf2a7659-delete_volume" released by "delete_volume" :: held 1.891s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:24:00 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a602a5c3-55d1-407c-8bf7-9ab766e43588 tempest-TestStampPattern-979127523 None] Acquiring lock "cinder-94ff4973-e3d7-4058-b904-8d14ef929429-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:24:00 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a602a5c3-55d1-407c-8bf7-9ab766e43588 tempest-TestStampPattern-979127523 None] Lock "cinder-94ff4973-e3d7-4058-b904-8d14ef929429-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:24:00 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a602a5c3-55d1-407c-8bf7-9ab766e43588 tempest-TestStampPattern-979127523 None] Acquiring lock "cinder-quobyte-94ff4973-e3d7-4058-b904-8d14ef929429" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:24:00 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a602a5c3-55d1-407c-8bf7-9ab766e43588 tempest-TestStampPattern-979127523 None] Lock "cinder-quobyte-94ff4973-e3d7-4058-b904-8d14ef929429" acquired by "delete_volume" :: waited 0.024s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:24:00 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4275a8e0-8593-45a8-bf57-fb6562bb558b]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:24:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a602a5c3-55d1-407c-8bf7-9ab766e43588 tempest-TestStampPattern-979127523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-94ff4973-e3d7-4058-b904-8d14ef929429 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:00 devstack sudo[102274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-94ff4973-e3d7-4058-b904-8d14ef929429 Nov 04 12:24:00 devstack sudo[102274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:00 devstack sudo[102274]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a602a5c3-55d1-407c-8bf7-9ab766e43588 tempest-TestStampPattern-979127523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-94ff4973-e3d7-4058-b904-8d14ef929429" returned: 0 in 0.379s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a602a5c3-55d1-407c-8bf7-9ab766e43588 tempest-TestStampPattern-979127523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-94ff4973-e3d7-4058-b904-8d14ef929429 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:00 devstack sudo[102280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-94ff4973-e3d7-4058-b904-8d14ef929429 Nov 04 12:24:00 devstack sudo[102280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:01 devstack sudo[102280]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a602a5c3-55d1-407c-8bf7-9ab766e43588 tempest-TestStampPattern-979127523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-94ff4973-e3d7-4058-b904-8d14ef929429" returned: 0 in 0.272s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a602a5c3-55d1-407c-8bf7-9ab766e43588 tempest-TestStampPattern-979127523 None] Lock "cinder-quobyte-94ff4973-e3d7-4058-b904-8d14ef929429" released by "delete_volume" :: held 0.695s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:24:01 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-a602a5c3-55d1-407c-8bf7-9ab766e43588 tempest-TestStampPattern-979127523 None] Created reservations ['5b5d25d4-1197-4d46-b815-d7dd7ddb760d', '89247cff-2076-4a50-905c-f209372007f6', '76c3fd5c-3191-4a58-baaf-890a76168441', '1406f93d-a8d8-487f-9665-fc2b5550f192'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:24:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a602a5c3-55d1-407c-8bf7-9ab766e43588 tempest-TestStampPattern-979127523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:24:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a602a5c3-55d1-407c-8bf7-9ab766e43588 tempest-TestStampPattern-979127523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:24:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a602a5c3-55d1-407c-8bf7-9ab766e43588 tempest-TestStampPattern-979127523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:24:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a602a5c3-55d1-407c-8bf7-9ab766e43588 tempest-TestStampPattern-979127523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:24:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a602a5c3-55d1-407c-8bf7-9ab766e43588 tempest-TestStampPattern-979127523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:24:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a602a5c3-55d1-407c-8bf7-9ab766e43588 tempest-TestStampPattern-979127523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:01 devstack sudo[102283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:24:01 devstack sudo[102283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:01 devstack sudo[102283]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a602a5c3-55d1-407c-8bf7-9ab766e43588 tempest-TestStampPattern-979127523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.261s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:01 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-a602a5c3-55d1-407c-8bf7-9ab766e43588 tempest-TestStampPattern-979127523 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:24:01 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-a602a5c3-55d1-407c-8bf7-9ab766e43588 tempest-TestStampPattern-979127523 None] Deleted volume successfully. Nov 04 12:24:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a602a5c3-55d1-407c-8bf7-9ab766e43588 tempest-TestStampPattern-979127523 None] Lock "cinder-94ff4973-e3d7-4058-b904-8d14ef929429-delete_volume" released by "delete_volume" :: held 1.208s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:24:01 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 12:24:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:24:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:24:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:24:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:24:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:24:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:01 devstack sudo[102286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:24:01 devstack sudo[102286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f2e51920-b35d-4222-99ab-232b0eea2fd8 tempest-TestStampPattern-979127523 None] Acquiring lock "cinder-f0db180a-2367-4655-b69d-b30fce457998-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:24:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f2e51920-b35d-4222-99ab-232b0eea2fd8 tempest-TestStampPattern-979127523 None] Lock "cinder-f0db180a-2367-4655-b69d-b30fce457998-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:24:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f2e51920-b35d-4222-99ab-232b0eea2fd8 tempest-TestStampPattern-979127523 None] Acquiring lock "cinder-quobyte-ff7aff92-ea95-4882-b1bd-9a444df50764" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:24:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f2e51920-b35d-4222-99ab-232b0eea2fd8 tempest-TestStampPattern-979127523 None] Lock "cinder-quobyte-ff7aff92-ea95-4882-b1bd-9a444df50764" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:24:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f2e51920-b35d-4222-99ab-232b0eea2fd8 tempest-TestStampPattern-979127523 None] Acquiring lock "cinder-quobyte-f0db180a-2367-4655-b69d-b30fce457998" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:24:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f2e51920-b35d-4222-99ab-232b0eea2fd8 tempest-TestStampPattern-979127523 None] Lock "cinder-quobyte-f0db180a-2367-4655-b69d-b30fce457998" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:24:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-f2e51920-b35d-4222-99ab-232b0eea2fd8 tempest-TestStampPattern-979127523 None] Deleting offline snapshot f0db180a-2367-4655-b69d-b30fce457998 of volume ff7aff92-ea95-4882-b1bd-9a444df50764 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 12:24:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-f2e51920-b35d-4222-99ab-232b0eea2fd8 tempest-TestStampPattern-979127523 None] snapshot_file for this snap is: volume-ff7aff92-ea95-4882-b1bd-9a444df50764.f0db180a-2367-4655-b69d-b30fce457998 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 12:24:01 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4bb541e-ebe3-4a2c-b0c3-d24e0c3f22a4]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:24:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f2e51920-b35d-4222-99ab-232b0eea2fd8 tempest-TestStampPattern-979127523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ff7aff92-ea95-4882-b1bd-9a444df50764.f0db180a-2367-4655-b69d-b30fce457998 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:02 devstack sudo[102288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ff7aff92-ea95-4882-b1bd-9a444df50764.f0db180a-2367-4655-b69d-b30fce457998 Nov 04 12:24:02 devstack sudo[102288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:02 devstack sudo[102286]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.301s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:02 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:24:02 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Running periodic task VolumeManager._thread_info {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 12:24:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] thread count: 28 {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 12:24:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] thread info: [<_MainThread(MainThread, started 140610387472512)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 12:24:02 devstack sudo[102288]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f2e51920-b35d-4222-99ab-232b0eea2fd8 tempest-TestStampPattern-979127523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ff7aff92-ea95-4882-b1bd-9a444df50764.f0db180a-2367-4655-b69d-b30fce457998" returned: 0 in 0.384s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:02 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-f2e51920-b35d-4222-99ab-232b0eea2fd8 tempest-TestStampPattern-979127523 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff7aff92-ea95-4882-b1bd-9a444df50764(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 12:24:02 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[795f9106-4374-4aa4-8978-1662564b4563]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:24:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f2e51920-b35d-4222-99ab-232b0eea2fd8 tempest-TestStampPattern-979127523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ff7aff92-ea95-4882-b1bd-9a444df50764 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:02 devstack sudo[102294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ff7aff92-ea95-4882-b1bd-9a444df50764 Nov 04 12:24:02 devstack sudo[102294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:02 devstack sudo[102294]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f2e51920-b35d-4222-99ab-232b0eea2fd8 tempest-TestStampPattern-979127523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ff7aff92-ea95-4882-b1bd-9a444df50764" returned: 0 in 0.540s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f2e51920-b35d-4222-99ab-232b0eea2fd8 tempest-TestStampPattern-979127523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ff7aff92-ea95-4882-b1bd-9a444df50764.f0db180a-2367-4655-b69d-b30fce457998 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:02 devstack sudo[102300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ff7aff92-ea95-4882-b1bd-9a444df50764.f0db180a-2367-4655-b69d-b30fce457998 Nov 04 12:24:02 devstack sudo[102300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:03 devstack sudo[102300]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f2e51920-b35d-4222-99ab-232b0eea2fd8 tempest-TestStampPattern-979127523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ff7aff92-ea95-4882-b1bd-9a444df50764.f0db180a-2367-4655-b69d-b30fce457998" returned: 0 in 0.339s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f2e51920-b35d-4222-99ab-232b0eea2fd8 tempest-TestStampPattern-979127523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ff7aff92-ea95-4882-b1bd-9a444df50764.f0db180a-2367-4655-b69d-b30fce457998 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:03 devstack sudo[102306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ff7aff92-ea95-4882-b1bd-9a444df50764.f0db180a-2367-4655-b69d-b30fce457998 Nov 04 12:24:03 devstack sudo[102306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:03 devstack sudo[102306]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f2e51920-b35d-4222-99ab-232b0eea2fd8 tempest-TestStampPattern-979127523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ff7aff92-ea95-4882-b1bd-9a444df50764.f0db180a-2367-4655-b69d-b30fce457998" returned: 0 in 0.281s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:03 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f2e51920-b35d-4222-99ab-232b0eea2fd8 tempest-TestStampPattern-979127523 None] Lock "cinder-quobyte-f0db180a-2367-4655-b69d-b30fce457998" released by "_delete_snapshot" :: held 1.662s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:24:03 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f2e51920-b35d-4222-99ab-232b0eea2fd8 tempest-TestStampPattern-979127523 None] Lock "cinder-quobyte-ff7aff92-ea95-4882-b1bd-9a444df50764" released by "delete_snapshot" :: held 1.690s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:24:03 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-f2e51920-b35d-4222-99ab-232b0eea2fd8 tempest-TestStampPattern-979127523 None] Created reservations ['6ee803e3-5736-4f65-b75c-98365044ec88', 'd24add75-b11b-4c14-95eb-17c9941f7718', '6b966be1-1577-49d0-ab96-eb418291c443', '06a65490-95c6-4cb2-8219-79d4f6c018d7'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:24:03 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-f2e51920-b35d-4222-99ab-232b0eea2fd8 tempest-TestStampPattern-979127523 None] Delete snapshot completed successfully. Nov 04 12:24:03 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f2e51920-b35d-4222-99ab-232b0eea2fd8 tempest-TestStampPattern-979127523 None] Lock "cinder-f0db180a-2367-4655-b69d-b30fce457998-delete_snapshot" released by "delete_snapshot" :: held 1.834s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:24:08 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-d05ec123-9ef4-48f9-a01a-c4b81cff9aa0 tempest-TestStampPattern-979127523 None] Acquiring lock "cinder-ff7aff92-ea95-4882-b1bd-9a444df50764-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:24:08 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-d05ec123-9ef4-48f9-a01a-c4b81cff9aa0 tempest-TestStampPattern-979127523 None] Lock "cinder-ff7aff92-ea95-4882-b1bd-9a444df50764-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:24:08 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=62,cinder:INSERT=22,cinder:UPDATE=77,cinder:DELETE=5 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 12:24:08 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=79,cinder:INSERT=17,cinder:UPDATE=62,cinder:DELETE=6 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 12:24:08 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-d05ec123-9ef4-48f9-a01a-c4b81cff9aa0 tempest-TestStampPattern-979127523 None] Acquiring lock "cinder-quobyte-ff7aff92-ea95-4882-b1bd-9a444df50764" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:24:08 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-d05ec123-9ef4-48f9-a01a-c4b81cff9aa0 tempest-TestStampPattern-979127523 None] Lock "cinder-quobyte-ff7aff92-ea95-4882-b1bd-9a444df50764" acquired by "delete_volume" :: waited 0.025s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:24:08 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d9b9c4-f872-4224-b82a-dc565860769a]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:24:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d05ec123-9ef4-48f9-a01a-c4b81cff9aa0 tempest-TestStampPattern-979127523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ff7aff92-ea95-4882-b1bd-9a444df50764 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:08 devstack sudo[102337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ff7aff92-ea95-4882-b1bd-9a444df50764 Nov 04 12:24:08 devstack sudo[102337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:08 devstack sudo[102337]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d05ec123-9ef4-48f9-a01a-c4b81cff9aa0 tempest-TestStampPattern-979127523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ff7aff92-ea95-4882-b1bd-9a444df50764" returned: 0 in 0.418s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d05ec123-9ef4-48f9-a01a-c4b81cff9aa0 tempest-TestStampPattern-979127523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ff7aff92-ea95-4882-b1bd-9a444df50764 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:08 devstack sudo[102344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ff7aff92-ea95-4882-b1bd-9a444df50764 Nov 04 12:24:08 devstack sudo[102344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:08 devstack sudo[102344]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d05ec123-9ef4-48f9-a01a-c4b81cff9aa0 tempest-TestStampPattern-979127523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ff7aff92-ea95-4882-b1bd-9a444df50764" returned: 0 in 0.268s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:08 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-d05ec123-9ef4-48f9-a01a-c4b81cff9aa0 tempest-TestStampPattern-979127523 None] Lock "cinder-quobyte-ff7aff92-ea95-4882-b1bd-9a444df50764" released by "delete_volume" :: held 0.767s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:24:09 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-d05ec123-9ef4-48f9-a01a-c4b81cff9aa0 tempest-TestStampPattern-979127523 None] Created reservations ['6be1c66e-fc59-450e-bd27-d18a3860f2fa', '7889ec08-5dd2-4ea5-8d8c-e55cdb4e9a6a', '4a84141f-28f8-41a2-873a-4551f0be5957', '2a65e0ed-e906-4477-b850-6564d67438fe'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:24:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d05ec123-9ef4-48f9-a01a-c4b81cff9aa0 tempest-TestStampPattern-979127523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:24:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d05ec123-9ef4-48f9-a01a-c4b81cff9aa0 tempest-TestStampPattern-979127523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:24:09 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d05ec123-9ef4-48f9-a01a-c4b81cff9aa0 tempest-TestStampPattern-979127523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:24:09 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d05ec123-9ef4-48f9-a01a-c4b81cff9aa0 tempest-TestStampPattern-979127523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:24:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d05ec123-9ef4-48f9-a01a-c4b81cff9aa0 tempest-TestStampPattern-979127523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:24:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d05ec123-9ef4-48f9-a01a-c4b81cff9aa0 tempest-TestStampPattern-979127523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:09 devstack sudo[102347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:24:09 devstack sudo[102347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:09 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-76f41efb-08fb-4bc7-bc8f-47aeb950f7df tempest-AttachVolumeNegativeTest-1833368782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:24:09 devstack sudo[102347]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-76f41efb-08fb-4bc7-bc8f-47aeb950f7df tempest-AttachVolumeNegativeTest-1833368782 None] Flow 'volume_create_manager' (bb4cb74f-9480-4946-86a8-37fd0ed95e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:24:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-76f41efb-08fb-4bc7-bc8f-47aeb950f7df tempest-AttachVolumeNegativeTest-1833368782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1b53623-2b26-4e1d-a5ee-9a587da51929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:24:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d05ec123-9ef4-48f9-a01a-c4b81cff9aa0 tempest-TestStampPattern-979127523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.365s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:09 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-d05ec123-9ef4-48f9-a01a-c4b81cff9aa0 tempest-TestStampPattern-979127523 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:24:09 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-d05ec123-9ef4-48f9-a01a-c4b81cff9aa0 tempest-TestStampPattern-979127523 None] Deleted volume successfully. Nov 04 12:24:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-76f41efb-08fb-4bc7-bc8f-47aeb950f7df tempest-AttachVolumeNegativeTest-1833368782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1b53623-2b26-4e1d-a5ee-9a587da51929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:24:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1724174483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=422724ec-0757-486b-a11e-61d3fad0170e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af841f214471418c9e103670562e75a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:24:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:24:09Z,use_quota=True,user_id='c5a5a0abad934484bdf8be54400a7185',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:24:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-76f41efb-08fb-4bc7-bc8f-47aeb950f7df tempest-AttachVolumeNegativeTest-1833368782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e238a9b-521e-49a3-9359-543f417efade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:24:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-76f41efb-08fb-4bc7-bc8f-47aeb950f7df tempest-AttachVolumeNegativeTest-1833368782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e238a9b-521e-49a3-9359-543f417efade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:24:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-76f41efb-08fb-4bc7-bc8f-47aeb950f7df tempest-AttachVolumeNegativeTest-1833368782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9aa1485c-6c0b-46ba-ae27-fcab9df0c99a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:24:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-76f41efb-08fb-4bc7-bc8f-47aeb950f7df tempest-AttachVolumeNegativeTest-1833368782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9aa1485c-6c0b-46ba-ae27-fcab9df0c99a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '422724ec-0757-486b-a11e-61d3fad0170e', 'volume_name': 'volume-422724ec-0757-486b-a11e-61d3fad0170e', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:24:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-76f41efb-08fb-4bc7-bc8f-47aeb950f7df tempest-AttachVolumeNegativeTest-1833368782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0426418-6c8b-4f8e-964e-9dcec65b8d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:24:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-76f41efb-08fb-4bc7-bc8f-47aeb950f7df tempest-AttachVolumeNegativeTest-1833368782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0426418-6c8b-4f8e-964e-9dcec65b8d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:24:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-76f41efb-08fb-4bc7-bc8f-47aeb950f7df tempest-AttachVolumeNegativeTest-1833368782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39a125be-75ba-4e8f-bfe2-da90dc2a8a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:24:09 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-76f41efb-08fb-4bc7-bc8f-47aeb950f7df tempest-AttachVolumeNegativeTest-1833368782 None] Volume 422724ec-0757-486b-a11e-61d3fad0170e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-422724ec-0757-486b-a11e-61d3fad0170e', 'volume_size': 1} Nov 04 12:24:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-76f41efb-08fb-4bc7-bc8f-47aeb950f7df tempest-AttachVolumeNegativeTest-1833368782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:24:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-76f41efb-08fb-4bc7-bc8f-47aeb950f7df tempest-AttachVolumeNegativeTest-1833368782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:24:09 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-76f41efb-08fb-4bc7-bc8f-47aeb950f7df tempest-AttachVolumeNegativeTest-1833368782 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:24:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1724174483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=422724ec-0757-486b-a11e-61d3fad0170e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af841f214471418c9e103670562e75a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:24:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:24:09Z,use_quota=True,user_id='c5a5a0abad934484bdf8be54400a7185',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:24:09 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-76f41efb-08fb-4bc7-bc8f-47aeb950f7df tempest-AttachVolumeNegativeTest-1833368782 None] Creating volume 422724ec-0757-486b-a11e-61d3fad0170e {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:24:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-76f41efb-08fb-4bc7-bc8f-47aeb950f7df tempest-AttachVolumeNegativeTest-1833368782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:24:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-76f41efb-08fb-4bc7-bc8f-47aeb950f7df tempest-AttachVolumeNegativeTest-1833368782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:24:09 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-76f41efb-08fb-4bc7-bc8f-47aeb950f7df tempest-AttachVolumeNegativeTest-1833368782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:24:09 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-76f41efb-08fb-4bc7-bc8f-47aeb950f7df tempest-AttachVolumeNegativeTest-1833368782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:24:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-76f41efb-08fb-4bc7-bc8f-47aeb950f7df tempest-AttachVolumeNegativeTest-1833368782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:24:09 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-76f41efb-08fb-4bc7-bc8f-47aeb950f7df tempest-AttachVolumeNegativeTest-1833368782 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:24:09 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-76f41efb-08fb-4bc7-bc8f-47aeb950f7df tempest-AttachVolumeNegativeTest-1833368782 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:24:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-76f41efb-08fb-4bc7-bc8f-47aeb950f7df tempest-AttachVolumeNegativeTest-1833368782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-422724ec-0757-486b-a11e-61d3fad0170e 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:09 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-d05ec123-9ef4-48f9-a01a-c4b81cff9aa0 tempest-TestStampPattern-979127523 None] Lock "cinder-ff7aff92-ea95-4882-b1bd-9a444df50764-delete_volume" released by "delete_volume" :: held 1.476s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:24:09 devstack sudo[102351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-422724ec-0757-486b-a11e-61d3fad0170e 1073741824 Nov 04 12:24:09 devstack sudo[102351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:10 devstack sudo[102351]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-76f41efb-08fb-4bc7-bc8f-47aeb950f7df tempest-AttachVolumeNegativeTest-1833368782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-422724ec-0757-486b-a11e-61d3fad0170e 1073741824" returned: 0 in 0.473s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-76f41efb-08fb-4bc7-bc8f-47aeb950f7df tempest-AttachVolumeNegativeTest-1833368782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-422724ec-0757-486b-a11e-61d3fad0170e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:10 devstack sudo[102357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-422724ec-0757-486b-a11e-61d3fad0170e Nov 04 12:24:10 devstack sudo[102357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:10 devstack sudo[102357]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-76f41efb-08fb-4bc7-bc8f-47aeb950f7df tempest-AttachVolumeNegativeTest-1833368782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-422724ec-0757-486b-a11e-61d3fad0170e" returned: 0 in 0.272s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:10 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-76f41efb-08fb-4bc7-bc8f-47aeb950f7df tempest-AttachVolumeNegativeTest-1833368782 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:24:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-76f41efb-08fb-4bc7-bc8f-47aeb950f7df tempest-AttachVolumeNegativeTest-1833368782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:24:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-76f41efb-08fb-4bc7-bc8f-47aeb950f7df tempest-AttachVolumeNegativeTest-1833368782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39a125be-75ba-4e8f-bfe2-da90dc2a8a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-422724ec-0757-486b-a11e-61d3fad0170e', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:24:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-76f41efb-08fb-4bc7-bc8f-47aeb950f7df tempest-AttachVolumeNegativeTest-1833368782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c23ae02-6012-4d56-a000-2ca03bbd06bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:24:10 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-76f41efb-08fb-4bc7-bc8f-47aeb950f7df tempest-AttachVolumeNegativeTest-1833368782 None] Volume volume-422724ec-0757-486b-a11e-61d3fad0170e (422724ec-0757-486b-a11e-61d3fad0170e): created successfully Nov 04 12:24:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-76f41efb-08fb-4bc7-bc8f-47aeb950f7df tempest-AttachVolumeNegativeTest-1833368782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c23ae02-6012-4d56-a000-2ca03bbd06bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:24:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-76f41efb-08fb-4bc7-bc8f-47aeb950f7df tempest-AttachVolumeNegativeTest-1833368782 None] Flow 'volume_create_manager' (bb4cb74f-9480-4946-86a8-37fd0ed95e10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:24:10 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-76f41efb-08fb-4bc7-bc8f-47aeb950f7df tempest-AttachVolumeNegativeTest-1833368782 None] Created volume successfully. Nov 04 12:24:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-a0bb0ee3-74f7-47db-848b-2b1556032b84 req-1b25d3b3-27d4-4398-a50c-d3eadb1b6250 tempest-AttachVolumeNegativeTest-1833368782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:24:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-a0bb0ee3-74f7-47db-848b-2b1556032b84 req-1b25d3b3-27d4-4398-a50c-d3eadb1b6250 tempest-AttachVolumeNegativeTest-1833368782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:24:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-a0bb0ee3-74f7-47db-848b-2b1556032b84 req-1b25d3b3-27d4-4398-a50c-d3eadb1b6250 tempest-AttachVolumeNegativeTest-1833368782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:24:12 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-a0bb0ee3-74f7-47db-848b-2b1556032b84 req-1b25d3b3-27d4-4398-a50c-d3eadb1b6250 tempest-AttachVolumeNegativeTest-1833368782 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784', 'name': 'volume-422724ec-0757-486b-a11e-61d3fad0170e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f18af508-4c9f-481b-931b-f7ba97e742a4', 'enforce_multipath': True} {{(pid=87095) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 12:24:12 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-a0bb0ee3-74f7-47db-848b-2b1556032b84 req-1b25d3b3-27d4-4398-a50c-d3eadb1b6250 tempest-AttachVolumeNegativeTest-1833368782 None] attachment_update completed successfully. Nov 04 12:24:15 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-854e77e0-cf4f-4df6-bd2a-5a19d2d8bd6a req-2af33ac7-9f19-4660-9650-51e622d9de51 tempest-AttachVolumeNegativeTest-1833368782 None] Terminate volume connection completed successfully. Nov 04 12:24:15 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-854e77e0-cf4f-4df6-bd2a-5a19d2d8bd6a req-2af33ac7-9f19-4660-9650-51e622d9de51 tempest-AttachVolumeNegativeTest-1833368782 None] Deleting attachment f18af508-4c9f-481b-931b-f7ba97e742a4. {{(pid=87095) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 12:24:22 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=14,cinder:INSERT=3,cinder:UPDATE=10,cinder:DELETE=1 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 12:24:25 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=14,cinder:INSERT=2,cinder:UPDATE=14,cinder:DELETE=1 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 12:24:25 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f65d8a7f-8988-488e-8d17-a84c9064946d tempest-AttachVolumeNegativeTest-1833368782 None] Acquiring lock "cinder-422724ec-0757-486b-a11e-61d3fad0170e-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:24:25 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f65d8a7f-8988-488e-8d17-a84c9064946d tempest-AttachVolumeNegativeTest-1833368782 None] Lock "cinder-422724ec-0757-486b-a11e-61d3fad0170e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:24:25 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f65d8a7f-8988-488e-8d17-a84c9064946d tempest-AttachVolumeNegativeTest-1833368782 None] Acquiring lock "cinder-quobyte-422724ec-0757-486b-a11e-61d3fad0170e" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:24:25 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f65d8a7f-8988-488e-8d17-a84c9064946d tempest-AttachVolumeNegativeTest-1833368782 None] Lock "cinder-quobyte-422724ec-0757-486b-a11e-61d3fad0170e" acquired by "delete_volume" :: waited 0.018s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:24:25 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8facb57-e330-42a4-8552-0b11977a8018]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:24:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f65d8a7f-8988-488e-8d17-a84c9064946d tempest-AttachVolumeNegativeTest-1833368782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-422724ec-0757-486b-a11e-61d3fad0170e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:25 devstack sudo[102847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-422724ec-0757-486b-a11e-61d3fad0170e Nov 04 12:24:25 devstack sudo[102847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:26 devstack sudo[102847]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f65d8a7f-8988-488e-8d17-a84c9064946d tempest-AttachVolumeNegativeTest-1833368782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-422724ec-0757-486b-a11e-61d3fad0170e" returned: 0 in 0.438s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f65d8a7f-8988-488e-8d17-a84c9064946d tempest-AttachVolumeNegativeTest-1833368782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-422724ec-0757-486b-a11e-61d3fad0170e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:26 devstack sudo[102852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-422724ec-0757-486b-a11e-61d3fad0170e Nov 04 12:24:26 devstack sudo[102852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:26 devstack sudo[102852]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f65d8a7f-8988-488e-8d17-a84c9064946d tempest-AttachVolumeNegativeTest-1833368782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-422724ec-0757-486b-a11e-61d3fad0170e" returned: 0 in 0.292s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:26 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f65d8a7f-8988-488e-8d17-a84c9064946d tempest-AttachVolumeNegativeTest-1833368782 None] Lock "cinder-quobyte-422724ec-0757-486b-a11e-61d3fad0170e" released by "delete_volume" :: held 0.827s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:24:26 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-f65d8a7f-8988-488e-8d17-a84c9064946d tempest-AttachVolumeNegativeTest-1833368782 None] Created reservations ['6a12ea8e-93a0-4a51-b1ce-af0d8f11c555', 'cb716b34-2f21-4b2e-bd76-5b067dc3e8ca', 'dca1222e-b657-4e25-b762-0fc22e449202', '29f2a2ab-5f54-4e91-9f6b-eea2e094b79d'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:24:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f65d8a7f-8988-488e-8d17-a84c9064946d tempest-AttachVolumeNegativeTest-1833368782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:24:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f65d8a7f-8988-488e-8d17-a84c9064946d tempest-AttachVolumeNegativeTest-1833368782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:24:26 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f65d8a7f-8988-488e-8d17-a84c9064946d tempest-AttachVolumeNegativeTest-1833368782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:24:26 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f65d8a7f-8988-488e-8d17-a84c9064946d tempest-AttachVolumeNegativeTest-1833368782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:24:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f65d8a7f-8988-488e-8d17-a84c9064946d tempest-AttachVolumeNegativeTest-1833368782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:24:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f65d8a7f-8988-488e-8d17-a84c9064946d tempest-AttachVolumeNegativeTest-1833368782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:26 devstack sudo[102855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:24:26 devstack sudo[102855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:26 devstack sudo[102855]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f65d8a7f-8988-488e-8d17-a84c9064946d tempest-AttachVolumeNegativeTest-1833368782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.377s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:26 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-f65d8a7f-8988-488e-8d17-a84c9064946d tempest-AttachVolumeNegativeTest-1833368782 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:24:26 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-56dc672f-8117-412b-8d00-47d74a2b7bdd tempest-AttachVolumeNegativeTest-1833368782 None] Acquiring lock "cinder-9f25dd80-370f-4f73-b1bf-bcbc0b8f41ca-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:24:26 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-f65d8a7f-8988-488e-8d17-a84c9064946d tempest-AttachVolumeNegativeTest-1833368782 None] Deleted volume successfully. Nov 04 12:24:27 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-56dc672f-8117-412b-8d00-47d74a2b7bdd tempest-AttachVolumeNegativeTest-1833368782 None] Lock "cinder-9f25dd80-370f-4f73-b1bf-bcbc0b8f41ca-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:24:27 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f65d8a7f-8988-488e-8d17-a84c9064946d tempest-AttachVolumeNegativeTest-1833368782 None] Lock "cinder-422724ec-0757-486b-a11e-61d3fad0170e-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:24:27 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-56dc672f-8117-412b-8d00-47d74a2b7bdd tempest-AttachVolumeNegativeTest-1833368782 None] Acquiring lock "cinder-quobyte-9f25dd80-370f-4f73-b1bf-bcbc0b8f41ca" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:24:27 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-56dc672f-8117-412b-8d00-47d74a2b7bdd tempest-AttachVolumeNegativeTest-1833368782 None] Lock "cinder-quobyte-9f25dd80-370f-4f73-b1bf-bcbc0b8f41ca" acquired by "delete_volume" :: waited 0.018s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:24:27 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f07efd-b44e-4392-98e7-0d13ad6b6bf1]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:24:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-56dc672f-8117-412b-8d00-47d74a2b7bdd tempest-AttachVolumeNegativeTest-1833368782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9f25dd80-370f-4f73-b1bf-bcbc0b8f41ca {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:27 devstack sudo[102858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9f25dd80-370f-4f73-b1bf-bcbc0b8f41ca Nov 04 12:24:27 devstack sudo[102858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:27 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-1988b526-b1f3-4b7e-aaa6-13441e0809d1 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:24:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1988b526-b1f3-4b7e-aaa6-13441e0809d1 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Flow 'volume_create_manager' (f3f53063-a412-468a-bd41-a328a8f739da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:24:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1988b526-b1f3-4b7e-aaa6-13441e0809d1 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79cb792d-3f7e-4a52-a766-2f4f684bf08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:24:27 devstack sudo[102858]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-56dc672f-8117-412b-8d00-47d74a2b7bdd tempest-AttachVolumeNegativeTest-1833368782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9f25dd80-370f-4f73-b1bf-bcbc0b8f41ca" returned: 0 in 0.447s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-56dc672f-8117-412b-8d00-47d74a2b7bdd tempest-AttachVolumeNegativeTest-1833368782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9f25dd80-370f-4f73-b1bf-bcbc0b8f41ca {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1988b526-b1f3-4b7e-aaa6-13441e0809d1 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79cb792d-3f7e-4a52-a766-2f4f684bf08b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:24:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-116537318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3eb6d98b-596d-40fc-ac01-6454f00de4e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='183010e2bea744bba896cb5ddc3bba54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:24:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:24:27Z,use_quota=True,user_id='7f62eb6d6a504733ab31ba7bf4116693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:24:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1988b526-b1f3-4b7e-aaa6-13441e0809d1 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e57ec3ea-015a-4500-891b-f765ebc9dc09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:24:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1988b526-b1f3-4b7e-aaa6-13441e0809d1 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e57ec3ea-015a-4500-891b-f765ebc9dc09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:24:27 devstack sudo[102864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9f25dd80-370f-4f73-b1bf-bcbc0b8f41ca Nov 04 12:24:27 devstack sudo[102864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1988b526-b1f3-4b7e-aaa6-13441e0809d1 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (777de6a4-777c-457c-b1e8-6f22c7c8170b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:24:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1988b526-b1f3-4b7e-aaa6-13441e0809d1 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (777de6a4-777c-457c-b1e8-6f22c7c8170b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3eb6d98b-596d-40fc-ac01-6454f00de4e6', 'volume_name': 'volume-3eb6d98b-596d-40fc-ac01-6454f00de4e6', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:24:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1988b526-b1f3-4b7e-aaa6-13441e0809d1 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (583c6d06-f883-43c7-80e6-e67919734937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:24:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1988b526-b1f3-4b7e-aaa6-13441e0809d1 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (583c6d06-f883-43c7-80e6-e67919734937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:24:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1988b526-b1f3-4b7e-aaa6-13441e0809d1 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99a41f75-6059-45df-b842-1e042500771d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:24:27 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-1988b526-b1f3-4b7e-aaa6-13441e0809d1 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Volume 3eb6d98b-596d-40fc-ac01-6454f00de4e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3eb6d98b-596d-40fc-ac01-6454f00de4e6', 'volume_size': 1} Nov 04 12:24:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1988b526-b1f3-4b7e-aaa6-13441e0809d1 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:24:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1988b526-b1f3-4b7e-aaa6-13441e0809d1 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:24:27 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1988b526-b1f3-4b7e-aaa6-13441e0809d1 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:24:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-116537318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3eb6d98b-596d-40fc-ac01-6454f00de4e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='183010e2bea744bba896cb5ddc3bba54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:24:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:24:27Z,use_quota=True,user_id='7f62eb6d6a504733ab31ba7bf4116693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:24:27 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-1988b526-b1f3-4b7e-aaa6-13441e0809d1 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Creating volume 3eb6d98b-596d-40fc-ac01-6454f00de4e6 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:24:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1988b526-b1f3-4b7e-aaa6-13441e0809d1 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:24:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1988b526-b1f3-4b7e-aaa6-13441e0809d1 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:24:27 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1988b526-b1f3-4b7e-aaa6-13441e0809d1 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:24:27 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1988b526-b1f3-4b7e-aaa6-13441e0809d1 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:24:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1988b526-b1f3-4b7e-aaa6-13441e0809d1 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:24:27 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1988b526-b1f3-4b7e-aaa6-13441e0809d1 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:24:27 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-1988b526-b1f3-4b7e-aaa6-13441e0809d1 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:24:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1988b526-b1f3-4b7e-aaa6-13441e0809d1 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-3eb6d98b-596d-40fc-ac01-6454f00de4e6 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:27 devstack sudo[102866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-3eb6d98b-596d-40fc-ac01-6454f00de4e6 1073741824 Nov 04 12:24:27 devstack sudo[102866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:27 devstack sudo[102864]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-56dc672f-8117-412b-8d00-47d74a2b7bdd tempest-AttachVolumeNegativeTest-1833368782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9f25dd80-370f-4f73-b1bf-bcbc0b8f41ca" returned: 0 in 0.309s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:27 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-56dc672f-8117-412b-8d00-47d74a2b7bdd tempest-AttachVolumeNegativeTest-1833368782 None] Lock "cinder-quobyte-9f25dd80-370f-4f73-b1bf-bcbc0b8f41ca" released by "delete_volume" :: held 0.817s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:24:27 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-56dc672f-8117-412b-8d00-47d74a2b7bdd tempest-AttachVolumeNegativeTest-1833368782 None] Created reservations ['cbf93d4a-72b4-4a1b-a723-1d325088b578', '0f8057f6-e00b-4c4d-a39a-aebf1ff81970', '3afc313b-4598-4c9c-951f-f604e7c37ad0', 'd0c05f2f-958f-43f2-95f5-1a4d97db0094'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:24:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-56dc672f-8117-412b-8d00-47d74a2b7bdd tempest-AttachVolumeNegativeTest-1833368782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:24:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-56dc672f-8117-412b-8d00-47d74a2b7bdd tempest-AttachVolumeNegativeTest-1833368782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:24:28 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-56dc672f-8117-412b-8d00-47d74a2b7bdd tempest-AttachVolumeNegativeTest-1833368782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:24:28 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-56dc672f-8117-412b-8d00-47d74a2b7bdd tempest-AttachVolumeNegativeTest-1833368782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:24:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-56dc672f-8117-412b-8d00-47d74a2b7bdd tempest-AttachVolumeNegativeTest-1833368782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:24:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-56dc672f-8117-412b-8d00-47d74a2b7bdd tempest-AttachVolumeNegativeTest-1833368782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:28 devstack sudo[102873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:24:28 devstack sudo[102873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:28 devstack sudo[102866]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1988b526-b1f3-4b7e-aaa6-13441e0809d1 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-3eb6d98b-596d-40fc-ac01-6454f00de4e6 1073741824" returned: 0 in 0.556s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1988b526-b1f3-4b7e-aaa6-13441e0809d1 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-3eb6d98b-596d-40fc-ac01-6454f00de4e6 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:28 devstack sudo[102881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-3eb6d98b-596d-40fc-ac01-6454f00de4e6 Nov 04 12:24:28 devstack sudo[102881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:28 devstack sudo[102873]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-56dc672f-8117-412b-8d00-47d74a2b7bdd tempest-AttachVolumeNegativeTest-1833368782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.437s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:28 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-56dc672f-8117-412b-8d00-47d74a2b7bdd tempest-AttachVolumeNegativeTest-1833368782 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:24:28 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-56dc672f-8117-412b-8d00-47d74a2b7bdd tempest-AttachVolumeNegativeTest-1833368782 None] Deleted volume successfully. Nov 04 12:24:28 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3a7679b7-267b-4f9f-8d5f-73f859ec0379 tempest-AttachVolumeNegativeTest-1833368782 None] Acquiring lock "cinder-33de3682-4e86-4c0f-ba66-0bf31024a8e4-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:24:28 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-56dc672f-8117-412b-8d00-47d74a2b7bdd tempest-AttachVolumeNegativeTest-1833368782 None] Lock "cinder-9f25dd80-370f-4f73-b1bf-bcbc0b8f41ca-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:24:28 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3a7679b7-267b-4f9f-8d5f-73f859ec0379 tempest-AttachVolumeNegativeTest-1833368782 None] Lock "cinder-33de3682-4e86-4c0f-ba66-0bf31024a8e4-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:24:28 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3a7679b7-267b-4f9f-8d5f-73f859ec0379 tempest-AttachVolumeNegativeTest-1833368782 None] Acquiring lock "cinder-quobyte-33de3682-4e86-4c0f-ba66-0bf31024a8e4" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:24:28 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3a7679b7-267b-4f9f-8d5f-73f859ec0379 tempest-AttachVolumeNegativeTest-1833368782 None] Lock "cinder-quobyte-33de3682-4e86-4c0f-ba66-0bf31024a8e4" acquired by "delete_volume" :: waited 0.018s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:24:28 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd80945e-2b84-482b-ac72-11db5a30efa0]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:24:28 devstack sudo[102881]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3a7679b7-267b-4f9f-8d5f-73f859ec0379 tempest-AttachVolumeNegativeTest-1833368782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-33de3682-4e86-4c0f-ba66-0bf31024a8e4 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1988b526-b1f3-4b7e-aaa6-13441e0809d1 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-3eb6d98b-596d-40fc-ac01-6454f00de4e6" returned: 0 in 0.428s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:28 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1988b526-b1f3-4b7e-aaa6-13441e0809d1 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:24:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1988b526-b1f3-4b7e-aaa6-13441e0809d1 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:24:28 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1988b526-b1f3-4b7e-aaa6-13441e0809d1 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99a41f75-6059-45df-b842-1e042500771d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3eb6d98b-596d-40fc-ac01-6454f00de4e6', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:24:28 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1988b526-b1f3-4b7e-aaa6-13441e0809d1 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34944f26-2573-4b56-9b6c-49e26c9d5d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:24:28 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-1988b526-b1f3-4b7e-aaa6-13441e0809d1 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Volume volume-3eb6d98b-596d-40fc-ac01-6454f00de4e6 (3eb6d98b-596d-40fc-ac01-6454f00de4e6): created successfully Nov 04 12:24:28 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1988b526-b1f3-4b7e-aaa6-13441e0809d1 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34944f26-2573-4b56-9b6c-49e26c9d5d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:24:28 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1988b526-b1f3-4b7e-aaa6-13441e0809d1 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Flow 'volume_create_manager' (f3f53063-a412-468a-bd41-a328a8f739da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:24:28 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-1988b526-b1f3-4b7e-aaa6-13441e0809d1 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Created volume successfully. Nov 04 12:24:28 devstack sudo[102919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-33de3682-4e86-4c0f-ba66-0bf31024a8e4 Nov 04 12:24:28 devstack sudo[102919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:29 devstack sudo[102919]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3a7679b7-267b-4f9f-8d5f-73f859ec0379 tempest-AttachVolumeNegativeTest-1833368782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-33de3682-4e86-4c0f-ba66-0bf31024a8e4" returned: 0 in 0.404s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3a7679b7-267b-4f9f-8d5f-73f859ec0379 tempest-AttachVolumeNegativeTest-1833368782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-33de3682-4e86-4c0f-ba66-0bf31024a8e4 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:29 devstack sudo[102926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-33de3682-4e86-4c0f-ba66-0bf31024a8e4 Nov 04 12:24:29 devstack sudo[102926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:29 devstack sudo[102926]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3a7679b7-267b-4f9f-8d5f-73f859ec0379 tempest-AttachVolumeNegativeTest-1833368782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-33de3682-4e86-4c0f-ba66-0bf31024a8e4" returned: 0 in 0.287s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:29 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3a7679b7-267b-4f9f-8d5f-73f859ec0379 tempest-AttachVolumeNegativeTest-1833368782 None] Lock "cinder-quobyte-33de3682-4e86-4c0f-ba66-0bf31024a8e4" released by "delete_volume" :: held 0.757s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:24:29 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-3a7679b7-267b-4f9f-8d5f-73f859ec0379 tempest-AttachVolumeNegativeTest-1833368782 None] Created reservations ['6ceb739e-9538-446d-b32c-afdfaf8f1d5b', '2f9886d2-ab3f-4829-912c-6451e2cb2c18', 'c2750b99-2a57-42c6-b684-239f68abdbff', '34f04986-3342-4a04-91c6-1626ed01aada'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:24:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3a7679b7-267b-4f9f-8d5f-73f859ec0379 tempest-AttachVolumeNegativeTest-1833368782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:24:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3a7679b7-267b-4f9f-8d5f-73f859ec0379 tempest-AttachVolumeNegativeTest-1833368782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:24:29 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3a7679b7-267b-4f9f-8d5f-73f859ec0379 tempest-AttachVolumeNegativeTest-1833368782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:24:29 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3a7679b7-267b-4f9f-8d5f-73f859ec0379 tempest-AttachVolumeNegativeTest-1833368782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:24:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3a7679b7-267b-4f9f-8d5f-73f859ec0379 tempest-AttachVolumeNegativeTest-1833368782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:24:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3a7679b7-267b-4f9f-8d5f-73f859ec0379 tempest-AttachVolumeNegativeTest-1833368782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:29 devstack sudo[102929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:24:29 devstack sudo[102929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:29 devstack sudo[102929]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3a7679b7-267b-4f9f-8d5f-73f859ec0379 tempest-AttachVolumeNegativeTest-1833368782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.336s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:29 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-3a7679b7-267b-4f9f-8d5f-73f859ec0379 tempest-AttachVolumeNegativeTest-1833368782 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:24:29 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-3a7679b7-267b-4f9f-8d5f-73f859ec0379 tempest-AttachVolumeNegativeTest-1833368782 None] Deleted volume successfully. Nov 04 12:24:29 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3a7679b7-267b-4f9f-8d5f-73f859ec0379 tempest-AttachVolumeNegativeTest-1833368782 None] Lock "cinder-33de3682-4e86-4c0f-ba66-0bf31024a8e4-delete_volume" released by "delete_volume" :: held 1.347s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:24:30 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-016980ec-f8a9-4f05-937e-afb6fe1b330d tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:24:30 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-016980ec-f8a9-4f05-937e-afb6fe1b330d tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Flow 'volume_create_manager' (e1a8217c-673a-401c-afe7-9c57cd04cf1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:24:30 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-016980ec-f8a9-4f05-937e-afb6fe1b330d tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fb46981-8c93-4691-8ae3-16c7b18134c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:24:30 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-016980ec-f8a9-4f05-937e-afb6fe1b330d tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fb46981-8c93-4691-8ae3-16c7b18134c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:24:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1030560596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1a93baf-2ec8-4803-a0a2-e876c89073d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='183010e2bea744bba896cb5ddc3bba54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:24:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:24:30Z,use_quota=True,user_id='7f62eb6d6a504733ab31ba7bf4116693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:24:30 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-016980ec-f8a9-4f05-937e-afb6fe1b330d tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ee9e251-f49a-4903-9d2a-8093d5b63bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:24:30 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-016980ec-f8a9-4f05-937e-afb6fe1b330d tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ee9e251-f49a-4903-9d2a-8093d5b63bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:24:30 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-016980ec-f8a9-4f05-937e-afb6fe1b330d tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eef0b721-b132-4f23-8b9e-c1d6017ef2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:24:30 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-016980ec-f8a9-4f05-937e-afb6fe1b330d tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eef0b721-b132-4f23-8b9e-c1d6017ef2f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1a93baf-2ec8-4803-a0a2-e876c89073d7', 'volume_name': 'volume-f1a93baf-2ec8-4803-a0a2-e876c89073d7', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:24:30 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-016980ec-f8a9-4f05-937e-afb6fe1b330d tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfbae5ad-f5f2-4388-b86f-e23f25b4a008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:24:30 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-016980ec-f8a9-4f05-937e-afb6fe1b330d tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfbae5ad-f5f2-4388-b86f-e23f25b4a008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:24:30 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-016980ec-f8a9-4f05-937e-afb6fe1b330d tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b39416be-4296-4a5a-b2d8-cf5ef2db9889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:24:30 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-016980ec-f8a9-4f05-937e-afb6fe1b330d tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Volume f1a93baf-2ec8-4803-a0a2-e876c89073d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1a93baf-2ec8-4803-a0a2-e876c89073d7', 'volume_size': 1} Nov 04 12:24:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-016980ec-f8a9-4f05-937e-afb6fe1b330d tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:24:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-016980ec-f8a9-4f05-937e-afb6fe1b330d tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:24:30 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-016980ec-f8a9-4f05-937e-afb6fe1b330d tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:24:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1030560596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1a93baf-2ec8-4803-a0a2-e876c89073d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='183010e2bea744bba896cb5ddc3bba54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:24:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:24:30Z,use_quota=True,user_id='7f62eb6d6a504733ab31ba7bf4116693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:24:30 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-016980ec-f8a9-4f05-937e-afb6fe1b330d tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Creating volume f1a93baf-2ec8-4803-a0a2-e876c89073d7 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:24:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-016980ec-f8a9-4f05-937e-afb6fe1b330d tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:24:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-016980ec-f8a9-4f05-937e-afb6fe1b330d tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:24:30 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-016980ec-f8a9-4f05-937e-afb6fe1b330d tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:24:30 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-016980ec-f8a9-4f05-937e-afb6fe1b330d tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:24:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-016980ec-f8a9-4f05-937e-afb6fe1b330d tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:24:30 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-016980ec-f8a9-4f05-937e-afb6fe1b330d tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:24:30 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-016980ec-f8a9-4f05-937e-afb6fe1b330d tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:24:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-016980ec-f8a9-4f05-937e-afb6fe1b330d tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f1a93baf-2ec8-4803-a0a2-e876c89073d7 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:30 devstack sudo[102932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f1a93baf-2ec8-4803-a0a2-e876c89073d7 1073741824 Nov 04 12:24:30 devstack sudo[102932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:30 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e02547a-1957-45a0-9c36-0563a3cadbb6 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:24:30 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8e02547a-1957-45a0-9c36-0563a3cadbb6 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Flow 'volume_create_manager' (ac415e07-924e-42b9-b755-22618e680b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:24:30 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8e02547a-1957-45a0-9c36-0563a3cadbb6 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80559169-a6f7-4b8f-a7eb-10cb5a62370e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:24:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8e02547a-1957-45a0-9c36-0563a3cadbb6 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80559169-a6f7-4b8f-a7eb-10cb5a62370e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:24:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-889292136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d587141d-b1d4-4d26-9dcd-e6c9fec51fa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='183010e2bea744bba896cb5ddc3bba54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:24:31Z,use_quota=True,user_id='7f62eb6d6a504733ab31ba7bf4116693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:24:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8e02547a-1957-45a0-9c36-0563a3cadbb6 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e2ed112-4e26-4c11-8833-b2467aafedf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:24:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8e02547a-1957-45a0-9c36-0563a3cadbb6 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e2ed112-4e26-4c11-8833-b2467aafedf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:24:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8e02547a-1957-45a0-9c36-0563a3cadbb6 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9af07e2c-ea0a-4629-b685-1d7f18030235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:24:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8e02547a-1957-45a0-9c36-0563a3cadbb6 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9af07e2c-ea0a-4629-b685-1d7f18030235) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd587141d-b1d4-4d26-9dcd-e6c9fec51fa8', 'volume_name': 'volume-d587141d-b1d4-4d26-9dcd-e6c9fec51fa8', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:24:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8e02547a-1957-45a0-9c36-0563a3cadbb6 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21bbf552-6041-4780-9b7b-f1403732a7cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:24:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8e02547a-1957-45a0-9c36-0563a3cadbb6 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21bbf552-6041-4780-9b7b-f1403732a7cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:24:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8e02547a-1957-45a0-9c36-0563a3cadbb6 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaf5f6c1-48bf-4bdb-97cd-7e09ece67142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:24:31 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-8e02547a-1957-45a0-9c36-0563a3cadbb6 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Volume d587141d-b1d4-4d26-9dcd-e6c9fec51fa8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d587141d-b1d4-4d26-9dcd-e6c9fec51fa8', 'volume_size': 1} Nov 04 12:24:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-8e02547a-1957-45a0-9c36-0563a3cadbb6 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:24:31 devstack sudo[102932]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-016980ec-f8a9-4f05-937e-afb6fe1b330d tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f1a93baf-2ec8-4803-a0a2-e876c89073d7 1073741824" returned: 0 in 0.793s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-016980ec-f8a9-4f05-937e-afb6fe1b330d tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f1a93baf-2ec8-4803-a0a2-e876c89073d7 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:31 devstack sudo[102939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f1a93baf-2ec8-4803-a0a2-e876c89073d7 Nov 04 12:24:31 devstack sudo[102939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:31 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-c72d8794-0d17-4e09-ba8f-09dfcc58364d tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:24:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c72d8794-0d17-4e09-ba8f-09dfcc58364d tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Flow 'volume_create_manager' (d0af5999-98b4-4326-826f-a14883600380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:24:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c72d8794-0d17-4e09-ba8f-09dfcc58364d tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be1da18e-8cfa-4983-a438-afbefef9a14c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:24:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c72d8794-0d17-4e09-ba8f-09dfcc58364d tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be1da18e-8cfa-4983-a438-afbefef9a14c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:24:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1267725634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5a5b379-552c-4257-947b-4fe260368688,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='183010e2bea744bba896cb5ddc3bba54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:24:31Z,use_quota=True,user_id='7f62eb6d6a504733ab31ba7bf4116693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:24:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c72d8794-0d17-4e09-ba8f-09dfcc58364d tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4728dbd5-e1b3-464a-a662-4ccacaf0abff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:24:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c72d8794-0d17-4e09-ba8f-09dfcc58364d tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4728dbd5-e1b3-464a-a662-4ccacaf0abff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:24:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c72d8794-0d17-4e09-ba8f-09dfcc58364d tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f766a6c-4c2e-4f1a-af33-cae4b45fad06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:24:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c72d8794-0d17-4e09-ba8f-09dfcc58364d tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f766a6c-4c2e-4f1a-af33-cae4b45fad06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5a5b379-552c-4257-947b-4fe260368688', 'volume_name': 'volume-c5a5b379-552c-4257-947b-4fe260368688', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:24:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c72d8794-0d17-4e09-ba8f-09dfcc58364d tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e9eaad4-bd41-4156-8012-a91e89b5ed2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:24:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c72d8794-0d17-4e09-ba8f-09dfcc58364d tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e9eaad4-bd41-4156-8012-a91e89b5ed2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:24:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c72d8794-0d17-4e09-ba8f-09dfcc58364d tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f5033e7-a522-4860-827f-c1570ec5dd68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:24:31 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-c72d8794-0d17-4e09-ba8f-09dfcc58364d tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Volume c5a5b379-552c-4257-947b-4fe260368688: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5a5b379-552c-4257-947b-4fe260368688', 'volume_size': 1} Nov 04 12:24:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c72d8794-0d17-4e09-ba8f-09dfcc58364d tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:24:31 devstack sudo[102939]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-016980ec-f8a9-4f05-937e-afb6fe1b330d tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f1a93baf-2ec8-4803-a0a2-e876c89073d7" returned: 0 in 0.599s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:31 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-016980ec-f8a9-4f05-937e-afb6fe1b330d tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] <== create_volume: return (1463ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:24:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-016980ec-f8a9-4f05-937e-afb6fe1b330d tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.471s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:24:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-8e02547a-1957-45a0-9c36-0563a3cadbb6 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.781s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:24:31 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-8e02547a-1957-45a0-9c36-0563a3cadbb6 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:24:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-889292136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d587141d-b1d4-4d26-9dcd-e6c9fec51fa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='183010e2bea744bba896cb5ddc3bba54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:24:31Z,use_quota=True,user_id='7f62eb6d6a504733ab31ba7bf4116693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:24:31 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-8e02547a-1957-45a0-9c36-0563a3cadbb6 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Creating volume d587141d-b1d4-4d26-9dcd-e6c9fec51fa8 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:24:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-8e02547a-1957-45a0-9c36-0563a3cadbb6 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:24:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-8e02547a-1957-45a0-9c36-0563a3cadbb6 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:24:31 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-8e02547a-1957-45a0-9c36-0563a3cadbb6 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:24:31 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-8e02547a-1957-45a0-9c36-0563a3cadbb6 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:24:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-8e02547a-1957-45a0-9c36-0563a3cadbb6 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:24:31 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-8e02547a-1957-45a0-9c36-0563a3cadbb6 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:24:31 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-8e02547a-1957-45a0-9c36-0563a3cadbb6 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:24:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8e02547a-1957-45a0-9c36-0563a3cadbb6 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d587141d-b1d4-4d26-9dcd-e6c9fec51fa8 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-016980ec-f8a9-4f05-937e-afb6fe1b330d tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b39416be-4296-4a5a-b2d8-cf5ef2db9889) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1a93baf-2ec8-4803-a0a2-e876c89073d7', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:24:31 devstack sudo[102942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d587141d-b1d4-4d26-9dcd-e6c9fec51fa8 1073741824 Nov 04 12:24:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-016980ec-f8a9-4f05-937e-afb6fe1b330d tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (898e5fe1-9daf-431d-8b91-9296b79b3e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:24:31 devstack sudo[102942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:31 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-016980ec-f8a9-4f05-937e-afb6fe1b330d tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Volume volume-f1a93baf-2ec8-4803-a0a2-e876c89073d7 (f1a93baf-2ec8-4803-a0a2-e876c89073d7): created successfully Nov 04 12:24:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-016980ec-f8a9-4f05-937e-afb6fe1b330d tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (898e5fe1-9daf-431d-8b91-9296b79b3e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:24:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-016980ec-f8a9-4f05-937e-afb6fe1b330d tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Flow 'volume_create_manager' (e1a8217c-673a-401c-afe7-9c57cd04cf1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:24:31 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-016980ec-f8a9-4f05-937e-afb6fe1b330d tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Created volume successfully. Nov 04 12:24:32 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-795402c0-ab32-48bb-a822-00661a23816c tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:24:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-795402c0-ab32-48bb-a822-00661a23816c tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Flow 'volume_create_manager' (bb36e267-2fed-44fe-aeed-71add0ea241e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:24:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-795402c0-ab32-48bb-a822-00661a23816c tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e944e5b4-a624-48fd-aeec-c83cb90fc00e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:24:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-795402c0-ab32-48bb-a822-00661a23816c tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e944e5b4-a624-48fd-aeec-c83cb90fc00e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:24:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1087761843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2e93c66-80cc-4f72-bf1a-1752a0a00b03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='183010e2bea744bba896cb5ddc3bba54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:24:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:24:32Z,use_quota=True,user_id='7f62eb6d6a504733ab31ba7bf4116693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:24:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-795402c0-ab32-48bb-a822-00661a23816c tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f20fbb2-9341-4a2b-aaf5-a2d3f147cfa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:24:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-795402c0-ab32-48bb-a822-00661a23816c tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f20fbb2-9341-4a2b-aaf5-a2d3f147cfa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:24:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-795402c0-ab32-48bb-a822-00661a23816c tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44566d05-629e-4a44-a846-37245f339767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:24:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-795402c0-ab32-48bb-a822-00661a23816c tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44566d05-629e-4a44-a846-37245f339767) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2e93c66-80cc-4f72-bf1a-1752a0a00b03', 'volume_name': 'volume-b2e93c66-80cc-4f72-bf1a-1752a0a00b03', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:24:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-795402c0-ab32-48bb-a822-00661a23816c tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (558b13b7-67c2-4f1d-b53a-ab5e74ebe760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:24:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-795402c0-ab32-48bb-a822-00661a23816c tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (558b13b7-67c2-4f1d-b53a-ab5e74ebe760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:24:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-795402c0-ab32-48bb-a822-00661a23816c tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7a8a743-ec4b-4fa3-a385-4e49bfc37ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:24:32 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-795402c0-ab32-48bb-a822-00661a23816c tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Volume b2e93c66-80cc-4f72-bf1a-1752a0a00b03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2e93c66-80cc-4f72-bf1a-1752a0a00b03', 'volume_size': 1} Nov 04 12:24:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-795402c0-ab32-48bb-a822-00661a23816c tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:24:32 devstack sudo[102942]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8e02547a-1957-45a0-9c36-0563a3cadbb6 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d587141d-b1d4-4d26-9dcd-e6c9fec51fa8 1073741824" returned: 0 in 0.742s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8e02547a-1957-45a0-9c36-0563a3cadbb6 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d587141d-b1d4-4d26-9dcd-e6c9fec51fa8 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:32 devstack sudo[102948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d587141d-b1d4-4d26-9dcd-e6c9fec51fa8 Nov 04 12:24:32 devstack sudo[102948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:33 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-f75a488e-cce7-4d80-8b5a-3208ec946276 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:24:33 devstack sudo[102948]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f75a488e-cce7-4d80-8b5a-3208ec946276 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Flow 'volume_create_manager' (2d59f2cd-7e63-4822-a7d6-87304af22d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:24:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f75a488e-cce7-4d80-8b5a-3208ec946276 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a258d00-8483-4a61-b1ec-761fbd32203f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:24:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8e02547a-1957-45a0-9c36-0563a3cadbb6 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d587141d-b1d4-4d26-9dcd-e6c9fec51fa8" returned: 0 in 0.379s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:33 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-8e02547a-1957-45a0-9c36-0563a3cadbb6 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] <== create_volume: return (1195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:24:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-8e02547a-1957-45a0-9c36-0563a3cadbb6 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.198s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:24:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c72d8794-0d17-4e09-ba8f-09dfcc58364d tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.262s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:24:33 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c72d8794-0d17-4e09-ba8f-09dfcc58364d tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:24:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1267725634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5a5b379-552c-4257-947b-4fe260368688,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='183010e2bea744bba896cb5ddc3bba54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:24:31Z,use_quota=True,user_id='7f62eb6d6a504733ab31ba7bf4116693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:24:33 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-c72d8794-0d17-4e09-ba8f-09dfcc58364d tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Creating volume c5a5b379-552c-4257-947b-4fe260368688 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:24:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c72d8794-0d17-4e09-ba8f-09dfcc58364d tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:24:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c72d8794-0d17-4e09-ba8f-09dfcc58364d tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:24:33 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c72d8794-0d17-4e09-ba8f-09dfcc58364d tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:24:33 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c72d8794-0d17-4e09-ba8f-09dfcc58364d tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:24:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c72d8794-0d17-4e09-ba8f-09dfcc58364d tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:24:33 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c72d8794-0d17-4e09-ba8f-09dfcc58364d tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:24:33 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-c72d8794-0d17-4e09-ba8f-09dfcc58364d tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:24:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c72d8794-0d17-4e09-ba8f-09dfcc58364d tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c5a5b379-552c-4257-947b-4fe260368688 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f75a488e-cce7-4d80-8b5a-3208ec946276 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a258d00-8483-4a61-b1ec-761fbd32203f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:24:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1850528135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd8ff63c-ac41-43c5-ace6-103968d367d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='183010e2bea744bba896cb5ddc3bba54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:24:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:24:33Z,use_quota=True,user_id='7f62eb6d6a504733ab31ba7bf4116693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:24:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f75a488e-cce7-4d80-8b5a-3208ec946276 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9b4f7dc-914b-4fd6-b9e1-6879e5c7f457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:24:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f75a488e-cce7-4d80-8b5a-3208ec946276 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9b4f7dc-914b-4fd6-b9e1-6879e5c7f457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:24:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f75a488e-cce7-4d80-8b5a-3208ec946276 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3123ca4a-2a3a-404e-84c8-094a359e246f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:24:33 devstack sudo[102952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c5a5b379-552c-4257-947b-4fe260368688 1073741824 Nov 04 12:24:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f75a488e-cce7-4d80-8b5a-3208ec946276 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3123ca4a-2a3a-404e-84c8-094a359e246f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd8ff63c-ac41-43c5-ace6-103968d367d1', 'volume_name': 'volume-fd8ff63c-ac41-43c5-ace6-103968d367d1', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:24:33 devstack sudo[102952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f75a488e-cce7-4d80-8b5a-3208ec946276 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c23f428-950d-4cef-a940-48564bd0f09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:24:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f75a488e-cce7-4d80-8b5a-3208ec946276 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c23f428-950d-4cef-a940-48564bd0f09f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:24:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f75a488e-cce7-4d80-8b5a-3208ec946276 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a455f31-87eb-4c7c-a672-817b89de765e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:24:33 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-f75a488e-cce7-4d80-8b5a-3208ec946276 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Volume fd8ff63c-ac41-43c5-ace6-103968d367d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd8ff63c-ac41-43c5-ace6-103968d367d1', 'volume_size': 1} Nov 04 12:24:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f75a488e-cce7-4d80-8b5a-3208ec946276 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:24:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8e02547a-1957-45a0-9c36-0563a3cadbb6 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaf5f6c1-48bf-4bdb-97cd-7e09ece67142) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d587141d-b1d4-4d26-9dcd-e6c9fec51fa8', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:24:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8e02547a-1957-45a0-9c36-0563a3cadbb6 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (147ff52d-6588-4c03-8caa-6864d693c3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:24:33 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-8e02547a-1957-45a0-9c36-0563a3cadbb6 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Volume volume-d587141d-b1d4-4d26-9dcd-e6c9fec51fa8 (d587141d-b1d4-4d26-9dcd-e6c9fec51fa8): created successfully Nov 04 12:24:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8e02547a-1957-45a0-9c36-0563a3cadbb6 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (147ff52d-6588-4c03-8caa-6864d693c3f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:24:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8e02547a-1957-45a0-9c36-0563a3cadbb6 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Flow 'volume_create_manager' (ac415e07-924e-42b9-b755-22618e680b5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:24:33 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-8e02547a-1957-45a0-9c36-0563a3cadbb6 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Created volume successfully. Nov 04 12:24:33 devstack sudo[102952]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c72d8794-0d17-4e09-ba8f-09dfcc58364d tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c5a5b379-552c-4257-947b-4fe260368688 1073741824" returned: 0 in 0.598s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c72d8794-0d17-4e09-ba8f-09dfcc58364d tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c5a5b379-552c-4257-947b-4fe260368688 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:33 devstack sudo[102959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c5a5b379-552c-4257-947b-4fe260368688 Nov 04 12:24:33 devstack sudo[102959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:34 devstack sudo[102959]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c72d8794-0d17-4e09-ba8f-09dfcc58364d tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c5a5b379-552c-4257-947b-4fe260368688" returned: 0 in 0.388s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:34 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c72d8794-0d17-4e09-ba8f-09dfcc58364d tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:24:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c72d8794-0d17-4e09-ba8f-09dfcc58364d tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:24:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-795402c0-ab32-48bb-a822-00661a23816c tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.592s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:24:34 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-795402c0-ab32-48bb-a822-00661a23816c tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:24:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1087761843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2e93c66-80cc-4f72-bf1a-1752a0a00b03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='183010e2bea744bba896cb5ddc3bba54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:24:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:24:32Z,use_quota=True,user_id='7f62eb6d6a504733ab31ba7bf4116693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:24:34 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-795402c0-ab32-48bb-a822-00661a23816c tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Creating volume b2e93c66-80cc-4f72-bf1a-1752a0a00b03 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:24:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-795402c0-ab32-48bb-a822-00661a23816c tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:24:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-795402c0-ab32-48bb-a822-00661a23816c tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:24:34 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-795402c0-ab32-48bb-a822-00661a23816c tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:24:34 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-795402c0-ab32-48bb-a822-00661a23816c tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:24:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-795402c0-ab32-48bb-a822-00661a23816c tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:24:34 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-795402c0-ab32-48bb-a822-00661a23816c tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:24:34 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-795402c0-ab32-48bb-a822-00661a23816c tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:24:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-795402c0-ab32-48bb-a822-00661a23816c tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b2e93c66-80cc-4f72-bf1a-1752a0a00b03 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:34 devstack sudo[102962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b2e93c66-80cc-4f72-bf1a-1752a0a00b03 1073741824 Nov 04 12:24:34 devstack sudo[102962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c72d8794-0d17-4e09-ba8f-09dfcc58364d tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f5033e7-a522-4860-827f-c1570ec5dd68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5a5b379-552c-4257-947b-4fe260368688', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:24:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c72d8794-0d17-4e09-ba8f-09dfcc58364d tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0406907b-68d3-43dd-8fd2-abad0797f7dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:24:34 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-c72d8794-0d17-4e09-ba8f-09dfcc58364d tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Volume volume-c5a5b379-552c-4257-947b-4fe260368688 (c5a5b379-552c-4257-947b-4fe260368688): created successfully Nov 04 12:24:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c72d8794-0d17-4e09-ba8f-09dfcc58364d tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0406907b-68d3-43dd-8fd2-abad0797f7dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:24:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c72d8794-0d17-4e09-ba8f-09dfcc58364d tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Flow 'volume_create_manager' (d0af5999-98b4-4326-826f-a14883600380) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:24:34 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-c72d8794-0d17-4e09-ba8f-09dfcc58364d tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Created volume successfully. Nov 04 12:24:34 devstack sudo[102962]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-795402c0-ab32-48bb-a822-00661a23816c tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b2e93c66-80cc-4f72-bf1a-1752a0a00b03 1073741824" returned: 0 in 0.600s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-795402c0-ab32-48bb-a822-00661a23816c tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b2e93c66-80cc-4f72-bf1a-1752a0a00b03 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:34 devstack sudo[102968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b2e93c66-80cc-4f72-bf1a-1752a0a00b03 Nov 04 12:24:34 devstack sudo[102968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:35 devstack sudo[102968]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-795402c0-ab32-48bb-a822-00661a23816c tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b2e93c66-80cc-4f72-bf1a-1752a0a00b03" returned: 0 in 0.268s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:35 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-795402c0-ab32-48bb-a822-00661a23816c tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:24:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-795402c0-ab32-48bb-a822-00661a23816c tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:24:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f75a488e-cce7-4d80-8b5a-3208ec946276 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.924s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:24:35 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f75a488e-cce7-4d80-8b5a-3208ec946276 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:24:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1850528135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd8ff63c-ac41-43c5-ace6-103968d367d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='183010e2bea744bba896cb5ddc3bba54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:24:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:24:33Z,use_quota=True,user_id='7f62eb6d6a504733ab31ba7bf4116693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:24:35 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-f75a488e-cce7-4d80-8b5a-3208ec946276 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Creating volume fd8ff63c-ac41-43c5-ace6-103968d367d1 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:24:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f75a488e-cce7-4d80-8b5a-3208ec946276 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:24:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f75a488e-cce7-4d80-8b5a-3208ec946276 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:24:35 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f75a488e-cce7-4d80-8b5a-3208ec946276 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:24:35 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f75a488e-cce7-4d80-8b5a-3208ec946276 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:24:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f75a488e-cce7-4d80-8b5a-3208ec946276 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:24:35 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f75a488e-cce7-4d80-8b5a-3208ec946276 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:24:35 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-f75a488e-cce7-4d80-8b5a-3208ec946276 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:24:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f75a488e-cce7-4d80-8b5a-3208ec946276 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fd8ff63c-ac41-43c5-ace6-103968d367d1 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-795402c0-ab32-48bb-a822-00661a23816c tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7a8a743-ec4b-4fa3-a385-4e49bfc37ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2e93c66-80cc-4f72-bf1a-1752a0a00b03', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:24:35 devstack sudo[102971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fd8ff63c-ac41-43c5-ace6-103968d367d1 1073741824 Nov 04 12:24:35 devstack sudo[102971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-795402c0-ab32-48bb-a822-00661a23816c tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ebaca5d-8c33-4be3-9408-454dffc6a59b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:24:35 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-795402c0-ab32-48bb-a822-00661a23816c tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Volume volume-b2e93c66-80cc-4f72-bf1a-1752a0a00b03 (b2e93c66-80cc-4f72-bf1a-1752a0a00b03): created successfully Nov 04 12:24:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-795402c0-ab32-48bb-a822-00661a23816c tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ebaca5d-8c33-4be3-9408-454dffc6a59b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:24:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-795402c0-ab32-48bb-a822-00661a23816c tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Flow 'volume_create_manager' (bb36e267-2fed-44fe-aeed-71add0ea241e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:24:35 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-795402c0-ab32-48bb-a822-00661a23816c tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Created volume successfully. Nov 04 12:24:35 devstack sudo[102971]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f75a488e-cce7-4d80-8b5a-3208ec946276 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fd8ff63c-ac41-43c5-ace6-103968d367d1 1073741824" returned: 0 in 0.726s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f75a488e-cce7-4d80-8b5a-3208ec946276 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fd8ff63c-ac41-43c5-ace6-103968d367d1 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:35 devstack sudo[102978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fd8ff63c-ac41-43c5-ace6-103968d367d1 Nov 04 12:24:35 devstack sudo[102978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:36 devstack sudo[102978]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f75a488e-cce7-4d80-8b5a-3208ec946276 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fd8ff63c-ac41-43c5-ace6-103968d367d1" returned: 0 in 0.307s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:36 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f75a488e-cce7-4d80-8b5a-3208ec946276 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:24:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f75a488e-cce7-4d80-8b5a-3208ec946276 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:24:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f75a488e-cce7-4d80-8b5a-3208ec946276 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a455f31-87eb-4c7c-a672-817b89de765e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd8ff63c-ac41-43c5-ace6-103968d367d1', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:24:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f75a488e-cce7-4d80-8b5a-3208ec946276 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf947a45-7ab8-4edf-9a68-c27f3e78ed8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:24:36 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-f75a488e-cce7-4d80-8b5a-3208ec946276 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Volume volume-fd8ff63c-ac41-43c5-ace6-103968d367d1 (fd8ff63c-ac41-43c5-ace6-103968d367d1): created successfully Nov 04 12:24:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f75a488e-cce7-4d80-8b5a-3208ec946276 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf947a45-7ab8-4edf-9a68-c27f3e78ed8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:24:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f75a488e-cce7-4d80-8b5a-3208ec946276 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Flow 'volume_create_manager' (2d59f2cd-7e63-4822-a7d6-87304af22d08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:24:36 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-f75a488e-cce7-4d80-8b5a-3208ec946276 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Created volume successfully. Nov 04 12:24:36 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7a840325-e5e4-484b-bfff-3eb51146419c tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Acquiring lock "cinder-fd8ff63c-ac41-43c5-ace6-103968d367d1-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:24:36 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7a840325-e5e4-484b-bfff-3eb51146419c tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Lock "cinder-fd8ff63c-ac41-43c5-ace6-103968d367d1-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:24:36 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7a840325-e5e4-484b-bfff-3eb51146419c tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Acquiring lock "cinder-quobyte-fd8ff63c-ac41-43c5-ace6-103968d367d1" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:24:36 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7a840325-e5e4-484b-bfff-3eb51146419c tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Lock "cinder-quobyte-fd8ff63c-ac41-43c5-ace6-103968d367d1" acquired by "delete_volume" :: waited 0.037s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:24:36 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[521b0fbd-1873-4c20-b83f-c4866209d0be]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:24:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7a840325-e5e4-484b-bfff-3eb51146419c tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fd8ff63c-ac41-43c5-ace6-103968d367d1 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:36 devstack sudo[102982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fd8ff63c-ac41-43c5-ace6-103968d367d1 Nov 04 12:24:36 devstack sudo[102982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:37 devstack sudo[102982]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7a840325-e5e4-484b-bfff-3eb51146419c tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fd8ff63c-ac41-43c5-ace6-103968d367d1" returned: 0 in 0.400s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7a840325-e5e4-484b-bfff-3eb51146419c tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fd8ff63c-ac41-43c5-ace6-103968d367d1 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:37 devstack sudo[102987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fd8ff63c-ac41-43c5-ace6-103968d367d1 Nov 04 12:24:37 devstack sudo[102987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:37 devstack sudo[102987]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7a840325-e5e4-484b-bfff-3eb51146419c tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fd8ff63c-ac41-43c5-ace6-103968d367d1" returned: 0 in 0.344s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:37 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7a840325-e5e4-484b-bfff-3eb51146419c tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Lock "cinder-quobyte-fd8ff63c-ac41-43c5-ace6-103968d367d1" released by "delete_volume" :: held 0.811s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:24:37 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-7a840325-e5e4-484b-bfff-3eb51146419c tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Created reservations ['ea2d2a68-d314-470b-abf7-b58120bc3969', '0e0ad17b-6cfc-4c5d-ae4f-5268a7afb29a', 'b674fa5a-2196-4e86-9cb1-e2cbf877fb41', '8cf2fb5b-f9c8-4c39-ab8a-2b5c87303b4a'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:24:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7a840325-e5e4-484b-bfff-3eb51146419c tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:24:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7a840325-e5e4-484b-bfff-3eb51146419c tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:24:37 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7a840325-e5e4-484b-bfff-3eb51146419c tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:24:37 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7a840325-e5e4-484b-bfff-3eb51146419c tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:24:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7a840325-e5e4-484b-bfff-3eb51146419c tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:24:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7a840325-e5e4-484b-bfff-3eb51146419c tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:37 devstack sudo[102990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:24:37 devstack sudo[102990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:37 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-1ee122dd-2139-4721-bbce-d0ea16f47ff6 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Acquiring lock "cinder-b2e93c66-80cc-4f72-bf1a-1752a0a00b03-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:24:37 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-1ee122dd-2139-4721-bbce-d0ea16f47ff6 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Lock "cinder-b2e93c66-80cc-4f72-bf1a-1752a0a00b03-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:24:38 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-1ee122dd-2139-4721-bbce-d0ea16f47ff6 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Acquiring lock "cinder-quobyte-b2e93c66-80cc-4f72-bf1a-1752a0a00b03" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:24:38 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-1ee122dd-2139-4721-bbce-d0ea16f47ff6 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Lock "cinder-quobyte-b2e93c66-80cc-4f72-bf1a-1752a0a00b03" acquired by "delete_volume" :: waited 0.026s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:24:38 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece2ceb0-5313-478a-9aa1-a94019089799]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:24:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1ee122dd-2139-4721-bbce-d0ea16f47ff6 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b2e93c66-80cc-4f72-bf1a-1752a0a00b03 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:38 devstack sudo[102990]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7a840325-e5e4-484b-bfff-3eb51146419c tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.458s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:38 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-7a840325-e5e4-484b-bfff-3eb51146419c tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:24:38 devstack sudo[102992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b2e93c66-80cc-4f72-bf1a-1752a0a00b03 Nov 04 12:24:38 devstack sudo[102992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:38 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-7a840325-e5e4-484b-bfff-3eb51146419c tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Deleted volume successfully. Nov 04 12:24:38 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7a840325-e5e4-484b-bfff-3eb51146419c tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Lock "cinder-fd8ff63c-ac41-43c5-ace6-103968d367d1-delete_volume" released by "delete_volume" :: held 1.700s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:24:38 devstack sudo[102992]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1ee122dd-2139-4721-bbce-d0ea16f47ff6 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b2e93c66-80cc-4f72-bf1a-1752a0a00b03" returned: 0 in 0.555s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1ee122dd-2139-4721-bbce-d0ea16f47ff6 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b2e93c66-80cc-4f72-bf1a-1752a0a00b03 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:38 devstack sudo[102998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b2e93c66-80cc-4f72-bf1a-1752a0a00b03 Nov 04 12:24:38 devstack sudo[102998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:38 devstack sudo[102998]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1ee122dd-2139-4721-bbce-d0ea16f47ff6 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b2e93c66-80cc-4f72-bf1a-1752a0a00b03" returned: 0 in 0.323s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:39 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-1ee122dd-2139-4721-bbce-d0ea16f47ff6 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Lock "cinder-quobyte-b2e93c66-80cc-4f72-bf1a-1752a0a00b03" released by "delete_volume" :: held 0.955s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:24:39 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-1ee122dd-2139-4721-bbce-d0ea16f47ff6 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Created reservations ['468723d4-57cd-43d8-ba8c-8a3d535f6f81', 'e510d2d4-d65f-4692-b0a3-e8e2bb03a3e3', 'd6aab73c-6d78-4a0e-a36e-c6febd0a98a0', '57e8457e-e71f-4ce7-95c6-2a16262dcb48'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:24:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1ee122dd-2139-4721-bbce-d0ea16f47ff6 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:24:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1ee122dd-2139-4721-bbce-d0ea16f47ff6 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:24:39 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1ee122dd-2139-4721-bbce-d0ea16f47ff6 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:24:39 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1ee122dd-2139-4721-bbce-d0ea16f47ff6 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:24:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1ee122dd-2139-4721-bbce-d0ea16f47ff6 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:24:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1ee122dd-2139-4721-bbce-d0ea16f47ff6 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:39 devstack sudo[103001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:24:39 devstack sudo[103001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:39 devstack sudo[103001]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1ee122dd-2139-4721-bbce-d0ea16f47ff6 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.263s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:39 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-1ee122dd-2139-4721-bbce-d0ea16f47ff6 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:24:39 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-1ee122dd-2139-4721-bbce-d0ea16f47ff6 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Deleted volume successfully. Nov 04 12:24:39 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-1ee122dd-2139-4721-bbce-d0ea16f47ff6 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Lock "cinder-b2e93c66-80cc-4f72-bf1a-1752a0a00b03-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:24:40 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-593a8de5-6dd2-4cc2-bb02-49b19e9310c4 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Acquiring lock "cinder-c5a5b379-552c-4257-947b-4fe260368688-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:24:40 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-593a8de5-6dd2-4cc2-bb02-49b19e9310c4 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Lock "cinder-c5a5b379-552c-4257-947b-4fe260368688-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:24:40 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-593a8de5-6dd2-4cc2-bb02-49b19e9310c4 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Acquiring lock "cinder-quobyte-c5a5b379-552c-4257-947b-4fe260368688" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:24:40 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-593a8de5-6dd2-4cc2-bb02-49b19e9310c4 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Lock "cinder-quobyte-c5a5b379-552c-4257-947b-4fe260368688" acquired by "delete_volume" :: waited 0.023s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:24:40 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[df18c479-463d-481c-83ff-511895051162]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:24:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-593a8de5-6dd2-4cc2-bb02-49b19e9310c4 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c5a5b379-552c-4257-947b-4fe260368688 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:40 devstack sudo[103004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c5a5b379-552c-4257-947b-4fe260368688 Nov 04 12:24:40 devstack sudo[103004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:40 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc132f2d-27cf-43c8-a801-45e173d6d825 tempest-VolumesTestJSON-1683843544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:24:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dc132f2d-27cf-43c8-a801-45e173d6d825 tempest-VolumesTestJSON-1683843544 None] Flow 'volume_create_manager' (10a13cec-6fa2-48d7-ac5b-d56473e62f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:24:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dc132f2d-27cf-43c8-a801-45e173d6d825 tempest-VolumesTestJSON-1683843544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9c57ad1-48f6-4d53-8a1c-ef3a9eaef36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:24:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dc132f2d-27cf-43c8-a801-45e173d6d825 tempest-VolumesTestJSON-1683843544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9c57ad1-48f6-4d53-8a1c-ef3a9eaef36e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:24:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-14035219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b76108c-ded9-4200-a902-b4f3bd7eaf1c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0f3c767dddc648b7815bf84835a327ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:24:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:24:41Z,use_quota=True,user_id='5ac5f672e7474d44a2f59268306d8704',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:24:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dc132f2d-27cf-43c8-a801-45e173d6d825 tempest-VolumesTestJSON-1683843544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41ac2aa4-f0bf-40d9-b758-f4df507de19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:24:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dc132f2d-27cf-43c8-a801-45e173d6d825 tempest-VolumesTestJSON-1683843544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41ac2aa4-f0bf-40d9-b758-f4df507de19e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:24:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dc132f2d-27cf-43c8-a801-45e173d6d825 tempest-VolumesTestJSON-1683843544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c819808-4b8d-4d55-8401-55f791f20b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:24:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dc132f2d-27cf-43c8-a801-45e173d6d825 tempest-VolumesTestJSON-1683843544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c819808-4b8d-4d55-8401-55f791f20b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b76108c-ded9-4200-a902-b4f3bd7eaf1c', 'volume_name': 'volume-8b76108c-ded9-4200-a902-b4f3bd7eaf1c', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:24:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dc132f2d-27cf-43c8-a801-45e173d6d825 tempest-VolumesTestJSON-1683843544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (987cfe7f-df92-43be-bf4a-c9371ed8a5f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:24:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dc132f2d-27cf-43c8-a801-45e173d6d825 tempest-VolumesTestJSON-1683843544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (987cfe7f-df92-43be-bf4a-c9371ed8a5f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:24:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dc132f2d-27cf-43c8-a801-45e173d6d825 tempest-VolumesTestJSON-1683843544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa12a60d-4a00-401a-bce5-76e49aa83dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:24:40 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-dc132f2d-27cf-43c8-a801-45e173d6d825 tempest-VolumesTestJSON-1683843544 None] Volume 8b76108c-ded9-4200-a902-b4f3bd7eaf1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b76108c-ded9-4200-a902-b4f3bd7eaf1c', 'volume_size': 1} Nov 04 12:24:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-dc132f2d-27cf-43c8-a801-45e173d6d825 tempest-VolumesTestJSON-1683843544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:24:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-dc132f2d-27cf-43c8-a801-45e173d6d825 tempest-VolumesTestJSON-1683843544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:24:40 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-dc132f2d-27cf-43c8-a801-45e173d6d825 tempest-VolumesTestJSON-1683843544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:24:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-14035219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b76108c-ded9-4200-a902-b4f3bd7eaf1c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0f3c767dddc648b7815bf84835a327ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:24:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:24:41Z,use_quota=True,user_id='5ac5f672e7474d44a2f59268306d8704',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:24:40 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-dc132f2d-27cf-43c8-a801-45e173d6d825 tempest-VolumesTestJSON-1683843544 None] Creating volume 8b76108c-ded9-4200-a902-b4f3bd7eaf1c {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:24:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-dc132f2d-27cf-43c8-a801-45e173d6d825 tempest-VolumesTestJSON-1683843544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:24:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-dc132f2d-27cf-43c8-a801-45e173d6d825 tempest-VolumesTestJSON-1683843544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:24:40 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-dc132f2d-27cf-43c8-a801-45e173d6d825 tempest-VolumesTestJSON-1683843544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:24:40 devstack sudo[103004]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:40 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-dc132f2d-27cf-43c8-a801-45e173d6d825 tempest-VolumesTestJSON-1683843544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:24:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-dc132f2d-27cf-43c8-a801-45e173d6d825 tempest-VolumesTestJSON-1683843544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:24:40 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-dc132f2d-27cf-43c8-a801-45e173d6d825 tempest-VolumesTestJSON-1683843544 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:24:40 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-dc132f2d-27cf-43c8-a801-45e173d6d825 tempest-VolumesTestJSON-1683843544 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:24:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-dc132f2d-27cf-43c8-a801-45e173d6d825 tempest-VolumesTestJSON-1683843544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8b76108c-ded9-4200-a902-b4f3bd7eaf1c 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-593a8de5-6dd2-4cc2-bb02-49b19e9310c4 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c5a5b379-552c-4257-947b-4fe260368688" returned: 0 in 0.459s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-593a8de5-6dd2-4cc2-bb02-49b19e9310c4 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c5a5b379-552c-4257-947b-4fe260368688 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:40 devstack sudo[103010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8b76108c-ded9-4200-a902-b4f3bd7eaf1c 1073741824 Nov 04 12:24:40 devstack sudo[103010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:40 devstack sudo[103011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c5a5b379-552c-4257-947b-4fe260368688 Nov 04 12:24:40 devstack sudo[103011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:41 devstack sudo[103011]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-593a8de5-6dd2-4cc2-bb02-49b19e9310c4 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c5a5b379-552c-4257-947b-4fe260368688" returned: 0 in 0.300s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:41 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-593a8de5-6dd2-4cc2-bb02-49b19e9310c4 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Lock "cinder-quobyte-c5a5b379-552c-4257-947b-4fe260368688" released by "delete_volume" :: held 0.813s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:24:41 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-593a8de5-6dd2-4cc2-bb02-49b19e9310c4 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Created reservations ['507b66ab-397c-4f7d-9611-0e9364da857f', 'da2cb0b0-122e-44d6-9022-7f1461c024c5', '6a21900a-0221-402a-8776-7a265f0841f7', '18377ec7-9cc7-48c9-83cc-8f0f322f97ad'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:24:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-593a8de5-6dd2-4cc2-bb02-49b19e9310c4 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:24:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-593a8de5-6dd2-4cc2-bb02-49b19e9310c4 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:24:41 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-593a8de5-6dd2-4cc2-bb02-49b19e9310c4 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:24:41 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-593a8de5-6dd2-4cc2-bb02-49b19e9310c4 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:24:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-593a8de5-6dd2-4cc2-bb02-49b19e9310c4 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:24:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-593a8de5-6dd2-4cc2-bb02-49b19e9310c4 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:41 devstack sudo[103010]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:41 devstack sudo[103018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:24:41 devstack sudo[103018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-dc132f2d-27cf-43c8-a801-45e173d6d825 tempest-VolumesTestJSON-1683843544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8b76108c-ded9-4200-a902-b4f3bd7eaf1c 1073741824" returned: 0 in 0.517s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-dc132f2d-27cf-43c8-a801-45e173d6d825 tempest-VolumesTestJSON-1683843544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8b76108c-ded9-4200-a902-b4f3bd7eaf1c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:41 devstack sudo[103020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8b76108c-ded9-4200-a902-b4f3bd7eaf1c Nov 04 12:24:41 devstack sudo[103020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:41 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-637b5c55-1ac2-4763-ac4d-4e0acc9eb10c tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Acquiring lock "cinder-d587141d-b1d4-4d26-9dcd-e6c9fec51fa8-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:24:41 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-637b5c55-1ac2-4763-ac4d-4e0acc9eb10c tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Lock "cinder-d587141d-b1d4-4d26-9dcd-e6c9fec51fa8-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:24:41 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-637b5c55-1ac2-4763-ac4d-4e0acc9eb10c tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Acquiring lock "cinder-quobyte-d587141d-b1d4-4d26-9dcd-e6c9fec51fa8" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:24:41 devstack sudo[103018]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-593a8de5-6dd2-4cc2-bb02-49b19e9310c4 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.293s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:41 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-593a8de5-6dd2-4cc2-bb02-49b19e9310c4 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:24:41 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-637b5c55-1ac2-4763-ac4d-4e0acc9eb10c tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Lock "cinder-quobyte-d587141d-b1d4-4d26-9dcd-e6c9fec51fa8" acquired by "delete_volume" :: waited 0.033s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:24:41 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-593a8de5-6dd2-4cc2-bb02-49b19e9310c4 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Deleted volume successfully. Nov 04 12:24:41 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a0f4b62-4ea8-4787-8afe-43757bc6a84f]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:24:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-637b5c55-1ac2-4763-ac4d-4e0acc9eb10c tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d587141d-b1d4-4d26-9dcd-e6c9fec51fa8 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:41 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-593a8de5-6dd2-4cc2-bb02-49b19e9310c4 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Lock "cinder-c5a5b379-552c-4257-947b-4fe260368688-delete_volume" released by "delete_volume" :: held 1.422s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:24:41 devstack sudo[103020]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-dc132f2d-27cf-43c8-a801-45e173d6d825 tempest-VolumesTestJSON-1683843544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8b76108c-ded9-4200-a902-b4f3bd7eaf1c" returned: 0 in 0.372s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:41 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-dc132f2d-27cf-43c8-a801-45e173d6d825 tempest-VolumesTestJSON-1683843544 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:24:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-dc132f2d-27cf-43c8-a801-45e173d6d825 tempest-VolumesTestJSON-1683843544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:24:41 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dc132f2d-27cf-43c8-a801-45e173d6d825 tempest-VolumesTestJSON-1683843544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa12a60d-4a00-401a-bce5-76e49aa83dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b76108c-ded9-4200-a902-b4f3bd7eaf1c', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:24:41 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dc132f2d-27cf-43c8-a801-45e173d6d825 tempest-VolumesTestJSON-1683843544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb23c41b-76a3-48e0-add9-a33663c3040a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:24:41 devstack sudo[103023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d587141d-b1d4-4d26-9dcd-e6c9fec51fa8 Nov 04 12:24:41 devstack sudo[103023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:41 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-dc132f2d-27cf-43c8-a801-45e173d6d825 tempest-VolumesTestJSON-1683843544 None] Volume volume-8b76108c-ded9-4200-a902-b4f3bd7eaf1c (8b76108c-ded9-4200-a902-b4f3bd7eaf1c): created successfully Nov 04 12:24:41 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dc132f2d-27cf-43c8-a801-45e173d6d825 tempest-VolumesTestJSON-1683843544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb23c41b-76a3-48e0-add9-a33663c3040a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:24:41 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dc132f2d-27cf-43c8-a801-45e173d6d825 tempest-VolumesTestJSON-1683843544 None] Flow 'volume_create_manager' (10a13cec-6fa2-48d7-ac5b-d56473e62f27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:24:41 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-dc132f2d-27cf-43c8-a801-45e173d6d825 tempest-VolumesTestJSON-1683843544 None] Created volume successfully. Nov 04 12:24:42 devstack sudo[103023]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-637b5c55-1ac2-4763-ac4d-4e0acc9eb10c tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d587141d-b1d4-4d26-9dcd-e6c9fec51fa8" returned: 0 in 0.397s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-637b5c55-1ac2-4763-ac4d-4e0acc9eb10c tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d587141d-b1d4-4d26-9dcd-e6c9fec51fa8 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:42 devstack sudo[103030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d587141d-b1d4-4d26-9dcd-e6c9fec51fa8 Nov 04 12:24:42 devstack sudo[103030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:42 devstack sudo[103030]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-637b5c55-1ac2-4763-ac4d-4e0acc9eb10c tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d587141d-b1d4-4d26-9dcd-e6c9fec51fa8" returned: 0 in 0.282s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:42 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-637b5c55-1ac2-4763-ac4d-4e0acc9eb10c tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Lock "cinder-quobyte-d587141d-b1d4-4d26-9dcd-e6c9fec51fa8" released by "delete_volume" :: held 0.743s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:24:42 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-637b5c55-1ac2-4763-ac4d-4e0acc9eb10c tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Created reservations ['221811d6-fc99-43db-97d0-01322fd8deac', 'af0eab22-77f0-47ab-8432-679cafd6d461', 'ef35cda2-7e4e-4108-9571-a2de36e8d996', '458fd342-a9dd-4a90-9bb0-0d9776c965ed'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:24:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-637b5c55-1ac2-4763-ac4d-4e0acc9eb10c tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:24:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-637b5c55-1ac2-4763-ac4d-4e0acc9eb10c tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:24:42 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-637b5c55-1ac2-4763-ac4d-4e0acc9eb10c tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:24:42 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-637b5c55-1ac2-4763-ac4d-4e0acc9eb10c tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:24:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-637b5c55-1ac2-4763-ac4d-4e0acc9eb10c tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:24:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-637b5c55-1ac2-4763-ac4d-4e0acc9eb10c tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:42 devstack sudo[103033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:24:42 devstack sudo[103033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:42 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-4c22a189-bab8-49ab-b827-a6787d7961e9 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Acquiring lock "cinder-f1a93baf-2ec8-4803-a0a2-e876c89073d7-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:24:42 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-4c22a189-bab8-49ab-b827-a6787d7961e9 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Lock "cinder-f1a93baf-2ec8-4803-a0a2-e876c89073d7-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:24:42 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-4c22a189-bab8-49ab-b827-a6787d7961e9 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Acquiring lock "cinder-quobyte-f1a93baf-2ec8-4803-a0a2-e876c89073d7" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:24:42 devstack sudo[103033]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:42 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-4c22a189-bab8-49ab-b827-a6787d7961e9 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Lock "cinder-quobyte-f1a93baf-2ec8-4803-a0a2-e876c89073d7" acquired by "delete_volume" :: waited 0.017s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:24:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-637b5c55-1ac2-4763-ac4d-4e0acc9eb10c tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.349s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:42 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-637b5c55-1ac2-4763-ac4d-4e0acc9eb10c tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:24:42 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-637b5c55-1ac2-4763-ac4d-4e0acc9eb10c tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Deleted volume successfully. Nov 04 12:24:42 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d2207a-5c2f-4e57-9974-e54d9cfa90c2]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:24:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4c22a189-bab8-49ab-b827-a6787d7961e9 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f1a93baf-2ec8-4803-a0a2-e876c89073d7 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:42 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-637b5c55-1ac2-4763-ac4d-4e0acc9eb10c tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Lock "cinder-d587141d-b1d4-4d26-9dcd-e6c9fec51fa8-delete_volume" released by "delete_volume" :: held 1.382s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:24:43 devstack sudo[103036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f1a93baf-2ec8-4803-a0a2-e876c89073d7 Nov 04 12:24:43 devstack sudo[103036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:43 devstack sudo[103036]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4c22a189-bab8-49ab-b827-a6787d7961e9 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f1a93baf-2ec8-4803-a0a2-e876c89073d7" returned: 0 in 0.446s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4c22a189-bab8-49ab-b827-a6787d7961e9 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f1a93baf-2ec8-4803-a0a2-e876c89073d7 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:43 devstack sudo[103042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f1a93baf-2ec8-4803-a0a2-e876c89073d7 Nov 04 12:24:43 devstack sudo[103042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:43 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-40209234-bb69-4c68-b20f-32cf0a97e083 tempest-TestShelveInstance-181440490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:24:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-40209234-bb69-4c68-b20f-32cf0a97e083 tempest-TestShelveInstance-181440490 None] Flow 'volume_create_manager' (096f8055-14c3-4771-9262-ff90e0f3c101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:24:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-40209234-bb69-4c68-b20f-32cf0a97e083 tempest-TestShelveInstance-181440490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6bb5caf-967b-4f9a-b2d5-66f2f9669fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:24:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-40209234-bb69-4c68-b20f-32cf0a97e083 tempest-TestShelveInstance-181440490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6bb5caf-967b-4f9a-b2d5-66f2f9669fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-908551578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3657e41b-da17-451a-8749-edb5fed7bcd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='091d570d0fd74a0b8dccd422a13b8708',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:24:43Z,use_quota=True,user_id='231dca5ac71d467399968146a0f9ef53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:24:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-40209234-bb69-4c68-b20f-32cf0a97e083 tempest-TestShelveInstance-181440490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9586cb97-4694-4944-8c6a-bb54c6e01d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:24:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-40209234-bb69-4c68-b20f-32cf0a97e083 tempest-TestShelveInstance-181440490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9586cb97-4694-4944-8c6a-bb54c6e01d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:24:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-40209234-bb69-4c68-b20f-32cf0a97e083 tempest-TestShelveInstance-181440490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0309c447-477d-41db-a788-7d2b7d6504e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:24:43 devstack cinder-volume[87095]: DEBUG cinder.image.glance [None req-40209234-bb69-4c68-b20f-32cf0a97e083 tempest-TestShelveInstance-181440490 None] Creating Keystone auth plugin from conf {{(pid=87095) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 04 12:24:43 devstack sudo[103042]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4c22a189-bab8-49ab-b827-a6787d7961e9 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f1a93baf-2ec8-4803-a0a2-e876c89073d7" returned: 0 in 0.276s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:43 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-4c22a189-bab8-49ab-b827-a6787d7961e9 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Lock "cinder-quobyte-f1a93baf-2ec8-4803-a0a2-e876c89073d7" released by "delete_volume" :: held 0.785s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:24:43 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-469dfcf7-6e8a-4b5f-8b09-6cb08fb1f16f tempest-VolumesTestJSON-1683843544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:24:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-469dfcf7-6e8a-4b5f-8b09-6cb08fb1f16f tempest-VolumesTestJSON-1683843544 None] Flow 'volume_create_manager' (02f2c6a4-0807-4d84-9648-4dc5eac65d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:24:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-469dfcf7-6e8a-4b5f-8b09-6cb08fb1f16f tempest-VolumesTestJSON-1683843544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53f4a59f-baa6-4078-8032-924a779ad041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:24:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-469dfcf7-6e8a-4b5f-8b09-6cb08fb1f16f tempest-VolumesTestJSON-1683843544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53f4a59f-baa6-4078-8032-924a779ad041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-321238182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b291e8ae-2112-467f-8a6d-c0810dbda33a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0f3c767dddc648b7815bf84835a327ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:24:44Z,use_quota=True,user_id='5ac5f672e7474d44a2f59268306d8704',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:24:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-469dfcf7-6e8a-4b5f-8b09-6cb08fb1f16f tempest-VolumesTestJSON-1683843544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca414e3e-ed95-403e-810a-2453bc16ceda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:24:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-469dfcf7-6e8a-4b5f-8b09-6cb08fb1f16f tempest-VolumesTestJSON-1683843544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca414e3e-ed95-403e-810a-2453bc16ceda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:24:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-469dfcf7-6e8a-4b5f-8b09-6cb08fb1f16f tempest-VolumesTestJSON-1683843544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1ce8fa8-229b-4547-b36e-a488388456ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:24:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-469dfcf7-6e8a-4b5f-8b09-6cb08fb1f16f tempest-VolumesTestJSON-1683843544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1ce8fa8-229b-4547-b36e-a488388456ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b291e8ae-2112-467f-8a6d-c0810dbda33a', 'volume_name': 'volume-b291e8ae-2112-467f-8a6d-c0810dbda33a', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:24:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-469dfcf7-6e8a-4b5f-8b09-6cb08fb1f16f tempest-VolumesTestJSON-1683843544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be32e3f3-357e-43ba-a369-b88c4c0cc954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:24:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-469dfcf7-6e8a-4b5f-8b09-6cb08fb1f16f tempest-VolumesTestJSON-1683843544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be32e3f3-357e-43ba-a369-b88c4c0cc954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:24:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-469dfcf7-6e8a-4b5f-8b09-6cb08fb1f16f tempest-VolumesTestJSON-1683843544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23dc2932-db0e-4f49-b735-27f099029649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:24:43 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-469dfcf7-6e8a-4b5f-8b09-6cb08fb1f16f tempest-VolumesTestJSON-1683843544 None] Volume b291e8ae-2112-467f-8a6d-c0810dbda33a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b291e8ae-2112-467f-8a6d-c0810dbda33a', 'volume_size': 1} Nov 04 12:24:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-469dfcf7-6e8a-4b5f-8b09-6cb08fb1f16f tempest-VolumesTestJSON-1683843544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:24:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-469dfcf7-6e8a-4b5f-8b09-6cb08fb1f16f tempest-VolumesTestJSON-1683843544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:24:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-469dfcf7-6e8a-4b5f-8b09-6cb08fb1f16f tempest-VolumesTestJSON-1683843544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-321238182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b291e8ae-2112-467f-8a6d-c0810dbda33a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0f3c767dddc648b7815bf84835a327ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:24:44Z,use_quota=True,user_id='5ac5f672e7474d44a2f59268306d8704',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:24:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-469dfcf7-6e8a-4b5f-8b09-6cb08fb1f16f tempest-VolumesTestJSON-1683843544 None] Creating volume b291e8ae-2112-467f-8a6d-c0810dbda33a {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:24:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-469dfcf7-6e8a-4b5f-8b09-6cb08fb1f16f tempest-VolumesTestJSON-1683843544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:24:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-469dfcf7-6e8a-4b5f-8b09-6cb08fb1f16f tempest-VolumesTestJSON-1683843544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:24:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-469dfcf7-6e8a-4b5f-8b09-6cb08fb1f16f tempest-VolumesTestJSON-1683843544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:24:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-469dfcf7-6e8a-4b5f-8b09-6cb08fb1f16f tempest-VolumesTestJSON-1683843544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:24:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-469dfcf7-6e8a-4b5f-8b09-6cb08fb1f16f tempest-VolumesTestJSON-1683843544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:24:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-469dfcf7-6e8a-4b5f-8b09-6cb08fb1f16f tempest-VolumesTestJSON-1683843544 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:24:43 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-469dfcf7-6e8a-4b5f-8b09-6cb08fb1f16f tempest-VolumesTestJSON-1683843544 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:24:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-469dfcf7-6e8a-4b5f-8b09-6cb08fb1f16f tempest-VolumesTestJSON-1683843544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b291e8ae-2112-467f-8a6d-c0810dbda33a 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:43 devstack sudo[103045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b291e8ae-2112-467f-8a6d-c0810dbda33a 1073741824 Nov 04 12:24:43 devstack sudo[103045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:43 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-4c22a189-bab8-49ab-b827-a6787d7961e9 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Created reservations ['7097adcf-cfdf-4037-897c-d23ce9dc51a4', '1268ad92-b9e4-4846-9408-a7538b9b1ea5', '70db8e2f-c281-427c-9e23-e89e98a4efbf', 'b5bb56c9-667a-482f-8f45-c6a0548f6792'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:24:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4c22a189-bab8-49ab-b827-a6787d7961e9 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:24:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4c22a189-bab8-49ab-b827-a6787d7961e9 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:24:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4c22a189-bab8-49ab-b827-a6787d7961e9 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:24:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4c22a189-bab8-49ab-b827-a6787d7961e9 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:24:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4c22a189-bab8-49ab-b827-a6787d7961e9 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:24:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4c22a189-bab8-49ab-b827-a6787d7961e9 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:43 devstack sudo[103047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:24:43 devstack sudo[103047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-40209234-bb69-4c68-b20f-32cf0a97e083 tempest-TestShelveInstance-181440490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0309c447-477d-41db-a788-7d2b7d6504e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3657e41b-da17-451a-8749-edb5fed7bcd6', 'volume_name': 'volume-3657e41b-da17-451a-8749-edb5fed7bcd6', 'volume_size': 1, 'image_id': 'b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '021c36f8b23249aabf2d5e363bccb8bc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af', 'created_at': datetime.datetime(2026, 11, 4, 11, 4, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 11, 4, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:24:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-40209234-bb69-4c68-b20f-32cf0a97e083 tempest-TestShelveInstance-181440490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e664bf04-874b-4725-83eb-17d485504ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:24:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-40209234-bb69-4c68-b20f-32cf0a97e083 tempest-TestShelveInstance-181440490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e664bf04-874b-4725-83eb-17d485504ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:24:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-40209234-bb69-4c68-b20f-32cf0a97e083 tempest-TestShelveInstance-181440490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (723d9d2a-7f23-41af-9c26-edd7502c3575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:24:44 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-40209234-bb69-4c68-b20f-32cf0a97e083 tempest-TestShelveInstance-181440490 None] Volume 3657e41b-da17-451a-8749-edb5fed7bcd6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3657e41b-da17-451a-8749-edb5fed7bcd6', 'volume_size': 1, 'image_id': 'b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '021c36f8b23249aabf2d5e363bccb8bc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af', 'created_at': datetime.datetime(2026, 11, 4, 11, 4, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 11, 4, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 04 12:24:44 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-40209234-bb69-4c68-b20f-32cf0a97e083 tempest-TestShelveInstance-181440490 None] Trying to clone 3657e41b-da17-451a-8749-edb5fed7bcd6 from image b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af at location (None, [{'url': 'file:///opt/stack/data/glance/images/b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af', 'metadata': {}}]). {{(pid=87095) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 04 12:24:44 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6ca18de5-26f1-4a00-8b73-f50cea3c0f1e tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Acquiring lock "cinder-3eb6d98b-596d-40fc-ac01-6454f00de4e6-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:24:44 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6ca18de5-26f1-4a00-8b73-f50cea3c0f1e tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Lock "cinder-3eb6d98b-596d-40fc-ac01-6454f00de4e6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:24:44 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6ca18de5-26f1-4a00-8b73-f50cea3c0f1e tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Acquiring lock "cinder-quobyte-3eb6d98b-596d-40fc-ac01-6454f00de4e6" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:24:44 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6ca18de5-26f1-4a00-8b73-f50cea3c0f1e tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Lock "cinder-quobyte-3eb6d98b-596d-40fc-ac01-6454f00de4e6" acquired by "delete_volume" :: waited 0.016s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:24:44 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[649f908c-22fc-4397-859c-6d58c4c61018]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:24:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6ca18de5-26f1-4a00-8b73-f50cea3c0f1e tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-3eb6d98b-596d-40fc-ac01-6454f00de4e6 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:44 devstack sudo[103047]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4c22a189-bab8-49ab-b827-a6787d7961e9 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.341s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:44 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-4c22a189-bab8-49ab-b827-a6787d7961e9 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:24:44 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-4c22a189-bab8-49ab-b827-a6787d7961e9 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Deleted volume successfully. Nov 04 12:24:44 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-4c22a189-bab8-49ab-b827-a6787d7961e9 tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Lock "cinder-f1a93baf-2ec8-4803-a0a2-e876c89073d7-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:24:44 devstack sudo[103053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-3eb6d98b-596d-40fc-ac01-6454f00de4e6 Nov 04 12:24:44 devstack sudo[103053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:44 devstack sudo[103045]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-469dfcf7-6e8a-4b5f-8b09-6cb08fb1f16f tempest-VolumesTestJSON-1683843544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b291e8ae-2112-467f-8a6d-c0810dbda33a 1073741824" returned: 0 in 0.633s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-469dfcf7-6e8a-4b5f-8b09-6cb08fb1f16f tempest-VolumesTestJSON-1683843544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b291e8ae-2112-467f-8a6d-c0810dbda33a {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:44 devstack sudo[103056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b291e8ae-2112-467f-8a6d-c0810dbda33a Nov 04 12:24:44 devstack sudo[103056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:44 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-40209234-bb69-4c68-b20f-32cf0a97e083 tempest-TestShelveInstance-181440490 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_vpcmsg2ldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87095) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 04 12:24:44 devstack cinder-volume[87095]: INFO cinder.image.image_utils [None req-40209234-bb69-4c68-b20f-32cf0a97e083 tempest-TestShelveInstance-181440490 None] Image download 20.69 MB at 20.69 MB/s Nov 04 12:24:44 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa811777-d3a0-47d6-9d0d-364e36426448]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:24:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-40209234-bb69-4c68-b20f-32cf0a97e083 tempest-TestShelveInstance-181440490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_vpcmsg2ldevstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:44 devstack sudo[103053]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6ca18de5-26f1-4a00-8b73-f50cea3c0f1e tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-3eb6d98b-596d-40fc-ac01-6454f00de4e6" returned: 0 in 0.534s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6ca18de5-26f1-4a00-8b73-f50cea3c0f1e tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-3eb6d98b-596d-40fc-ac01-6454f00de4e6 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:44 devstack sudo[103058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_vpcmsg2ldevstack@QuobyteHD Nov 04 12:24:44 devstack sudo[103058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:44 devstack sudo[103063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-3eb6d98b-596d-40fc-ac01-6454f00de4e6 Nov 04 12:24:44 devstack sudo[103063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:44 devstack sudo[103056]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-469dfcf7-6e8a-4b5f-8b09-6cb08fb1f16f tempest-VolumesTestJSON-1683843544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b291e8ae-2112-467f-8a6d-c0810dbda33a" returned: 0 in 0.302s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:44 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-469dfcf7-6e8a-4b5f-8b09-6cb08fb1f16f tempest-VolumesTestJSON-1683843544 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:24:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-469dfcf7-6e8a-4b5f-8b09-6cb08fb1f16f tempest-VolumesTestJSON-1683843544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:24:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-469dfcf7-6e8a-4b5f-8b09-6cb08fb1f16f tempest-VolumesTestJSON-1683843544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23dc2932-db0e-4f49-b735-27f099029649) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b291e8ae-2112-467f-8a6d-c0810dbda33a', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:24:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-469dfcf7-6e8a-4b5f-8b09-6cb08fb1f16f tempest-VolumesTestJSON-1683843544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a74d16ff-be1b-40e9-94a6-483c7a593b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:24:44 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-469dfcf7-6e8a-4b5f-8b09-6cb08fb1f16f tempest-VolumesTestJSON-1683843544 None] Volume volume-b291e8ae-2112-467f-8a6d-c0810dbda33a (b291e8ae-2112-467f-8a6d-c0810dbda33a): created successfully Nov 04 12:24:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-469dfcf7-6e8a-4b5f-8b09-6cb08fb1f16f tempest-VolumesTestJSON-1683843544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a74d16ff-be1b-40e9-94a6-483c7a593b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:24:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-469dfcf7-6e8a-4b5f-8b09-6cb08fb1f16f tempest-VolumesTestJSON-1683843544 None] Flow 'volume_create_manager' (02f2c6a4-0807-4d84-9648-4dc5eac65d80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:24:44 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-469dfcf7-6e8a-4b5f-8b09-6cb08fb1f16f tempest-VolumesTestJSON-1683843544 None] Created volume successfully. Nov 04 12:24:44 devstack sudo[103058]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-40209234-bb69-4c68-b20f-32cf0a97e083 tempest-TestShelveInstance-181440490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_vpcmsg2ldevstack@QuobyteHD" returned: 0 in 0.340s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:44 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-40209234-bb69-4c68-b20f-32cf0a97e083 tempest-TestShelveInstance-181440490 None] Temporary image b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af is fetched for user 231dca5ac71d467399968146a0f9ef53. {{(pid=87095) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 04 12:24:44 devstack sudo[103063]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6ca18de5-26f1-4a00-8b73-f50cea3c0f1e tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-3eb6d98b-596d-40fc-ac01-6454f00de4e6" returned: 0 in 0.278s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:45 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6ca18de5-26f1-4a00-8b73-f50cea3c0f1e tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Lock "cinder-quobyte-3eb6d98b-596d-40fc-ac01-6454f00de4e6" released by "delete_volume" :: held 0.871s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:24:45 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f126647d-309d-431c-8e1d-3347d70cb95b]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:24:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-40209234-bb69-4c68-b20f-32cf0a97e083 tempest-TestShelveInstance-181440490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_vpcmsg2ldevstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:45 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-6ca18de5-26f1-4a00-8b73-f50cea3c0f1e tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Created reservations ['a68be86c-22ee-4977-b7ba-28ec6c78337b', 'ae8fdb57-83c3-4f09-8604-aebba1fed212', '1e95513a-688b-4f3c-ab75-8a647861097f', '2da58b10-d9bf-4a2e-9d53-878335d39c1a'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:24:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6ca18de5-26f1-4a00-8b73-f50cea3c0f1e tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:24:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6ca18de5-26f1-4a00-8b73-f50cea3c0f1e tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:24:45 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6ca18de5-26f1-4a00-8b73-f50cea3c0f1e tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:24:45 devstack sudo[103070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_vpcmsg2ldevstack@QuobyteHD Nov 04 12:24:45 devstack sudo[103070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:45 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6ca18de5-26f1-4a00-8b73-f50cea3c0f1e tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:24:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6ca18de5-26f1-4a00-8b73-f50cea3c0f1e tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:24:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6ca18de5-26f1-4a00-8b73-f50cea3c0f1e tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:45 devstack sudo[103072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:24:45 devstack sudo[103072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:45 devstack sudo[103070]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-40209234-bb69-4c68-b20f-32cf0a97e083 tempest-TestShelveInstance-181440490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_vpcmsg2ldevstack@QuobyteHD" returned: 0 in 0.343s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-40209234-bb69-4c68-b20f-32cf0a97e083 tempest-TestShelveInstance-181440490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:24:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-40209234-bb69-4c68-b20f-32cf0a97e083 tempest-TestShelveInstance-181440490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:24:45 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-40209234-bb69-4c68-b20f-32cf0a97e083 tempest-TestShelveInstance-181440490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-908551578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3657e41b-da17-451a-8749-edb5fed7bcd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='091d570d0fd74a0b8dccd422a13b8708',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:24:43Z,use_quota=True,user_id='231dca5ac71d467399968146a0f9ef53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:24:45 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-40209234-bb69-4c68-b20f-32cf0a97e083 tempest-TestShelveInstance-181440490 None] Creating volume 3657e41b-da17-451a-8749-edb5fed7bcd6 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:24:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-40209234-bb69-4c68-b20f-32cf0a97e083 tempest-TestShelveInstance-181440490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:24:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-40209234-bb69-4c68-b20f-32cf0a97e083 tempest-TestShelveInstance-181440490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:24:45 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-40209234-bb69-4c68-b20f-32cf0a97e083 tempest-TestShelveInstance-181440490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:24:45 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-40209234-bb69-4c68-b20f-32cf0a97e083 tempest-TestShelveInstance-181440490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:24:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-40209234-bb69-4c68-b20f-32cf0a97e083 tempest-TestShelveInstance-181440490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:24:45 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-40209234-bb69-4c68-b20f-32cf0a97e083 tempest-TestShelveInstance-181440490 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:24:45 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-40209234-bb69-4c68-b20f-32cf0a97e083 tempest-TestShelveInstance-181440490 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:24:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-40209234-bb69-4c68-b20f-32cf0a97e083 tempest-TestShelveInstance-181440490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-3657e41b-da17-451a-8749-edb5fed7bcd6 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:45 devstack sudo[103072]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:45 devstack sudo[103078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-3657e41b-da17-451a-8749-edb5fed7bcd6 1073741824 Nov 04 12:24:45 devstack sudo[103078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6ca18de5-26f1-4a00-8b73-f50cea3c0f1e tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.283s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:45 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-6ca18de5-26f1-4a00-8b73-f50cea3c0f1e tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:24:45 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-6ca18de5-26f1-4a00-8b73-f50cea3c0f1e tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Deleted volume successfully. Nov 04 12:24:45 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6ca18de5-26f1-4a00-8b73-f50cea3c0f1e tempest-CreateVolumesFromSourceVolumeTest-1807281490 None] Lock "cinder-3eb6d98b-596d-40fc-ac01-6454f00de4e6-delete_volume" released by "delete_volume" :: held 1.400s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:24:45 devstack sudo[103078]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-40209234-bb69-4c68-b20f-32cf0a97e083 tempest-TestShelveInstance-181440490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-3657e41b-da17-451a-8749-edb5fed7bcd6 1073741824" returned: 0 in 0.489s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-40209234-bb69-4c68-b20f-32cf0a97e083 tempest-TestShelveInstance-181440490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-3657e41b-da17-451a-8749-edb5fed7bcd6 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:45 devstack sudo[103084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-3657e41b-da17-451a-8749-edb5fed7bcd6 Nov 04 12:24:45 devstack sudo[103084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:46 devstack sudo[103084]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-40209234-bb69-4c68-b20f-32cf0a97e083 tempest-TestShelveInstance-181440490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-3657e41b-da17-451a-8749-edb5fed7bcd6" returned: 0 in 0.326s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:46 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-40209234-bb69-4c68-b20f-32cf0a97e083 tempest-TestShelveInstance-181440490 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:24:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-40209234-bb69-4c68-b20f-32cf0a97e083 tempest-TestShelveInstance-181440490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:24:46 devstack cinder-volume[87095]: DEBUG cinder.volume.volume_utils [None req-40209234-bb69-4c68-b20f-32cf0a97e083 tempest-TestShelveInstance-181440490 None] Attempting download of b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af ((None, [{'url': 'file:///opt/stack/data/glance/images/b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af', 'metadata': {}}])) to volume 3657e41b-da17-451a-8749-edb5fed7bcd6. {{(pid=87095) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 04 12:24:46 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b26103a-e3a7-4133-90de-281f89315bc1]: (4, 'raw') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:24:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-40209234-bb69-4c68-b20f-32cf0a97e083 tempest-TestShelveInstance-181440490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_dofq3fzx {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:46 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea6cf09f-0712-4c5c-888c-6855fc573feb tempest-VolumesTestJSON-1683843544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:24:46 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ea6cf09f-0712-4c5c-888c-6855fc573feb tempest-VolumesTestJSON-1683843544 None] Flow 'volume_create_manager' (f5232636-c29c-44d0-9efa-a59eff2006c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:24:46 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ea6cf09f-0712-4c5c-888c-6855fc573feb tempest-VolumesTestJSON-1683843544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3042ec19-effc-47b3-bf1c-544be4113417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:24:46 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ea6cf09f-0712-4c5c-888c-6855fc573feb tempest-VolumesTestJSON-1683843544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3042ec19-effc-47b3-bf1c-544be4113417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:24:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1211343526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee680f81-5991-416f-9fb4-54aaa1d4fa56,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0f3c767dddc648b7815bf84835a327ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:24:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:24:46Z,use_quota=True,user_id='5ac5f672e7474d44a2f59268306d8704',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:24:46 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ea6cf09f-0712-4c5c-888c-6855fc573feb tempest-VolumesTestJSON-1683843544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34ef4325-0ff0-4c5d-bde8-4ca4822ec633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:24:46 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ea6cf09f-0712-4c5c-888c-6855fc573feb tempest-VolumesTestJSON-1683843544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34ef4325-0ff0-4c5d-bde8-4ca4822ec633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:24:46 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ea6cf09f-0712-4c5c-888c-6855fc573feb tempest-VolumesTestJSON-1683843544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c64c4fc-4b7b-4e5f-9b07-ec4b835070cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:24:46 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ea6cf09f-0712-4c5c-888c-6855fc573feb tempest-VolumesTestJSON-1683843544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c64c4fc-4b7b-4e5f-9b07-ec4b835070cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee680f81-5991-416f-9fb4-54aaa1d4fa56', 'volume_name': 'volume-ee680f81-5991-416f-9fb4-54aaa1d4fa56', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:24:46 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ea6cf09f-0712-4c5c-888c-6855fc573feb tempest-VolumesTestJSON-1683843544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9bd6ef0-e794-4825-89b6-9c63a7c1ed2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:24:46 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ea6cf09f-0712-4c5c-888c-6855fc573feb tempest-VolumesTestJSON-1683843544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9bd6ef0-e794-4825-89b6-9c63a7c1ed2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:24:46 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ea6cf09f-0712-4c5c-888c-6855fc573feb tempest-VolumesTestJSON-1683843544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f509478b-0bdf-40c6-bafe-c2285deac0cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:24:46 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-ea6cf09f-0712-4c5c-888c-6855fc573feb tempest-VolumesTestJSON-1683843544 None] Volume ee680f81-5991-416f-9fb4-54aaa1d4fa56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee680f81-5991-416f-9fb4-54aaa1d4fa56', 'volume_size': 1} Nov 04 12:24:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ea6cf09f-0712-4c5c-888c-6855fc573feb tempest-VolumesTestJSON-1683843544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:24:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ea6cf09f-0712-4c5c-888c-6855fc573feb tempest-VolumesTestJSON-1683843544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:24:46 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ea6cf09f-0712-4c5c-888c-6855fc573feb tempest-VolumesTestJSON-1683843544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:24:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1211343526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee680f81-5991-416f-9fb4-54aaa1d4fa56,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0f3c767dddc648b7815bf84835a327ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:24:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:24:46Z,use_quota=True,user_id='5ac5f672e7474d44a2f59268306d8704',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:24:46 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-ea6cf09f-0712-4c5c-888c-6855fc573feb tempest-VolumesTestJSON-1683843544 None] Creating volume ee680f81-5991-416f-9fb4-54aaa1d4fa56 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:24:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ea6cf09f-0712-4c5c-888c-6855fc573feb tempest-VolumesTestJSON-1683843544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:24:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ea6cf09f-0712-4c5c-888c-6855fc573feb tempest-VolumesTestJSON-1683843544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:24:46 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ea6cf09f-0712-4c5c-888c-6855fc573feb tempest-VolumesTestJSON-1683843544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:24:46 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ea6cf09f-0712-4c5c-888c-6855fc573feb tempest-VolumesTestJSON-1683843544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:24:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ea6cf09f-0712-4c5c-888c-6855fc573feb tempest-VolumesTestJSON-1683843544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:24:46 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ea6cf09f-0712-4c5c-888c-6855fc573feb tempest-VolumesTestJSON-1683843544 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:24:46 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-ea6cf09f-0712-4c5c-888c-6855fc573feb tempest-VolumesTestJSON-1683843544 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:24:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ea6cf09f-0712-4c5c-888c-6855fc573feb tempest-VolumesTestJSON-1683843544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee680f81-5991-416f-9fb4-54aaa1d4fa56 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:46 devstack sudo[103087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_dofq3fzx Nov 04 12:24:46 devstack sudo[103087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:46 devstack sudo[103088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee680f81-5991-416f-9fb4-54aaa1d4fa56 1073741824 Nov 04 12:24:46 devstack sudo[103088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:46 devstack sudo[103087]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-40209234-bb69-4c68-b20f-32cf0a97e083 tempest-TestShelveInstance-181440490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_dofq3fzx" returned: 0 in 0.416s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-40209234-bb69-4c68-b20f-32cf0a97e083 tempest-TestShelveInstance-181440490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_dofq3fzx {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:46 devstack sudo[103096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_dofq3fzx Nov 04 12:24:46 devstack sudo[103096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:46 devstack sudo[103088]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ea6cf09f-0712-4c5c-888c-6855fc573feb tempest-VolumesTestJSON-1683843544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee680f81-5991-416f-9fb4-54aaa1d4fa56 1073741824" returned: 0 in 0.542s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ea6cf09f-0712-4c5c-888c-6855fc573feb tempest-VolumesTestJSON-1683843544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee680f81-5991-416f-9fb4-54aaa1d4fa56 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:47 devstack sudo[103099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee680f81-5991-416f-9fb4-54aaa1d4fa56 Nov 04 12:24:47 devstack sudo[103099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:47 devstack sudo[103096]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-40209234-bb69-4c68-b20f-32cf0a97e083 tempest-TestShelveInstance-181440490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_dofq3fzx" returned: 1 in 0.344s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-40209234-bb69-4c68-b20f-32cf0a97e083 tempest-TestShelveInstance-181440490 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_dofq3fzx' failed. Not Retrying. {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 12:24:47 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a251c8dd-4b68-468e-8699-e5cd28d3d1da]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:24:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-40209234-bb69-4c68-b20f-32cf0a97e083 tempest-TestShelveInstance-181440490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_vpcmsg2ldevstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:47 devstack sudo[103103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_vpcmsg2ldevstack@QuobyteHD Nov 04 12:24:47 devstack sudo[103103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:47 devstack sudo[103099]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ea6cf09f-0712-4c5c-888c-6855fc573feb tempest-VolumesTestJSON-1683843544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee680f81-5991-416f-9fb4-54aaa1d4fa56" returned: 0 in 0.286s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:47 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ea6cf09f-0712-4c5c-888c-6855fc573feb tempest-VolumesTestJSON-1683843544 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:24:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ea6cf09f-0712-4c5c-888c-6855fc573feb tempest-VolumesTestJSON-1683843544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:24:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ea6cf09f-0712-4c5c-888c-6855fc573feb tempest-VolumesTestJSON-1683843544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f509478b-0bdf-40c6-bafe-c2285deac0cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee680f81-5991-416f-9fb4-54aaa1d4fa56', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:24:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ea6cf09f-0712-4c5c-888c-6855fc573feb tempest-VolumesTestJSON-1683843544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e244c074-7e32-4d0f-8a8e-ff4c58a7dbf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:24:47 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-ea6cf09f-0712-4c5c-888c-6855fc573feb tempest-VolumesTestJSON-1683843544 None] Volume volume-ee680f81-5991-416f-9fb4-54aaa1d4fa56 (ee680f81-5991-416f-9fb4-54aaa1d4fa56): created successfully Nov 04 12:24:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ea6cf09f-0712-4c5c-888c-6855fc573feb tempest-VolumesTestJSON-1683843544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e244c074-7e32-4d0f-8a8e-ff4c58a7dbf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:24:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ea6cf09f-0712-4c5c-888c-6855fc573feb tempest-VolumesTestJSON-1683843544 None] Flow 'volume_create_manager' (f5232636-c29c-44d0-9efa-a59eff2006c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:24:47 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-ea6cf09f-0712-4c5c-888c-6855fc573feb tempest-VolumesTestJSON-1683843544 None] Created volume successfully. Nov 04 12:24:47 devstack sudo[103103]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-40209234-bb69-4c68-b20f-32cf0a97e083 tempest-TestShelveInstance-181440490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_vpcmsg2ldevstack@QuobyteHD" returned: 0 in 0.379s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:47 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-40209234-bb69-4c68-b20f-32cf0a97e083 tempest-TestShelveInstance-181440490 None] b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af was qcow2, converting to qcow2 {{(pid=87095) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 04 12:24:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-40209234-bb69-4c68-b20f-32cf0a97e083 tempest-TestShelveInstance-181440490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_vpcmsg2ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-3657e41b-da17-451a-8749-edb5fed7bcd6 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:47 devstack sudo[103109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_vpcmsg2ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-3657e41b-da17-451a-8749-edb5fed7bcd6 Nov 04 12:24:47 devstack sudo[103109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:48 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-fee8e1c7-d92f-499c-b035-05025672d8a8 tempest-VolumeDependencyTests-1649406245 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:24:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-fee8e1c7-d92f-499c-b035-05025672d8a8 tempest-VolumeDependencyTests-1649406245 None] Flow 'volume_create_manager' (c607ba08-21ce-4af6-a6fc-88e8d011dd48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:24:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-fee8e1c7-d92f-499c-b035-05025672d8a8 tempest-VolumeDependencyTests-1649406245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14b36a8c-37b4-45b4-bab5-f775e6836d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:24:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-fee8e1c7-d92f-499c-b035-05025672d8a8 tempest-VolumeDependencyTests-1649406245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14b36a8c-37b4-45b4-bab5-f775e6836d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:24:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2050672636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad72e00f-2a0f-42de-9570-d3c6d8a87869,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e1f79b9715b45b49bbb0a5c13a423cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:24:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:24:49Z,use_quota=True,user_id='037643911c1e400cad720c7ceb24a380',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:24:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-fee8e1c7-d92f-499c-b035-05025672d8a8 tempest-VolumeDependencyTests-1649406245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fe71003-7b21-4c76-92b4-3f15bc63347e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:24:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-fee8e1c7-d92f-499c-b035-05025672d8a8 tempest-VolumeDependencyTests-1649406245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fe71003-7b21-4c76-92b4-3f15bc63347e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:24:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-fee8e1c7-d92f-499c-b035-05025672d8a8 tempest-VolumeDependencyTests-1649406245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d396c5e7-960a-455d-b645-151a7af6d3f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:24:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-fee8e1c7-d92f-499c-b035-05025672d8a8 tempest-VolumeDependencyTests-1649406245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d396c5e7-960a-455d-b645-151a7af6d3f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad72e00f-2a0f-42de-9570-d3c6d8a87869', 'volume_name': 'volume-ad72e00f-2a0f-42de-9570-d3c6d8a87869', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:24:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-fee8e1c7-d92f-499c-b035-05025672d8a8 tempest-VolumeDependencyTests-1649406245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9cd5264-fe9f-4d42-8f36-bc3b9e0d816d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:24:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-fee8e1c7-d92f-499c-b035-05025672d8a8 tempest-VolumeDependencyTests-1649406245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9cd5264-fe9f-4d42-8f36-bc3b9e0d816d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:24:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-fee8e1c7-d92f-499c-b035-05025672d8a8 tempest-VolumeDependencyTests-1649406245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87e44194-ad8b-4d63-ac19-6b92f387568d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:24:48 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-fee8e1c7-d92f-499c-b035-05025672d8a8 tempest-VolumeDependencyTests-1649406245 None] Volume ad72e00f-2a0f-42de-9570-d3c6d8a87869: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad72e00f-2a0f-42de-9570-d3c6d8a87869', 'volume_size': 1} Nov 04 12:24:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-fee8e1c7-d92f-499c-b035-05025672d8a8 tempest-VolumeDependencyTests-1649406245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:24:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-fee8e1c7-d92f-499c-b035-05025672d8a8 tempest-VolumeDependencyTests-1649406245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:24:48 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-fee8e1c7-d92f-499c-b035-05025672d8a8 tempest-VolumeDependencyTests-1649406245 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:24:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2050672636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad72e00f-2a0f-42de-9570-d3c6d8a87869,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e1f79b9715b45b49bbb0a5c13a423cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:24:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:24:49Z,use_quota=True,user_id='037643911c1e400cad720c7ceb24a380',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:24:48 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-fee8e1c7-d92f-499c-b035-05025672d8a8 tempest-VolumeDependencyTests-1649406245 None] Creating volume ad72e00f-2a0f-42de-9570-d3c6d8a87869 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:24:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-fee8e1c7-d92f-499c-b035-05025672d8a8 tempest-VolumeDependencyTests-1649406245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:24:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-fee8e1c7-d92f-499c-b035-05025672d8a8 tempest-VolumeDependencyTests-1649406245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:24:48 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-fee8e1c7-d92f-499c-b035-05025672d8a8 tempest-VolumeDependencyTests-1649406245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:24:48 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-fee8e1c7-d92f-499c-b035-05025672d8a8 tempest-VolumeDependencyTests-1649406245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:24:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-fee8e1c7-d92f-499c-b035-05025672d8a8 tempest-VolumeDependencyTests-1649406245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:24:48 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-fee8e1c7-d92f-499c-b035-05025672d8a8 tempest-VolumeDependencyTests-1649406245 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:24:48 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-fee8e1c7-d92f-499c-b035-05025672d8a8 tempest-VolumeDependencyTests-1649406245 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:24:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fee8e1c7-d92f-499c-b035-05025672d8a8 tempest-VolumeDependencyTests-1649406245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ad72e00f-2a0f-42de-9570-d3c6d8a87869 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:48 devstack sudo[103120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ad72e00f-2a0f-42de-9570-d3c6d8a87869 1073741824 Nov 04 12:24:48 devstack sudo[103120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:49 devstack sudo[103120]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fee8e1c7-d92f-499c-b035-05025672d8a8 tempest-VolumeDependencyTests-1649406245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ad72e00f-2a0f-42de-9570-d3c6d8a87869 1073741824" returned: 0 in 0.544s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fee8e1c7-d92f-499c-b035-05025672d8a8 tempest-VolumeDependencyTests-1649406245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ad72e00f-2a0f-42de-9570-d3c6d8a87869 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:49 devstack sudo[103126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ad72e00f-2a0f-42de-9570-d3c6d8a87869 Nov 04 12:24:49 devstack sudo[103126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:49 devstack sudo[103126]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fee8e1c7-d92f-499c-b035-05025672d8a8 tempest-VolumeDependencyTests-1649406245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ad72e00f-2a0f-42de-9570-d3c6d8a87869" returned: 0 in 0.346s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:49 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-fee8e1c7-d92f-499c-b035-05025672d8a8 tempest-VolumeDependencyTests-1649406245 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:24:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-fee8e1c7-d92f-499c-b035-05025672d8a8 tempest-VolumeDependencyTests-1649406245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:24:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-fee8e1c7-d92f-499c-b035-05025672d8a8 tempest-VolumeDependencyTests-1649406245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87e44194-ad8b-4d63-ac19-6b92f387568d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad72e00f-2a0f-42de-9570-d3c6d8a87869', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:24:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-fee8e1c7-d92f-499c-b035-05025672d8a8 tempest-VolumeDependencyTests-1649406245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1400903f-a155-45be-b981-e6ff3a7e5e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:24:49 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c87c4e5c-b36c-4cb7-a76b-ef77bcda8310 tempest-VolumesTestJSON-1683843544 None] Acquiring lock "cinder-ee680f81-5991-416f-9fb4-54aaa1d4fa56-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:24:49 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-fee8e1c7-d92f-499c-b035-05025672d8a8 tempest-VolumeDependencyTests-1649406245 None] Volume volume-ad72e00f-2a0f-42de-9570-d3c6d8a87869 (ad72e00f-2a0f-42de-9570-d3c6d8a87869): created successfully Nov 04 12:24:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-fee8e1c7-d92f-499c-b035-05025672d8a8 tempest-VolumeDependencyTests-1649406245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1400903f-a155-45be-b981-e6ff3a7e5e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:24:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-fee8e1c7-d92f-499c-b035-05025672d8a8 tempest-VolumeDependencyTests-1649406245 None] Flow 'volume_create_manager' (c607ba08-21ce-4af6-a6fc-88e8d011dd48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:24:49 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c87c4e5c-b36c-4cb7-a76b-ef77bcda8310 tempest-VolumesTestJSON-1683843544 None] Lock "cinder-ee680f81-5991-416f-9fb4-54aaa1d4fa56-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:24:49 devstack sudo[103109]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-40209234-bb69-4c68-b20f-32cf0a97e083 tempest-TestShelveInstance-181440490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_vpcmsg2ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-3657e41b-da17-451a-8749-edb5fed7bcd6" returned: 0 in 2.237s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:49 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-40209234-bb69-4c68-b20f-32cf0a97e083 tempest-TestShelveInstance-181440490 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af_vpcmsg2ldevstack@QuobyteHD, size 112.00 MB, duration 2.24 sec, destination /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-3657e41b-da17-451a-8749-edb5fed7bcd6 {{(pid=87095) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 12:24:49 devstack cinder-volume[87095]: INFO cinder.image.image_utils [None req-40209234-bb69-4c68-b20f-32cf0a97e083 tempest-TestShelveInstance-181440490 None] Converted 112.00 MB image at 50.03 MB/s Nov 04 12:24:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-40209234-bb69-4c68-b20f-32cf0a97e083 tempest-TestShelveInstance-181440490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-3657e41b-da17-451a-8749-edb5fed7bcd6 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:49 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-fee8e1c7-d92f-499c-b035-05025672d8a8 tempest-VolumeDependencyTests-1649406245 None] Created volume successfully. Nov 04 12:24:49 devstack sudo[103129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-3657e41b-da17-451a-8749-edb5fed7bcd6 1G Nov 04 12:24:49 devstack sudo[103129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:49 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c87c4e5c-b36c-4cb7-a76b-ef77bcda8310 tempest-VolumesTestJSON-1683843544 None] Acquiring lock "cinder-quobyte-ee680f81-5991-416f-9fb4-54aaa1d4fa56" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:24:49 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c87c4e5c-b36c-4cb7-a76b-ef77bcda8310 tempest-VolumesTestJSON-1683843544 None] Lock "cinder-quobyte-ee680f81-5991-416f-9fb4-54aaa1d4fa56" acquired by "delete_volume" :: waited 0.019s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:24:49 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2dde9c2-4022-4f6d-bfe6-18b8165a8c7b]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:24:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c87c4e5c-b36c-4cb7-a76b-ef77bcda8310 tempest-VolumesTestJSON-1683843544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee680f81-5991-416f-9fb4-54aaa1d4fa56 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:49 devstack sudo[103131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee680f81-5991-416f-9fb4-54aaa1d4fa56 Nov 04 12:24:49 devstack sudo[103131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:50 devstack sudo[103129]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-40209234-bb69-4c68-b20f-32cf0a97e083 tempest-TestShelveInstance-181440490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-3657e41b-da17-451a-8749-edb5fed7bcd6 1G" returned: 0 in 0.328s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:50 devstack cinder-volume[87095]: DEBUG cinder.volume.volume_utils [None req-40209234-bb69-4c68-b20f-32cf0a97e083 tempest-TestShelveInstance-181440490 None] Downloaded image b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af ((None, [{'url': 'file:///opt/stack/data/glance/images/b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af', 'metadata': {}}])) to volume 3657e41b-da17-451a-8749-edb5fed7bcd6 successfully. {{(pid=87095) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 04 12:24:50 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-40209234-bb69-4c68-b20f-32cf0a97e083 tempest-TestShelveInstance-181440490 None] Temporary image b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af for user 231dca5ac71d467399968146a0f9ef53 is deleted. {{(pid=87095) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 04 12:24:50 devstack cinder-volume[87095]: DEBUG cinder.volume.volume_utils [None req-40209234-bb69-4c68-b20f-32cf0a97e083 tempest-TestShelveInstance-181440490 None] Marking volume 3657e41b-da17-451a-8749-edb5fed7bcd6 as bootable. {{(pid=87095) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 04 12:24:50 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-40209234-bb69-4c68-b20f-32cf0a97e083 tempest-TestShelveInstance-181440490 None] Copying metadata from image b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af to 3657e41b-da17-451a-8749-edb5fed7bcd6. {{(pid=87095) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 04 12:24:50 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-40209234-bb69-4c68-b20f-32cf0a97e083 tempest-TestShelveInstance-181440490 None] Creating volume glance metadata for volume 3657e41b-da17-451a-8749-edb5fed7bcd6 backed by image b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87095) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 04 12:24:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-40209234-bb69-4c68-b20f-32cf0a97e083 tempest-TestShelveInstance-181440490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (723d9d2a-7f23-41af-9c26-edd7502c3575) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3657e41b-da17-451a-8749-edb5fed7bcd6', 'volume_size': 1, 'image_id': 'b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '021c36f8b23249aabf2d5e363bccb8bc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af', 'created_at': datetime.datetime(2026, 11, 4, 11, 4, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 11, 4, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b0fdddae-6d2f-4f2c-8b8e-f7926f63d1af/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:24:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-40209234-bb69-4c68-b20f-32cf0a97e083 tempest-TestShelveInstance-181440490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a05513b6-827b-40cd-9980-57ebd1a6b395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:24:50 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-40209234-bb69-4c68-b20f-32cf0a97e083 tempest-TestShelveInstance-181440490 None] Volume volume-3657e41b-da17-451a-8749-edb5fed7bcd6 (3657e41b-da17-451a-8749-edb5fed7bcd6): created successfully Nov 04 12:24:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-40209234-bb69-4c68-b20f-32cf0a97e083 tempest-TestShelveInstance-181440490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a05513b6-827b-40cd-9980-57ebd1a6b395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:24:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-40209234-bb69-4c68-b20f-32cf0a97e083 tempest-TestShelveInstance-181440490 None] Flow 'volume_create_manager' (096f8055-14c3-4771-9262-ff90e0f3c101) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:24:50 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-40209234-bb69-4c68-b20f-32cf0a97e083 tempest-TestShelveInstance-181440490 None] Created volume successfully. Nov 04 12:24:50 devstack sudo[103131]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c87c4e5c-b36c-4cb7-a76b-ef77bcda8310 tempest-VolumesTestJSON-1683843544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee680f81-5991-416f-9fb4-54aaa1d4fa56" returned: 0 in 0.389s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c87c4e5c-b36c-4cb7-a76b-ef77bcda8310 tempest-VolumesTestJSON-1683843544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee680f81-5991-416f-9fb4-54aaa1d4fa56 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:50 devstack sudo[103140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee680f81-5991-416f-9fb4-54aaa1d4fa56 Nov 04 12:24:50 devstack sudo[103140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:50 devstack sudo[103140]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c87c4e5c-b36c-4cb7-a76b-ef77bcda8310 tempest-VolumesTestJSON-1683843544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee680f81-5991-416f-9fb4-54aaa1d4fa56" returned: 0 in 0.239s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:50 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c87c4e5c-b36c-4cb7-a76b-ef77bcda8310 tempest-VolumesTestJSON-1683843544 None] Lock "cinder-quobyte-ee680f81-5991-416f-9fb4-54aaa1d4fa56" released by "delete_volume" :: held 0.671s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:24:50 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-c87c4e5c-b36c-4cb7-a76b-ef77bcda8310 tempest-VolumesTestJSON-1683843544 None] Created reservations ['157c1b58-8d43-4f66-972c-95ecfcfbb15e', 'ca2087a3-025d-4b70-8043-a58687a99a70', 'fa8c9607-2e2b-4f41-a49c-e092aa0c7d1c', 'c741d610-e244-4a1d-ba9b-634fecfc3912'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:24:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c87c4e5c-b36c-4cb7-a76b-ef77bcda8310 tempest-VolumesTestJSON-1683843544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:24:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c87c4e5c-b36c-4cb7-a76b-ef77bcda8310 tempest-VolumesTestJSON-1683843544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:24:50 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c87c4e5c-b36c-4cb7-a76b-ef77bcda8310 tempest-VolumesTestJSON-1683843544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:24:50 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c87c4e5c-b36c-4cb7-a76b-ef77bcda8310 tempest-VolumesTestJSON-1683843544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:24:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c87c4e5c-b36c-4cb7-a76b-ef77bcda8310 tempest-VolumesTestJSON-1683843544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:24:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c87c4e5c-b36c-4cb7-a76b-ef77bcda8310 tempest-VolumesTestJSON-1683843544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:50 devstack sudo[103143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:24:50 devstack sudo[103143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-647ed050-b311-401e-bb6c-760b92c7a986 tempest-VolumeDependencyTests-1649406245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:24:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-647ed050-b311-401e-bb6c-760b92c7a986 tempest-VolumeDependencyTests-1649406245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:24:50 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-647ed050-b311-401e-bb6c-760b92c7a986 tempest-VolumeDependencyTests-1649406245 None] Creating offline snapshot dd36466f-0da0-4410-a9b2-9a3887a56ee8 of volume ad72e00f-2a0f-42de-9570-d3c6d8a87869 {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 12:24:50 devstack sudo[103143]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c87c4e5c-b36c-4cb7-a76b-ef77bcda8310 tempest-VolumesTestJSON-1683843544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.286s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:50 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-c87c4e5c-b36c-4cb7-a76b-ef77bcda8310 tempest-VolumesTestJSON-1683843544 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:24:50 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-c87c4e5c-b36c-4cb7-a76b-ef77bcda8310 tempest-VolumesTestJSON-1683843544 None] Deleted volume successfully. Nov 04 12:24:50 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-8c4676a8-41ff-475a-a55f-4d20928cae12 tempest-VolumesTestJSON-1683843544 None] Acquiring lock "cinder-b291e8ae-2112-467f-8a6d-c0810dbda33a-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:24:50 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8465a21-fd65-4554-be96-afbf159431bc]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:24:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-647ed050-b311-401e-bb6c-760b92c7a986 tempest-VolumeDependencyTests-1649406245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ad72e00f-2a0f-42de-9570-d3c6d8a87869 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:50 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c87c4e5c-b36c-4cb7-a76b-ef77bcda8310 tempest-VolumesTestJSON-1683843544 None] Lock "cinder-ee680f81-5991-416f-9fb4-54aaa1d4fa56-delete_volume" released by "delete_volume" :: held 1.218s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:24:50 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-8c4676a8-41ff-475a-a55f-4d20928cae12 tempest-VolumesTestJSON-1683843544 None] Lock "cinder-b291e8ae-2112-467f-8a6d-c0810dbda33a-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:24:50 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-8c4676a8-41ff-475a-a55f-4d20928cae12 tempest-VolumesTestJSON-1683843544 None] Acquiring lock "cinder-quobyte-b291e8ae-2112-467f-8a6d-c0810dbda33a" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:24:50 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-8c4676a8-41ff-475a-a55f-4d20928cae12 tempest-VolumesTestJSON-1683843544 None] Lock "cinder-quobyte-b291e8ae-2112-467f-8a6d-c0810dbda33a" acquired by "delete_volume" :: waited 0.016s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:24:51 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5d5825-409c-448d-ac2f-e0b40388e625]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:24:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8c4676a8-41ff-475a-a55f-4d20928cae12 tempest-VolumesTestJSON-1683843544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b291e8ae-2112-467f-8a6d-c0810dbda33a {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:51 devstack sudo[103146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ad72e00f-2a0f-42de-9570-d3c6d8a87869 Nov 04 12:24:51 devstack sudo[103146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:51 devstack sudo[103147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b291e8ae-2112-467f-8a6d-c0810dbda33a Nov 04 12:24:51 devstack sudo[103147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:51 devstack sudo[103146]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-647ed050-b311-401e-bb6c-760b92c7a986 tempest-VolumeDependencyTests-1649406245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ad72e00f-2a0f-42de-9570-d3c6d8a87869" returned: 0 in 0.432s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-647ed050-b311-401e-bb6c-760b92c7a986 tempest-VolumeDependencyTests-1649406245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ad72e00f-2a0f-42de-9570-d3c6d8a87869,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ad72e00f-2a0f-42de-9570-d3c6d8a87869.dd36466f-0da0-4410-a9b2-9a3887a56ee8 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:51 devstack sudo[103155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ad72e00f-2a0f-42de-9570-d3c6d8a87869,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ad72e00f-2a0f-42de-9570-d3c6d8a87869.dd36466f-0da0-4410-a9b2-9a3887a56ee8 1G Nov 04 12:24:51 devstack sudo[103155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:51 devstack sudo[103147]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8c4676a8-41ff-475a-a55f-4d20928cae12 tempest-VolumesTestJSON-1683843544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b291e8ae-2112-467f-8a6d-c0810dbda33a" returned: 0 in 0.382s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8c4676a8-41ff-475a-a55f-4d20928cae12 tempest-VolumesTestJSON-1683843544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b291e8ae-2112-467f-8a6d-c0810dbda33a {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:51 devstack sudo[103158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b291e8ae-2112-467f-8a6d-c0810dbda33a Nov 04 12:24:51 devstack sudo[103158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:51 devstack sudo[103158]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8c4676a8-41ff-475a-a55f-4d20928cae12 tempest-VolumesTestJSON-1683843544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b291e8ae-2112-467f-8a6d-c0810dbda33a" returned: 0 in 0.282s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:51 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-8c4676a8-41ff-475a-a55f-4d20928cae12 tempest-VolumesTestJSON-1683843544 None] Lock "cinder-quobyte-b291e8ae-2112-467f-8a6d-c0810dbda33a" released by "delete_volume" :: held 0.721s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:24:51 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-8c4676a8-41ff-475a-a55f-4d20928cae12 tempest-VolumesTestJSON-1683843544 None] Created reservations ['a6db6838-15fa-4158-b54c-13af10b881c6', 'f1706be7-513c-43e9-8aa9-5fbd6eb32651', '304111ae-8664-48c4-bd9b-9d2a6e4fbf77', '28c49867-a8a2-492b-9fd5-7f214b308d4c'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:24:51 devstack sudo[103155]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-647ed050-b311-401e-bb6c-760b92c7a986 tempest-VolumeDependencyTests-1649406245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ad72e00f-2a0f-42de-9570-d3c6d8a87869,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ad72e00f-2a0f-42de-9570-d3c6d8a87869.dd36466f-0da0-4410-a9b2-9a3887a56ee8 1G" returned: 0 in 0.491s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-647ed050-b311-401e-bb6c-760b92c7a986 tempest-VolumeDependencyTests-1649406245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad72e00f-2a0f-42de-9570-d3c6d8a87869 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ad72e00f-2a0f-42de-9570-d3c6d8a87869.dd36466f-0da0-4410-a9b2-9a3887a56ee8 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:51 devstack sudo[103165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad72e00f-2a0f-42de-9570-d3c6d8a87869 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ad72e00f-2a0f-42de-9570-d3c6d8a87869.dd36466f-0da0-4410-a9b2-9a3887a56ee8 Nov 04 12:24:51 devstack sudo[103165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-8c4676a8-41ff-475a-a55f-4d20928cae12 tempest-VolumesTestJSON-1683843544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:24:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-8c4676a8-41ff-475a-a55f-4d20928cae12 tempest-VolumesTestJSON-1683843544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:24:51 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-8c4676a8-41ff-475a-a55f-4d20928cae12 tempest-VolumesTestJSON-1683843544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:24:51 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-8c4676a8-41ff-475a-a55f-4d20928cae12 tempest-VolumesTestJSON-1683843544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:24:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-8c4676a8-41ff-475a-a55f-4d20928cae12 tempest-VolumesTestJSON-1683843544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:24:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8c4676a8-41ff-475a-a55f-4d20928cae12 tempest-VolumesTestJSON-1683843544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:51 devstack sudo[103168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:24:51 devstack sudo[103168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6b0d52e0-0bcd-4f4b-a9a6-fc2012d632a7 tempest-VolumesTestJSON-1683843544 None] Acquiring lock "cinder-8b76108c-ded9-4200-a902-b4f3bd7eaf1c-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:24:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6b0d52e0-0bcd-4f4b-a9a6-fc2012d632a7 tempest-VolumesTestJSON-1683843544 None] Lock "cinder-8b76108c-ded9-4200-a902-b4f3bd7eaf1c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:24:52 devstack sudo[103165]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-647ed050-b311-401e-bb6c-760b92c7a986 tempest-VolumeDependencyTests-1649406245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad72e00f-2a0f-42de-9570-d3c6d8a87869 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ad72e00f-2a0f-42de-9570-d3c6d8a87869.dd36466f-0da0-4410-a9b2-9a3887a56ee8" returned: 0 in 0.416s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:52 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-647ed050-b311-401e-bb6c-760b92c7a986 tempest-VolumeDependencyTests-1649406245 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ad72e00f-2a0f-42de-9570-d3c6d8a87869.dd36466f-0da0-4410-a9b2-9a3887a56ee8 is being set with open permissions: ugo+rw Nov 04 12:24:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-647ed050-b311-401e-bb6c-760b92c7a986 tempest-VolumeDependencyTests-1649406245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ad72e00f-2a0f-42de-9570-d3c6d8a87869.dd36466f-0da0-4410-a9b2-9a3887a56ee8 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:52 devstack sudo[103168]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6b0d52e0-0bcd-4f4b-a9a6-fc2012d632a7 tempest-VolumesTestJSON-1683843544 None] Acquiring lock "cinder-quobyte-8b76108c-ded9-4200-a902-b4f3bd7eaf1c" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:24:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8c4676a8-41ff-475a-a55f-4d20928cae12 tempest-VolumesTestJSON-1683843544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.364s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:52 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-8c4676a8-41ff-475a-a55f-4d20928cae12 tempest-VolumesTestJSON-1683843544 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:24:52 devstack sudo[103176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ad72e00f-2a0f-42de-9570-d3c6d8a87869.dd36466f-0da0-4410-a9b2-9a3887a56ee8 Nov 04 12:24:52 devstack sudo[103176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:52 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-8c4676a8-41ff-475a-a55f-4d20928cae12 tempest-VolumesTestJSON-1683843544 None] Deleted volume successfully. Nov 04 12:24:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6b0d52e0-0bcd-4f4b-a9a6-fc2012d632a7 tempest-VolumesTestJSON-1683843544 None] Lock "cinder-quobyte-8b76108c-ded9-4200-a902-b4f3bd7eaf1c" acquired by "delete_volume" :: waited 0.030s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:24:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-8c4676a8-41ff-475a-a55f-4d20928cae12 tempest-VolumesTestJSON-1683843544 None] Lock "cinder-b291e8ae-2112-467f-8a6d-c0810dbda33a-delete_volume" released by "delete_volume" :: held 1.372s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:24:52 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[23161f55-58c6-47d4-86da-c8f9f4df521d]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:24:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6b0d52e0-0bcd-4f4b-a9a6-fc2012d632a7 tempest-VolumesTestJSON-1683843544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8b76108c-ded9-4200-a902-b4f3bd7eaf1c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:52 devstack sudo[103178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8b76108c-ded9-4200-a902-b4f3bd7eaf1c Nov 04 12:24:52 devstack sudo[103178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:52 devstack sudo[103176]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-647ed050-b311-401e-bb6c-760b92c7a986 tempest-VolumeDependencyTests-1649406245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ad72e00f-2a0f-42de-9570-d3c6d8a87869.dd36466f-0da0-4410-a9b2-9a3887a56ee8" returned: 0 in 0.282s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-647ed050-b311-401e-bb6c-760b92c7a986 tempest-VolumeDependencyTests-1649406245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ad72e00f-2a0f-42de-9570-d3c6d8a87869.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:52 devstack sudo[103181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ad72e00f-2a0f-42de-9570-d3c6d8a87869.info Nov 04 12:24:52 devstack sudo[103181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:52 devstack sudo[103178]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6b0d52e0-0bcd-4f4b-a9a6-fc2012d632a7 tempest-VolumesTestJSON-1683843544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8b76108c-ded9-4200-a902-b4f3bd7eaf1c" returned: 0 in 0.448s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6b0d52e0-0bcd-4f4b-a9a6-fc2012d632a7 tempest-VolumesTestJSON-1683843544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8b76108c-ded9-4200-a902-b4f3bd7eaf1c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:52 devstack sudo[103186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8b76108c-ded9-4200-a902-b4f3bd7eaf1c Nov 04 12:24:52 devstack sudo[103186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:52 devstack sudo[103181]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-647ed050-b311-401e-bb6c-760b92c7a986 tempest-VolumeDependencyTests-1649406245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ad72e00f-2a0f-42de-9570-d3c6d8a87869.info" returned: 0 in 0.291s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:52 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-647ed050-b311-401e-bb6c-760b92c7a986 tempest-VolumeDependencyTests-1649406245 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ad72e00f-2a0f-42de-9570-d3c6d8a87869.info is being set with open permissions: ugo+rw Nov 04 12:24:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-647ed050-b311-401e-bb6c-760b92c7a986 tempest-VolumeDependencyTests-1649406245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ad72e00f-2a0f-42de-9570-d3c6d8a87869.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:52 devstack sudo[103189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ad72e00f-2a0f-42de-9570-d3c6d8a87869.info Nov 04 12:24:52 devstack sudo[103189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:53 devstack sudo[103186]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6b0d52e0-0bcd-4f4b-a9a6-fc2012d632a7 tempest-VolumesTestJSON-1683843544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8b76108c-ded9-4200-a902-b4f3bd7eaf1c" returned: 0 in 0.300s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:53 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6b0d52e0-0bcd-4f4b-a9a6-fc2012d632a7 tempest-VolumesTestJSON-1683843544 None] Lock "cinder-quobyte-8b76108c-ded9-4200-a902-b4f3bd7eaf1c" released by "delete_volume" :: held 0.817s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:24:53 devstack sudo[103189]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-647ed050-b311-401e-bb6c-760b92c7a986 tempest-VolumeDependencyTests-1649406245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ad72e00f-2a0f-42de-9570-d3c6d8a87869.info" returned: 0 in 0.283s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-647ed050-b311-401e-bb6c-760b92c7a986 tempest-VolumeDependencyTests-1649406245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.326s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:24:53 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-647ed050-b311-401e-bb6c-760b92c7a986 tempest-VolumeDependencyTests-1649406245 None] Create snapshot completed successfully Nov 04 12:24:53 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-6b0d52e0-0bcd-4f4b-a9a6-fc2012d632a7 tempest-VolumesTestJSON-1683843544 None] Created reservations ['374d81c9-359b-4d10-b617-b52ee333fb85', '93bbf2de-9c32-4fdd-a107-3ec70c9de252', 'f3a439f7-97ce-4ee7-ab1a-300c06b1df63', 'a9b8bcd2-50c1-4391-b0af-a837a70e5abc'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:24:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6b0d52e0-0bcd-4f4b-a9a6-fc2012d632a7 tempest-VolumesTestJSON-1683843544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:24:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6b0d52e0-0bcd-4f4b-a9a6-fc2012d632a7 tempest-VolumesTestJSON-1683843544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:24:53 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6b0d52e0-0bcd-4f4b-a9a6-fc2012d632a7 tempest-VolumesTestJSON-1683843544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:24:53 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6b0d52e0-0bcd-4f4b-a9a6-fc2012d632a7 tempest-VolumesTestJSON-1683843544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:24:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6b0d52e0-0bcd-4f4b-a9a6-fc2012d632a7 tempest-VolumesTestJSON-1683843544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:24:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6b0d52e0-0bcd-4f4b-a9a6-fc2012d632a7 tempest-VolumesTestJSON-1683843544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:53 devstack sudo[103194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:24:53 devstack sudo[103194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:53 devstack sudo[103194]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6b0d52e0-0bcd-4f4b-a9a6-fc2012d632a7 tempest-VolumesTestJSON-1683843544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.274s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:53 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-6b0d52e0-0bcd-4f4b-a9a6-fc2012d632a7 tempest-VolumesTestJSON-1683843544 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:24:53 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-6b0d52e0-0bcd-4f4b-a9a6-fc2012d632a7 tempest-VolumesTestJSON-1683843544 None] Deleted volume successfully. Nov 04 12:24:53 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6b0d52e0-0bcd-4f4b-a9a6-fc2012d632a7 tempest-VolumesTestJSON-1683843544 None] Lock "cinder-8b76108c-ded9-4200-a902-b4f3bd7eaf1c-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:24:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-d0b63431-1f06-478b-942a-5091460a0caf req-522c340a-1e5a-43a9-b017-d105e2b589f7 tempest-TestShelveInstance-181440490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:24:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-d0b63431-1f06-478b-942a-5091460a0caf req-522c340a-1e5a-43a9-b017-d105e2b589f7 tempest-TestShelveInstance-181440490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:24:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-d0b63431-1f06-478b-942a-5091460a0caf req-522c340a-1e5a-43a9-b017-d105e2b589f7 tempest-TestShelveInstance-181440490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:24:53 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-d0b63431-1f06-478b-942a-5091460a0caf req-522c340a-1e5a-43a9-b017-d105e2b589f7 tempest-TestShelveInstance-181440490 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784', 'name': 'volume-3657e41b-da17-451a-8749-edb5fed7bcd6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ec79918f-6d8e-40da-a1e3-e572b21f5423', 'enforce_multipath': True} {{(pid=87095) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 12:24:53 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-d0b63431-1f06-478b-942a-5091460a0caf req-522c340a-1e5a-43a9-b017-d105e2b589f7 tempest-TestShelveInstance-181440490 None] attachment_update completed successfully. Nov 04 12:24:54 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-96dcb484-7db6-4e10-98f4-5d6cadfc6500 tempest-VolumeDependencyTests-1649406245 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:24:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-96dcb484-7db6-4e10-98f4-5d6cadfc6500 tempest-VolumeDependencyTests-1649406245 None] Flow 'volume_create_manager' (c57fd88c-1ffe-4402-a716-c0ff0b610b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:24:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-96dcb484-7db6-4e10-98f4-5d6cadfc6500 tempest-VolumeDependencyTests-1649406245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (905a0de3-571e-4bd0-a2a7-af11dd106ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:24:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-96dcb484-7db6-4e10-98f4-5d6cadfc6500 tempest-VolumeDependencyTests-1649406245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (905a0de3-571e-4bd0-a2a7-af11dd106ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:24:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1862323197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8db4e0ae-c893-495f-833f-585a2f7089ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e1f79b9715b45b49bbb0a5c13a423cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:24:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=dd36466f-0da0-4410-a9b2-9a3887a56ee8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:24:55Z,use_quota=True,user_id='037643911c1e400cad720c7ceb24a380',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:24:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-96dcb484-7db6-4e10-98f4-5d6cadfc6500 tempest-VolumeDependencyTests-1649406245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48719cf1-188b-40ae-8282-73696647d70a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:24:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-96dcb484-7db6-4e10-98f4-5d6cadfc6500 tempest-VolumeDependencyTests-1649406245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48719cf1-188b-40ae-8282-73696647d70a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:24:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-96dcb484-7db6-4e10-98f4-5d6cadfc6500 tempest-VolumeDependencyTests-1649406245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b439143-5eaf-4c29-b235-464503697d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:24:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-96dcb484-7db6-4e10-98f4-5d6cadfc6500 tempest-VolumeDependencyTests-1649406245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b439143-5eaf-4c29-b235-464503697d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8db4e0ae-c893-495f-833f-585a2f7089ec', 'volume_name': 'volume-8db4e0ae-c893-495f-833f-585a2f7089ec', 'volume_size': 1, 'snapshot_id': 'dd36466f-0da0-4410-a9b2-9a3887a56ee8'}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:24:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-96dcb484-7db6-4e10-98f4-5d6cadfc6500 tempest-VolumeDependencyTests-1649406245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba578e69-6ed4-44cf-be5b-5957c686255b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:24:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-96dcb484-7db6-4e10-98f4-5d6cadfc6500 tempest-VolumeDependencyTests-1649406245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba578e69-6ed4-44cf-be5b-5957c686255b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:24:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-96dcb484-7db6-4e10-98f4-5d6cadfc6500 tempest-VolumeDependencyTests-1649406245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39ef1e2c-2ca2-4a07-9855-6f07c439bd6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:24:54 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-96dcb484-7db6-4e10-98f4-5d6cadfc6500 tempest-VolumeDependencyTests-1649406245 None] Volume 8db4e0ae-c893-495f-833f-585a2f7089ec: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8db4e0ae-c893-495f-833f-585a2f7089ec', 'volume_size': 1, 'snapshot_id': 'dd36466f-0da0-4410-a9b2-9a3887a56ee8'} Nov 04 12:24:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-96dcb484-7db6-4e10-98f4-5d6cadfc6500 tempest-VolumeDependencyTests-1649406245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:24:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-96dcb484-7db6-4e10-98f4-5d6cadfc6500 tempest-VolumeDependencyTests-1649406245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:24:54 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-96dcb484-7db6-4e10-98f4-5d6cadfc6500 tempest-VolumeDependencyTests-1649406245 None] Acquiring lock "cinder-quobyte-dd36466f-0da0-4410-a9b2-9a3887a56ee8-8db4e0ae-c893-495f-833f-585a2f7089ec" by "_create_volume_from_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:24:54 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-96dcb484-7db6-4e10-98f4-5d6cadfc6500 tempest-VolumeDependencyTests-1649406245 None] Lock "cinder-quobyte-dd36466f-0da0-4410-a9b2-9a3887a56ee8-8db4e0ae-c893-495f-833f-585a2f7089ec" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:24:54 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-96dcb484-7db6-4e10-98f4-5d6cadfc6500 tempest-VolumeDependencyTests-1649406245 None] Creating volume 8db4e0ae-c893-495f-833f-585a2f7089ec from snapshot dd36466f-0da0-4410-a9b2-9a3887a56ee8 {{(pid=87095) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 04 12:24:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-96dcb484-7db6-4e10-98f4-5d6cadfc6500 tempest-VolumeDependencyTests-1649406245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:24:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-96dcb484-7db6-4e10-98f4-5d6cadfc6500 tempest-VolumeDependencyTests-1649406245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:24:54 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-96dcb484-7db6-4e10-98f4-5d6cadfc6500 tempest-VolumeDependencyTests-1649406245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:24:54 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-96dcb484-7db6-4e10-98f4-5d6cadfc6500 tempest-VolumeDependencyTests-1649406245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:24:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-96dcb484-7db6-4e10-98f4-5d6cadfc6500 tempest-VolumeDependencyTests-1649406245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:24:54 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-96dcb484-7db6-4e10-98f4-5d6cadfc6500 tempest-VolumeDependencyTests-1649406245 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:24:54 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-96dcb484-7db6-4e10-98f4-5d6cadfc6500 tempest-VolumeDependencyTests-1649406245 None] Acquiring lock "cinder-quobyte-8db4e0ae-c893-495f-833f-585a2f7089ec" by "_copy_volume_from_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:24:54 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-96dcb484-7db6-4e10-98f4-5d6cadfc6500 tempest-VolumeDependencyTests-1649406245 None] Lock "cinder-quobyte-8db4e0ae-c893-495f-833f-585a2f7089ec" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:24:54 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-96dcb484-7db6-4e10-98f4-5d6cadfc6500 tempest-VolumeDependencyTests-1649406245 None] snapshot: dd36466f-0da0-4410-a9b2-9a3887a56ee8, volume: 8db4e0ae-c893-495f-833f-585a2f7089ec, {{(pid=87095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 12:24:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-96dcb484-7db6-4e10-98f4-5d6cadfc6500 tempest-VolumeDependencyTests-1649406245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:24:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-96dcb484-7db6-4e10-98f4-5d6cadfc6500 tempest-VolumeDependencyTests-1649406245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:24:54 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-96dcb484-7db6-4e10-98f4-5d6cadfc6500 tempest-VolumeDependencyTests-1649406245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:24:54 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-96dcb484-7db6-4e10-98f4-5d6cadfc6500 tempest-VolumeDependencyTests-1649406245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:24:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-96dcb484-7db6-4e10-98f4-5d6cadfc6500 tempest-VolumeDependencyTests-1649406245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:24:54 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[6917a838-79e9-4d37-87a8-170eada618ff]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:24:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-96dcb484-7db6-4e10-98f4-5d6cadfc6500 tempest-VolumeDependencyTests-1649406245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ad72e00f-2a0f-42de-9570-d3c6d8a87869.dd36466f-0da0-4410-a9b2-9a3887a56ee8 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:55 devstack sudo[103205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ad72e00f-2a0f-42de-9570-d3c6d8a87869.dd36466f-0da0-4410-a9b2-9a3887a56ee8 Nov 04 12:24:55 devstack sudo[103205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:55 devstack sudo[103205]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-96dcb484-7db6-4e10-98f4-5d6cadfc6500 tempest-VolumeDependencyTests-1649406245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ad72e00f-2a0f-42de-9570-d3c6d8a87869.dd36466f-0da0-4410-a9b2-9a3887a56ee8" returned: 0 in 0.431s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:55 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-96dcb484-7db6-4e10-98f4-5d6cadfc6500 tempest-VolumeDependencyTests-1649406245 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad72e00f-2a0f-42de-9570-d3c6d8a87869(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 12:24:55 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[66cef1d7-4181-477c-b82a-e37e99d6586a]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:24:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-96dcb484-7db6-4e10-98f4-5d6cadfc6500 tempest-VolumeDependencyTests-1649406245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ad72e00f-2a0f-42de-9570-d3c6d8a87869 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:55 devstack sudo[103212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ad72e00f-2a0f-42de-9570-d3c6d8a87869 Nov 04 12:24:55 devstack sudo[103212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:24:55 devstack sudo[103212]: pam_unix(sudo:session): session closed for user root Nov 04 12:24:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-96dcb484-7db6-4e10-98f4-5d6cadfc6500 tempest-VolumeDependencyTests-1649406245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ad72e00f-2a0f-42de-9570-d3c6d8a87869" returned: 0 in 0.459s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:24:55 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-96dcb484-7db6-4e10-98f4-5d6cadfc6500 tempest-VolumeDependencyTests-1649406245 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ad72e00f-2a0f-42de-9570-d3c6d8a87869 {{(pid=87095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 12:24:55 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-96dcb484-7db6-4e10-98f4-5d6cadfc6500 tempest-VolumeDependencyTests-1649406245 None] Creating direct copy from snapshot {{(pid=87095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 12:24:55 devstack cinder-volume[87095]: DEBUG cinder.utils [None req-96dcb484-7db6-4e10-98f4-5d6cadfc6500 tempest-VolumeDependencyTests-1649406245 None] Path /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8db4e0ae-c893-495f-833f-585a2f7089ec not found in is_blk_device check {{(pid=87095) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 04 12:24:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-96dcb484-7db6-4e10-98f4-5d6cadfc6500 tempest-VolumeDependencyTests-1649406245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ad72e00f-2a0f-42de-9570-d3c6d8a87869 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8db4e0ae-c893-495f-833f-585a2f7089ec {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:24:55 devstack sudo[103218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ad72e00f-2a0f-42de-9570-d3c6d8a87869 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8db4e0ae-c893-495f-833f-585a2f7089ec Nov 04 12:24:55 devstack sudo[103218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:01 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 12:25:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:25:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:25:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:25:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:25:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:25:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:01 devstack sudo[103714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:25:01 devstack sudo[103714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:02 devstack sudo[103714]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.832s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:02 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:25:02 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Running periodic task VolumeManager._thread_info {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 12:25:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] thread count: 28 {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 12:25:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] thread info: [<_MainThread(MainThread, started 140610387472512)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 12:25:04 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=97,cinder:INSERT=37,cinder:UPDATE=136,cinder:DELETE=13 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 12:25:04 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:UPDATE=132,cinder:SELECT=106,cinder:INSERT=36,cinder:DELETE=11 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 12:25:05 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-eb3fd864-8581-4305-a495-f567edcece92 tempest-GroupSnapshotsTest-1488589904 None] Group tempest-GroupSnapshotsTest-Group-1420397548: creating Nov 04 12:25:05 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-eb3fd864-8581-4305-a495-f567edcece92 tempest-GroupSnapshotsTest-1488589904 None] Group tempest-GroupSnapshotsTest-Group-1420397548: created successfully Nov 04 12:25:05 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-eb3fd864-8581-4305-a495-f567edcece92 tempest-GroupSnapshotsTest-1488589904 None] Create group completed successfully. Nov 04 12:25:06 devstack sudo[103218]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-96dcb484-7db6-4e10-98f4-5d6cadfc6500 tempest-VolumeDependencyTests-1649406245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ad72e00f-2a0f-42de-9570-d3c6d8a87869 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8db4e0ae-c893-495f-833f-585a2f7089ec" returned: 0 in 10.941s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:06 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-96dcb484-7db6-4e10-98f4-5d6cadfc6500 tempest-VolumeDependencyTests-1649406245 None] Image conversion details: src /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ad72e00f-2a0f-42de-9570-d3c6d8a87869, size 1024.00 MB, duration 10.94 sec, destination /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8db4e0ae-c893-495f-833f-585a2f7089ec {{(pid=87095) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 12:25:06 devstack cinder-volume[87095]: INFO cinder.image.image_utils [None req-96dcb484-7db6-4e10-98f4-5d6cadfc6500 tempest-VolumeDependencyTests-1649406245 None] Converted 1024.00 MB image at 93.59 MB/s Nov 04 12:25:06 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-96dcb484-7db6-4e10-98f4-5d6cadfc6500 tempest-VolumeDependencyTests-1649406245 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8db4e0ae-c893-495f-833f-585a2f7089ec is being set with open permissions: ugo+rw Nov 04 12:25:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-96dcb484-7db6-4e10-98f4-5d6cadfc6500 tempest-VolumeDependencyTests-1649406245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8db4e0ae-c893-495f-833f-585a2f7089ec {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:06 devstack sudo[104051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8db4e0ae-c893-495f-833f-585a2f7089ec Nov 04 12:25:06 devstack sudo[104051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:07 devstack sudo[104051]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-96dcb484-7db6-4e10-98f4-5d6cadfc6500 tempest-VolumeDependencyTests-1649406245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8db4e0ae-c893-495f-833f-585a2f7089ec" returned: 0 in 0.296s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:07 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-96dcb484-7db6-4e10-98f4-5d6cadfc6500 tempest-VolumeDependencyTests-1649406245 None] Lock "cinder-quobyte-8db4e0ae-c893-495f-833f-585a2f7089ec" released by "_copy_volume_from_snapshot" :: held 12.251s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:25:07 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-96dcb484-7db6-4e10-98f4-5d6cadfc6500 tempest-VolumeDependencyTests-1649406245 None] Lock "cinder-quobyte-dd36466f-0da0-4410-a9b2-9a3887a56ee8-8db4e0ae-c893-495f-833f-585a2f7089ec" released by "_create_volume_from_snapshot" :: held 12.347s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:25:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-96dcb484-7db6-4e10-98f4-5d6cadfc6500 tempest-VolumeDependencyTests-1649406245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.362s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:25:07 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-96dcb484-7db6-4e10-98f4-5d6cadfc6500 tempest-VolumeDependencyTests-1649406245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39ef1e2c-2ca2-4a07-9855-6f07c439bd6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8db4e0ae-c893-495f-833f-585a2f7089ec', 'volume_size': 1, 'snapshot_id': 'dd36466f-0da0-4410-a9b2-9a3887a56ee8'}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:25:07 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-96dcb484-7db6-4e10-98f4-5d6cadfc6500 tempest-VolumeDependencyTests-1649406245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07eea151-48d0-46e2-87b0-18d975266c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:25:07 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-96dcb484-7db6-4e10-98f4-5d6cadfc6500 tempest-VolumeDependencyTests-1649406245 None] Volume volume-8db4e0ae-c893-495f-833f-585a2f7089ec (8db4e0ae-c893-495f-833f-585a2f7089ec): created successfully Nov 04 12:25:07 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-96dcb484-7db6-4e10-98f4-5d6cadfc6500 tempest-VolumeDependencyTests-1649406245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07eea151-48d0-46e2-87b0-18d975266c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:25:07 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-96dcb484-7db6-4e10-98f4-5d6cadfc6500 tempest-VolumeDependencyTests-1649406245 None] Flow 'volume_create_manager' (c57fd88c-1ffe-4402-a716-c0ff0b610b6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:25:07 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-96dcb484-7db6-4e10-98f4-5d6cadfc6500 tempest-VolumeDependencyTests-1649406245 None] Created volume successfully. Nov 04 12:25:07 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-8f447501-5141-44ce-8c11-9c8cf9d4363e tempest-VolumeDependencyTests-1649406245 None] Acquiring lock "cinder-dd36466f-0da0-4410-a9b2-9a3887a56ee8-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:25:07 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-8f447501-5141-44ce-8c11-9c8cf9d4363e tempest-VolumeDependencyTests-1649406245 None] Lock "cinder-dd36466f-0da0-4410-a9b2-9a3887a56ee8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:25:07 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-8f447501-5141-44ce-8c11-9c8cf9d4363e tempest-VolumeDependencyTests-1649406245 None] Acquiring lock "cinder-quobyte-ad72e00f-2a0f-42de-9570-d3c6d8a87869" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:25:07 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-8f447501-5141-44ce-8c11-9c8cf9d4363e tempest-VolumeDependencyTests-1649406245 None] Lock "cinder-quobyte-ad72e00f-2a0f-42de-9570-d3c6d8a87869" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:25:07 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-8f447501-5141-44ce-8c11-9c8cf9d4363e tempest-VolumeDependencyTests-1649406245 None] Acquiring lock "cinder-quobyte-dd36466f-0da0-4410-a9b2-9a3887a56ee8" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:25:07 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-8f447501-5141-44ce-8c11-9c8cf9d4363e tempest-VolumeDependencyTests-1649406245 None] Lock "cinder-quobyte-dd36466f-0da0-4410-a9b2-9a3887a56ee8" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:25:07 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-8f447501-5141-44ce-8c11-9c8cf9d4363e tempest-VolumeDependencyTests-1649406245 None] Deleting offline snapshot dd36466f-0da0-4410-a9b2-9a3887a56ee8 of volume ad72e00f-2a0f-42de-9570-d3c6d8a87869 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 12:25:07 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-8f447501-5141-44ce-8c11-9c8cf9d4363e tempest-VolumeDependencyTests-1649406245 None] snapshot_file for this snap is: volume-ad72e00f-2a0f-42de-9570-d3c6d8a87869.dd36466f-0da0-4410-a9b2-9a3887a56ee8 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 12:25:07 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8175bf-345e-4295-bd75-d8a6f559279e]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:25:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8f447501-5141-44ce-8c11-9c8cf9d4363e tempest-VolumeDependencyTests-1649406245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ad72e00f-2a0f-42de-9570-d3c6d8a87869.dd36466f-0da0-4410-a9b2-9a3887a56ee8 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:07 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd775b24-1244-4ac2-8d9a-261b756430af tempest-GroupSnapshotsTest-1488589904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:25:07 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cd775b24-1244-4ac2-8d9a-261b756430af tempest-GroupSnapshotsTest-1488589904 None] Flow 'volume_create_manager' (80174bc9-f790-4930-8422-43d24036958c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:25:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cd775b24-1244-4ac2-8d9a-261b756430af tempest-GroupSnapshotsTest-1488589904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58667418-6936-4f3a-abed-2a6599185f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:25:08 devstack sudo[104054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ad72e00f-2a0f-42de-9570-d3c6d8a87869.dd36466f-0da0-4410-a9b2-9a3887a56ee8 Nov 04 12:25:08 devstack sudo[104054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cd775b24-1244-4ac2-8d9a-261b756430af tempest-GroupSnapshotsTest-1488589904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58667418-6936-4f3a-abed-2a6599185f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:25:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1185231618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a5057a45-71cb-4272-b83d-692e4521e04f,host='devstack@QuobyteHD#QuobyteHD',id=11c51894-7363-4a86-98c1-9af35549dc6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6740e312316a4752b9477b306727b158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:25:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:25:08Z,use_quota=True,user_id='e00bfc613c6743edb2db220f7cc9b5ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1faf049-271c-4ea9-bb69-95d1b95eba56),volume_type_id=b1faf049-271c-4ea9-bb69-95d1b95eba56)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:25:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cd775b24-1244-4ac2-8d9a-261b756430af tempest-GroupSnapshotsTest-1488589904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (defca526-40c1-4d83-829d-67032d0643cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:25:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cd775b24-1244-4ac2-8d9a-261b756430af tempest-GroupSnapshotsTest-1488589904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (defca526-40c1-4d83-829d-67032d0643cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:25:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cd775b24-1244-4ac2-8d9a-261b756430af tempest-GroupSnapshotsTest-1488589904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bc609f7-dda4-4993-8b67-6d3314a86e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:25:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cd775b24-1244-4ac2-8d9a-261b756430af tempest-GroupSnapshotsTest-1488589904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bc609f7-dda4-4993-8b67-6d3314a86e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11c51894-7363-4a86-98c1-9af35549dc6b', 'volume_name': 'volume-11c51894-7363-4a86-98c1-9af35549dc6b', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:25:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cd775b24-1244-4ac2-8d9a-261b756430af tempest-GroupSnapshotsTest-1488589904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dbcfb2a-67b8-41d4-b6a7-e641dd6975bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:25:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cd775b24-1244-4ac2-8d9a-261b756430af tempest-GroupSnapshotsTest-1488589904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dbcfb2a-67b8-41d4-b6a7-e641dd6975bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:25:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cd775b24-1244-4ac2-8d9a-261b756430af tempest-GroupSnapshotsTest-1488589904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfdb3bb3-3261-407a-ab9c-31c4ee500060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:25:08 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-cd775b24-1244-4ac2-8d9a-261b756430af tempest-GroupSnapshotsTest-1488589904 None] Volume 11c51894-7363-4a86-98c1-9af35549dc6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11c51894-7363-4a86-98c1-9af35549dc6b', 'volume_size': 1} Nov 04 12:25:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cd775b24-1244-4ac2-8d9a-261b756430af tempest-GroupSnapshotsTest-1488589904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:25:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cd775b24-1244-4ac2-8d9a-261b756430af tempest-GroupSnapshotsTest-1488589904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:25:08 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-cd775b24-1244-4ac2-8d9a-261b756430af tempest-GroupSnapshotsTest-1488589904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a5057a45-71cb-4272-b83d-692e4521e04f,created_at=2026-11-04T11:25:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1185231618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a5057a45-71cb-4272-b83d-692e4521e04f,host='devstack@QuobyteHD#QuobyteHD',id=11c51894-7363-4a86-98c1-9af35549dc6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6740e312316a4752b9477b306727b158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:25:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:25:08Z,use_quota=True,user_id='e00bfc613c6743edb2db220f7cc9b5ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1faf049-271c-4ea9-bb69-95d1b95eba56),volume_type_id=b1faf049-271c-4ea9-bb69-95d1b95eba56)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:25:08 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-cd775b24-1244-4ac2-8d9a-261b756430af tempest-GroupSnapshotsTest-1488589904 None] Creating volume 11c51894-7363-4a86-98c1-9af35549dc6b {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:25:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cd775b24-1244-4ac2-8d9a-261b756430af tempest-GroupSnapshotsTest-1488589904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:25:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cd775b24-1244-4ac2-8d9a-261b756430af tempest-GroupSnapshotsTest-1488589904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:25:08 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-cd775b24-1244-4ac2-8d9a-261b756430af tempest-GroupSnapshotsTest-1488589904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:25:08 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-cd775b24-1244-4ac2-8d9a-261b756430af tempest-GroupSnapshotsTest-1488589904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:25:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cd775b24-1244-4ac2-8d9a-261b756430af tempest-GroupSnapshotsTest-1488589904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:25:08 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-cd775b24-1244-4ac2-8d9a-261b756430af tempest-GroupSnapshotsTest-1488589904 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:25:08 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-cd775b24-1244-4ac2-8d9a-261b756430af tempest-GroupSnapshotsTest-1488589904 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:25:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cd775b24-1244-4ac2-8d9a-261b756430af tempest-GroupSnapshotsTest-1488589904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-11c51894-7363-4a86-98c1-9af35549dc6b 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:08 devstack sudo[104057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-11c51894-7363-4a86-98c1-9af35549dc6b 1073741824 Nov 04 12:25:08 devstack sudo[104057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:08 devstack sudo[104054]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8f447501-5141-44ce-8c11-9c8cf9d4363e tempest-VolumeDependencyTests-1649406245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ad72e00f-2a0f-42de-9570-d3c6d8a87869.dd36466f-0da0-4410-a9b2-9a3887a56ee8" returned: 0 in 0.569s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:08 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-8f447501-5141-44ce-8c11-9c8cf9d4363e tempest-VolumeDependencyTests-1649406245 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad72e00f-2a0f-42de-9570-d3c6d8a87869(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 12:25:08 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[79de8a63-9232-469b-9934-fbbf83f03947]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:25:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8f447501-5141-44ce-8c11-9c8cf9d4363e tempest-VolumeDependencyTests-1649406245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ad72e00f-2a0f-42de-9570-d3c6d8a87869 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:08 devstack sudo[104066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ad72e00f-2a0f-42de-9570-d3c6d8a87869 Nov 04 12:25:08 devstack sudo[104066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:08 devstack sudo[104057]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cd775b24-1244-4ac2-8d9a-261b756430af tempest-GroupSnapshotsTest-1488589904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-11c51894-7363-4a86-98c1-9af35549dc6b 1073741824" returned: 0 in 0.506s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cd775b24-1244-4ac2-8d9a-261b756430af tempest-GroupSnapshotsTest-1488589904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-11c51894-7363-4a86-98c1-9af35549dc6b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:08 devstack sudo[104069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-11c51894-7363-4a86-98c1-9af35549dc6b Nov 04 12:25:08 devstack sudo[104069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:08 devstack sudo[104069]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cd775b24-1244-4ac2-8d9a-261b756430af tempest-GroupSnapshotsTest-1488589904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-11c51894-7363-4a86-98c1-9af35549dc6b" returned: 0 in 0.351s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:08 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-cd775b24-1244-4ac2-8d9a-261b756430af tempest-GroupSnapshotsTest-1488589904 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:25:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cd775b24-1244-4ac2-8d9a-261b756430af tempest-GroupSnapshotsTest-1488589904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:25:09 devstack sudo[104066]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cd775b24-1244-4ac2-8d9a-261b756430af tempest-GroupSnapshotsTest-1488589904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfdb3bb3-3261-407a-ab9c-31c4ee500060) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11c51894-7363-4a86-98c1-9af35549dc6b', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:25:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cd775b24-1244-4ac2-8d9a-261b756430af tempest-GroupSnapshotsTest-1488589904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42edaab4-2a48-429e-b281-422837b6d341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:25:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8f447501-5141-44ce-8c11-9c8cf9d4363e tempest-VolumeDependencyTests-1649406245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ad72e00f-2a0f-42de-9570-d3c6d8a87869" returned: 0 in 0.635s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8f447501-5141-44ce-8c11-9c8cf9d4363e tempest-VolumeDependencyTests-1649406245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ad72e00f-2a0f-42de-9570-d3c6d8a87869.dd36466f-0da0-4410-a9b2-9a3887a56ee8 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:09 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-cd775b24-1244-4ac2-8d9a-261b756430af tempest-GroupSnapshotsTest-1488589904 None] Volume volume-11c51894-7363-4a86-98c1-9af35549dc6b (11c51894-7363-4a86-98c1-9af35549dc6b): created successfully Nov 04 12:25:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cd775b24-1244-4ac2-8d9a-261b756430af tempest-GroupSnapshotsTest-1488589904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42edaab4-2a48-429e-b281-422837b6d341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:25:09 devstack sudo[104075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ad72e00f-2a0f-42de-9570-d3c6d8a87869.dd36466f-0da0-4410-a9b2-9a3887a56ee8 Nov 04 12:25:09 devstack sudo[104075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cd775b24-1244-4ac2-8d9a-261b756430af tempest-GroupSnapshotsTest-1488589904 None] Flow 'volume_create_manager' (80174bc9-f790-4930-8422-43d24036958c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:25:09 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-cd775b24-1244-4ac2-8d9a-261b756430af tempest-GroupSnapshotsTest-1488589904 None] Created volume successfully. Nov 04 12:25:09 devstack sudo[104075]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8f447501-5141-44ce-8c11-9c8cf9d4363e tempest-VolumeDependencyTests-1649406245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ad72e00f-2a0f-42de-9570-d3c6d8a87869.dd36466f-0da0-4410-a9b2-9a3887a56ee8" returned: 0 in 0.335s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8f447501-5141-44ce-8c11-9c8cf9d4363e tempest-VolumeDependencyTests-1649406245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ad72e00f-2a0f-42de-9570-d3c6d8a87869.dd36466f-0da0-4410-a9b2-9a3887a56ee8 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:09 devstack sudo[104080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ad72e00f-2a0f-42de-9570-d3c6d8a87869.dd36466f-0da0-4410-a9b2-9a3887a56ee8 Nov 04 12:25:09 devstack sudo[104080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:09 devstack sudo[104080]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8f447501-5141-44ce-8c11-9c8cf9d4363e tempest-VolumeDependencyTests-1649406245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ad72e00f-2a0f-42de-9570-d3c6d8a87869.dd36466f-0da0-4410-a9b2-9a3887a56ee8" returned: 0 in 0.245s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:09 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-8f447501-5141-44ce-8c11-9c8cf9d4363e tempest-VolumeDependencyTests-1649406245 None] Lock "cinder-quobyte-dd36466f-0da0-4410-a9b2-9a3887a56ee8" released by "_delete_snapshot" :: held 1.925s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:25:09 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-8f447501-5141-44ce-8c11-9c8cf9d4363e tempest-VolumeDependencyTests-1649406245 None] Lock "cinder-quobyte-ad72e00f-2a0f-42de-9570-d3c6d8a87869" released by "delete_snapshot" :: held 1.970s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:25:09 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-8f447501-5141-44ce-8c11-9c8cf9d4363e tempest-VolumeDependencyTests-1649406245 None] Created reservations ['926acacf-2ae3-4335-8248-27b0210e7faa', '27e5d28f-dd77-4d5c-9fcd-227b33b894f8', '236d9b24-c7b9-4b02-bb6b-cb10c388a8a6', '35cb8931-6dbf-4e58-b3f3-bc31b1ac1eca'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:25:09 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-8f447501-5141-44ce-8c11-9c8cf9d4363e tempest-VolumeDependencyTests-1649406245 None] Delete snapshot completed successfully. Nov 04 12:25:09 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-8f447501-5141-44ce-8c11-9c8cf9d4363e tempest-VolumeDependencyTests-1649406245 None] Lock "cinder-dd36466f-0da0-4410-a9b2-9a3887a56ee8-delete_snapshot" released by "delete_snapshot" :: held 2.154s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:25:09 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7d68d2b8-7143-4ad9-a7c0-8fa99d8df37c tempest-VolumeDependencyTests-1649406245 None] Acquiring lock "cinder-ad72e00f-2a0f-42de-9570-d3c6d8a87869-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:25:09 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7d68d2b8-7143-4ad9-a7c0-8fa99d8df37c tempest-VolumeDependencyTests-1649406245 None] Lock "cinder-ad72e00f-2a0f-42de-9570-d3c6d8a87869-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:25:09 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7d68d2b8-7143-4ad9-a7c0-8fa99d8df37c tempest-VolumeDependencyTests-1649406245 None] Acquiring lock "cinder-quobyte-ad72e00f-2a0f-42de-9570-d3c6d8a87869" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:25:09 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7d68d2b8-7143-4ad9-a7c0-8fa99d8df37c tempest-VolumeDependencyTests-1649406245 None] Lock "cinder-quobyte-ad72e00f-2a0f-42de-9570-d3c6d8a87869" acquired by "delete_volume" :: waited 0.016s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:25:09 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b43c24c-417f-48c7-88af-57dbb2b7df71]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:25:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7d68d2b8-7143-4ad9-a7c0-8fa99d8df37c tempest-VolumeDependencyTests-1649406245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ad72e00f-2a0f-42de-9570-d3c6d8a87869 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:10 devstack sudo[104083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ad72e00f-2a0f-42de-9570-d3c6d8a87869 Nov 04 12:25:10 devstack sudo[104083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:10 devstack sudo[104083]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7d68d2b8-7143-4ad9-a7c0-8fa99d8df37c tempest-VolumeDependencyTests-1649406245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ad72e00f-2a0f-42de-9570-d3c6d8a87869" returned: 0 in 0.406s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7d68d2b8-7143-4ad9-a7c0-8fa99d8df37c tempest-VolumeDependencyTests-1649406245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ad72e00f-2a0f-42de-9570-d3c6d8a87869 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:10 devstack sudo[104088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ad72e00f-2a0f-42de-9570-d3c6d8a87869 Nov 04 12:25:10 devstack sudo[104088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:10 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-396e098c-7b53-4c30-9d7e-f0b1a2bbe473 tempest-GroupSnapshotsTest-1488589904 None] GroupSnapshot 009a2dad-105b-4465-80ba-88b01a752721: creating. Nov 04 12:25:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-396e098c-7b53-4c30-9d7e-f0b1a2bbe473 tempest-GroupSnapshotsTest-1488589904 None] Group snapshot 009a2dad-105b-4465-80ba-88b01a752721: creating. {{(pid=87095) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 04 12:25:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-396e098c-7b53-4c30-9d7e-f0b1a2bbe473 tempest-GroupSnapshotsTest-1488589904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:25:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-396e098c-7b53-4c30-9d7e-f0b1a2bbe473 tempest-GroupSnapshotsTest-1488589904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:25:10 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-396e098c-7b53-4c30-9d7e-f0b1a2bbe473 tempest-GroupSnapshotsTest-1488589904 None] Creating offline snapshot 1e1f64f5-6cd2-405f-88da-ed7f2a4d794e of volume 11c51894-7363-4a86-98c1-9af35549dc6b {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 12:25:10 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f55552fb-39c4-4341-b945-abed79ac811b]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:25:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-396e098c-7b53-4c30-9d7e-f0b1a2bbe473 tempest-GroupSnapshotsTest-1488589904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-11c51894-7363-4a86-98c1-9af35549dc6b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:10 devstack sudo[104090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-11c51894-7363-4a86-98c1-9af35549dc6b Nov 04 12:25:10 devstack sudo[104090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:10 devstack sudo[104088]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7d68d2b8-7143-4ad9-a7c0-8fa99d8df37c tempest-VolumeDependencyTests-1649406245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ad72e00f-2a0f-42de-9570-d3c6d8a87869" returned: 0 in 0.316s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:10 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7d68d2b8-7143-4ad9-a7c0-8fa99d8df37c tempest-VolumeDependencyTests-1649406245 None] Lock "cinder-quobyte-ad72e00f-2a0f-42de-9570-d3c6d8a87869" released by "delete_volume" :: held 0.781s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:25:10 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-7d68d2b8-7143-4ad9-a7c0-8fa99d8df37c tempest-VolumeDependencyTests-1649406245 None] Created reservations ['cde6f80c-260f-48dd-a0e1-155970123b4f', '08a97154-d65c-4ff5-b8c5-ea418ebfa789', 'b9b90572-0d6c-421b-a3b5-b89d5448ac50', '75a0042d-8069-4bba-b20b-6e77e7a725c5'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:25:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7d68d2b8-7143-4ad9-a7c0-8fa99d8df37c tempest-VolumeDependencyTests-1649406245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:25:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7d68d2b8-7143-4ad9-a7c0-8fa99d8df37c tempest-VolumeDependencyTests-1649406245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:25:10 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7d68d2b8-7143-4ad9-a7c0-8fa99d8df37c tempest-VolumeDependencyTests-1649406245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:25:10 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7d68d2b8-7143-4ad9-a7c0-8fa99d8df37c tempest-VolumeDependencyTests-1649406245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:25:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7d68d2b8-7143-4ad9-a7c0-8fa99d8df37c tempest-VolumeDependencyTests-1649406245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:25:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7d68d2b8-7143-4ad9-a7c0-8fa99d8df37c tempest-VolumeDependencyTests-1649406245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:10 devstack sudo[104093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:25:10 devstack sudo[104093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:10 devstack sudo[104090]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-396e098c-7b53-4c30-9d7e-f0b1a2bbe473 tempest-GroupSnapshotsTest-1488589904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-11c51894-7363-4a86-98c1-9af35549dc6b" returned: 0 in 0.398s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-396e098c-7b53-4c30-9d7e-f0b1a2bbe473 tempest-GroupSnapshotsTest-1488589904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-11c51894-7363-4a86-98c1-9af35549dc6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-11c51894-7363-4a86-98c1-9af35549dc6b.1e1f64f5-6cd2-405f-88da-ed7f2a4d794e 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:10 devstack sudo[104098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-11c51894-7363-4a86-98c1-9af35549dc6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-11c51894-7363-4a86-98c1-9af35549dc6b.1e1f64f5-6cd2-405f-88da-ed7f2a4d794e 1G Nov 04 12:25:10 devstack sudo[104098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:11 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9c28551e-6b83-4104-8b56-a1460c9c5311 tempest-VolumeDependencyTests-1649406245 None] Acquiring lock "cinder-8db4e0ae-c893-495f-833f-585a2f7089ec-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:25:11 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9c28551e-6b83-4104-8b56-a1460c9c5311 tempest-VolumeDependencyTests-1649406245 None] Lock "cinder-8db4e0ae-c893-495f-833f-585a2f7089ec-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:25:11 devstack sudo[104093]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7d68d2b8-7143-4ad9-a7c0-8fa99d8df37c tempest-VolumeDependencyTests-1649406245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.332s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:11 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-7d68d2b8-7143-4ad9-a7c0-8fa99d8df37c tempest-VolumeDependencyTests-1649406245 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:25:11 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-7d68d2b8-7143-4ad9-a7c0-8fa99d8df37c tempest-VolumeDependencyTests-1649406245 None] Deleted volume successfully. Nov 04 12:25:11 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9c28551e-6b83-4104-8b56-a1460c9c5311 tempest-VolumeDependencyTests-1649406245 None] Acquiring lock "cinder-quobyte-8db4e0ae-c893-495f-833f-585a2f7089ec" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:25:11 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7d68d2b8-7143-4ad9-a7c0-8fa99d8df37c tempest-VolumeDependencyTests-1649406245 None] Lock "cinder-ad72e00f-2a0f-42de-9570-d3c6d8a87869-delete_volume" released by "delete_volume" :: held 1.338s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:25:11 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9c28551e-6b83-4104-8b56-a1460c9c5311 tempest-VolumeDependencyTests-1649406245 None] Lock "cinder-quobyte-8db4e0ae-c893-495f-833f-585a2f7089ec" acquired by "delete_volume" :: waited 0.021s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:25:11 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4666e065-5b8e-438d-9542-94a9b3771b26]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:25:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9c28551e-6b83-4104-8b56-a1460c9c5311 tempest-VolumeDependencyTests-1649406245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8db4e0ae-c893-495f-833f-585a2f7089ec {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:11 devstack sudo[104101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8db4e0ae-c893-495f-833f-585a2f7089ec Nov 04 12:25:11 devstack sudo[104101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:11 devstack sudo[104098]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-396e098c-7b53-4c30-9d7e-f0b1a2bbe473 tempest-GroupSnapshotsTest-1488589904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-11c51894-7363-4a86-98c1-9af35549dc6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-11c51894-7363-4a86-98c1-9af35549dc6b.1e1f64f5-6cd2-405f-88da-ed7f2a4d794e 1G" returned: 0 in 0.535s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-396e098c-7b53-4c30-9d7e-f0b1a2bbe473 tempest-GroupSnapshotsTest-1488589904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11c51894-7363-4a86-98c1-9af35549dc6b -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-11c51894-7363-4a86-98c1-9af35549dc6b.1e1f64f5-6cd2-405f-88da-ed7f2a4d794e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:11 devstack sudo[104106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11c51894-7363-4a86-98c1-9af35549dc6b -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-11c51894-7363-4a86-98c1-9af35549dc6b.1e1f64f5-6cd2-405f-88da-ed7f2a4d794e Nov 04 12:25:11 devstack sudo[104106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:11 devstack sudo[104101]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9c28551e-6b83-4104-8b56-a1460c9c5311 tempest-VolumeDependencyTests-1649406245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8db4e0ae-c893-495f-833f-585a2f7089ec" returned: 0 in 0.403s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9c28551e-6b83-4104-8b56-a1460c9c5311 tempest-VolumeDependencyTests-1649406245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8db4e0ae-c893-495f-833f-585a2f7089ec {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:11 devstack sudo[104111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8db4e0ae-c893-495f-833f-585a2f7089ec Nov 04 12:25:11 devstack sudo[104111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:11 devstack sudo[104106]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-396e098c-7b53-4c30-9d7e-f0b1a2bbe473 tempest-GroupSnapshotsTest-1488589904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11c51894-7363-4a86-98c1-9af35549dc6b -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-11c51894-7363-4a86-98c1-9af35549dc6b.1e1f64f5-6cd2-405f-88da-ed7f2a4d794e" returned: 0 in 0.322s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:11 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-396e098c-7b53-4c30-9d7e-f0b1a2bbe473 tempest-GroupSnapshotsTest-1488589904 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-11c51894-7363-4a86-98c1-9af35549dc6b.1e1f64f5-6cd2-405f-88da-ed7f2a4d794e is being set with open permissions: ugo+rw: NotImplementedError Nov 04 12:25:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-396e098c-7b53-4c30-9d7e-f0b1a2bbe473 tempest-GroupSnapshotsTest-1488589904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-11c51894-7363-4a86-98c1-9af35549dc6b.1e1f64f5-6cd2-405f-88da-ed7f2a4d794e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:11 devstack sudo[104116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-11c51894-7363-4a86-98c1-9af35549dc6b.1e1f64f5-6cd2-405f-88da-ed7f2a4d794e Nov 04 12:25:11 devstack sudo[104116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:11 devstack sudo[104111]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9c28551e-6b83-4104-8b56-a1460c9c5311 tempest-VolumeDependencyTests-1649406245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8db4e0ae-c893-495f-833f-585a2f7089ec" returned: 0 in 0.289s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:11 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9c28551e-6b83-4104-8b56-a1460c9c5311 tempest-VolumeDependencyTests-1649406245 None] Lock "cinder-quobyte-8db4e0ae-c893-495f-833f-585a2f7089ec" released by "delete_volume" :: held 0.739s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:25:12 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-9c28551e-6b83-4104-8b56-a1460c9c5311 tempest-VolumeDependencyTests-1649406245 None] Created reservations ['da62dcee-a5eb-411c-8609-46d868ebb95e', 'c17e57a0-56a6-4bb2-9dac-00fed40136e5', 'bac812bd-c751-47d4-bc0f-5bd150df78ac', 'a8f6adc1-94ae-416a-835a-5ae06fa45f14'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:25:12 devstack sudo[104116]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-396e098c-7b53-4c30-9d7e-f0b1a2bbe473 tempest-GroupSnapshotsTest-1488589904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-11c51894-7363-4a86-98c1-9af35549dc6b.1e1f64f5-6cd2-405f-88da-ed7f2a4d794e" returned: 0 in 0.260s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9c28551e-6b83-4104-8b56-a1460c9c5311 tempest-VolumeDependencyTests-1649406245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:25:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9c28551e-6b83-4104-8b56-a1460c9c5311 tempest-VolumeDependencyTests-1649406245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:25:12 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9c28551e-6b83-4104-8b56-a1460c9c5311 tempest-VolumeDependencyTests-1649406245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:25:12 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9c28551e-6b83-4104-8b56-a1460c9c5311 tempest-VolumeDependencyTests-1649406245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:25:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9c28551e-6b83-4104-8b56-a1460c9c5311 tempest-VolumeDependencyTests-1649406245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:25:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9c28551e-6b83-4104-8b56-a1460c9c5311 tempest-VolumeDependencyTests-1649406245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-396e098c-7b53-4c30-9d7e-f0b1a2bbe473 tempest-GroupSnapshotsTest-1488589904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-11c51894-7363-4a86-98c1-9af35549dc6b.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:12 devstack sudo[104120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:25:12 devstack sudo[104120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:12 devstack sudo[104121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-11c51894-7363-4a86-98c1-9af35549dc6b.info Nov 04 12:25:12 devstack sudo[104121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:12 devstack sudo[104120]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9c28551e-6b83-4104-8b56-a1460c9c5311 tempest-VolumeDependencyTests-1649406245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.307s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:12 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-9c28551e-6b83-4104-8b56-a1460c9c5311 tempest-VolumeDependencyTests-1649406245 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:25:12 devstack sudo[104121]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:12 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-9c28551e-6b83-4104-8b56-a1460c9c5311 tempest-VolumeDependencyTests-1649406245 None] Deleted volume successfully. Nov 04 12:25:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-396e098c-7b53-4c30-9d7e-f0b1a2bbe473 tempest-GroupSnapshotsTest-1488589904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-11c51894-7363-4a86-98c1-9af35549dc6b.info" returned: 0 in 0.313s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:12 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-396e098c-7b53-4c30-9d7e-f0b1a2bbe473 tempest-GroupSnapshotsTest-1488589904 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-11c51894-7363-4a86-98c1-9af35549dc6b.info is being set with open permissions: ugo+rw: NotImplementedError Nov 04 12:25:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-396e098c-7b53-4c30-9d7e-f0b1a2bbe473 tempest-GroupSnapshotsTest-1488589904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-11c51894-7363-4a86-98c1-9af35549dc6b.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:12 devstack sudo[104126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-11c51894-7363-4a86-98c1-9af35549dc6b.info Nov 04 12:25:12 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9c28551e-6b83-4104-8b56-a1460c9c5311 tempest-VolumeDependencyTests-1649406245 None] Lock "cinder-8db4e0ae-c893-495f-833f-585a2f7089ec-delete_volume" released by "delete_volume" :: held 1.358s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:25:12 devstack sudo[104126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:12 devstack sudo[104126]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-396e098c-7b53-4c30-9d7e-f0b1a2bbe473 tempest-GroupSnapshotsTest-1488589904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-11c51894-7363-4a86-98c1-9af35549dc6b.info" returned: 0 in 0.300s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-396e098c-7b53-4c30-9d7e-f0b1a2bbe473 tempest-GroupSnapshotsTest-1488589904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.256s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:25:12 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-396e098c-7b53-4c30-9d7e-f0b1a2bbe473 tempest-GroupSnapshotsTest-1488589904 None] group_snapshot 009a2dad-105b-4465-80ba-88b01a752721: created successfully Nov 04 12:25:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b08c2043-62d8-4370-8053-0313e30fcfb3 tempest-GroupSnapshotsTest-1488589904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:25:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b08c2043-62d8-4370-8053-0313e30fcfb3 tempest-GroupSnapshotsTest-1488589904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:25:14 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b08c2043-62d8-4370-8053-0313e30fcfb3 tempest-GroupSnapshotsTest-1488589904 None] Acquiring lock "cinder-quobyte-1e1f64f5-6cd2-405f-88da-ed7f2a4d794e-3fa58a73-4113-4760-b587-e2334c15f8f4" by "_create_volume_from_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:25:14 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b08c2043-62d8-4370-8053-0313e30fcfb3 tempest-GroupSnapshotsTest-1488589904 None] Lock "cinder-quobyte-1e1f64f5-6cd2-405f-88da-ed7f2a4d794e-3fa58a73-4113-4760-b587-e2334c15f8f4" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:25:14 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b08c2043-62d8-4370-8053-0313e30fcfb3 tempest-GroupSnapshotsTest-1488589904 None] Creating volume 3fa58a73-4113-4760-b587-e2334c15f8f4 from snapshot 1e1f64f5-6cd2-405f-88da-ed7f2a4d794e {{(pid=87095) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 04 12:25:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b08c2043-62d8-4370-8053-0313e30fcfb3 tempest-GroupSnapshotsTest-1488589904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:25:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b08c2043-62d8-4370-8053-0313e30fcfb3 tempest-GroupSnapshotsTest-1488589904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:25:14 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b08c2043-62d8-4370-8053-0313e30fcfb3 tempest-GroupSnapshotsTest-1488589904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:25:14 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b08c2043-62d8-4370-8053-0313e30fcfb3 tempest-GroupSnapshotsTest-1488589904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:25:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b08c2043-62d8-4370-8053-0313e30fcfb3 tempest-GroupSnapshotsTest-1488589904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:25:14 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b08c2043-62d8-4370-8053-0313e30fcfb3 tempest-GroupSnapshotsTest-1488589904 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:25:14 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b08c2043-62d8-4370-8053-0313e30fcfb3 tempest-GroupSnapshotsTest-1488589904 None] Acquiring lock "cinder-quobyte-3fa58a73-4113-4760-b587-e2334c15f8f4" by "_copy_volume_from_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:25:14 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b08c2043-62d8-4370-8053-0313e30fcfb3 tempest-GroupSnapshotsTest-1488589904 None] Lock "cinder-quobyte-3fa58a73-4113-4760-b587-e2334c15f8f4" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:25:14 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b08c2043-62d8-4370-8053-0313e30fcfb3 tempest-GroupSnapshotsTest-1488589904 None] snapshot: 1e1f64f5-6cd2-405f-88da-ed7f2a4d794e, volume: 3fa58a73-4113-4760-b587-e2334c15f8f4, {{(pid=87095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 12:25:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b08c2043-62d8-4370-8053-0313e30fcfb3 tempest-GroupSnapshotsTest-1488589904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:25:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b08c2043-62d8-4370-8053-0313e30fcfb3 tempest-GroupSnapshotsTest-1488589904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:25:14 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b08c2043-62d8-4370-8053-0313e30fcfb3 tempest-GroupSnapshotsTest-1488589904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:25:14 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b08c2043-62d8-4370-8053-0313e30fcfb3 tempest-GroupSnapshotsTest-1488589904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:25:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b08c2043-62d8-4370-8053-0313e30fcfb3 tempest-GroupSnapshotsTest-1488589904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:25:14 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d788af-e0fb-4d9c-840f-04b873421dc0]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:25:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b08c2043-62d8-4370-8053-0313e30fcfb3 tempest-GroupSnapshotsTest-1488589904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-11c51894-7363-4a86-98c1-9af35549dc6b.1e1f64f5-6cd2-405f-88da-ed7f2a4d794e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:15 devstack sudo[104131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-11c51894-7363-4a86-98c1-9af35549dc6b.1e1f64f5-6cd2-405f-88da-ed7f2a4d794e Nov 04 12:25:15 devstack sudo[104131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:15 devstack sudo[104131]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b08c2043-62d8-4370-8053-0313e30fcfb3 tempest-GroupSnapshotsTest-1488589904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-11c51894-7363-4a86-98c1-9af35549dc6b.1e1f64f5-6cd2-405f-88da-ed7f2a4d794e" returned: 0 in 0.446s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:15 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-b08c2043-62d8-4370-8053-0313e30fcfb3 tempest-GroupSnapshotsTest-1488589904 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11c51894-7363-4a86-98c1-9af35549dc6b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 12:25:15 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a11f7e99-1dc8-41f1-83d8-406393dda1f2]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:25:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b08c2043-62d8-4370-8053-0313e30fcfb3 tempest-GroupSnapshotsTest-1488589904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-11c51894-7363-4a86-98c1-9af35549dc6b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:15 devstack sudo[104137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-11c51894-7363-4a86-98c1-9af35549dc6b Nov 04 12:25:15 devstack sudo[104137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:15 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c2b30a5-1ef3-40fc-94ac-6284b1997a18 tempest-CinderUnicodeTest-835344334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:25:15 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1c2b30a5-1ef3-40fc-94ac-6284b1997a18 tempest-CinderUnicodeTest-835344334 None] Flow 'volume_create_manager' (f650aa68-8004-4d67-a710-7a60bc3d3bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:25:15 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1c2b30a5-1ef3-40fc-94ac-6284b1997a18 tempest-CinderUnicodeTest-835344334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1374a616-0e32-4619-aaac-37933c869263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:25:15 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1c2b30a5-1ef3-40fc-94ac-6284b1997a18 tempest-CinderUnicodeTest-835344334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1374a616-0e32-4619-aaac-37933c869263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:25:15Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f50c2f5-a1e4-4d7d-ad67-548fa26ce7e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='348d8128914b4249a3d2dc1bdf6804c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:25:16Z,use_quota=True,user_id='be5bb5cf8b5f4e6ea5b8d03e8172f75b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:25:15 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1c2b30a5-1ef3-40fc-94ac-6284b1997a18 tempest-CinderUnicodeTest-835344334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (540aafcd-6d84-490a-bcbf-f8bfd13be0d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:25:15 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1c2b30a5-1ef3-40fc-94ac-6284b1997a18 tempest-CinderUnicodeTest-835344334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (540aafcd-6d84-490a-bcbf-f8bfd13be0d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:25:15 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1c2b30a5-1ef3-40fc-94ac-6284b1997a18 tempest-CinderUnicodeTest-835344334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cbe6d92-e9b9-46cc-a8d7-e4914ba3d63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:25:15 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1c2b30a5-1ef3-40fc-94ac-6284b1997a18 tempest-CinderUnicodeTest-835344334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cbe6d92-e9b9-46cc-a8d7-e4914ba3d63f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f50c2f5-a1e4-4d7d-ad67-548fa26ce7e7', 'volume_name': 'volume-4f50c2f5-a1e4-4d7d-ad67-548fa26ce7e7', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:25:15 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1c2b30a5-1ef3-40fc-94ac-6284b1997a18 tempest-CinderUnicodeTest-835344334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f190b463-acee-4d8f-938b-82402f284a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:25:15 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1c2b30a5-1ef3-40fc-94ac-6284b1997a18 tempest-CinderUnicodeTest-835344334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f190b463-acee-4d8f-938b-82402f284a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:25:15 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1c2b30a5-1ef3-40fc-94ac-6284b1997a18 tempest-CinderUnicodeTest-835344334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df6428c5-48c1-46a5-9227-1dc85e4faf93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:25:15 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-1c2b30a5-1ef3-40fc-94ac-6284b1997a18 tempest-CinderUnicodeTest-835344334 None] Volume 4f50c2f5-a1e4-4d7d-ad67-548fa26ce7e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f50c2f5-a1e4-4d7d-ad67-548fa26ce7e7', 'volume_size': 1} Nov 04 12:25:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1c2b30a5-1ef3-40fc-94ac-6284b1997a18 tempest-CinderUnicodeTest-835344334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:25:15 devstack sudo[104137]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b08c2043-62d8-4370-8053-0313e30fcfb3 tempest-GroupSnapshotsTest-1488589904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-11c51894-7363-4a86-98c1-9af35549dc6b" returned: 0 in 0.448s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:15 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b08c2043-62d8-4370-8053-0313e30fcfb3 tempest-GroupSnapshotsTest-1488589904 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-11c51894-7363-4a86-98c1-9af35549dc6b {{(pid=87095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 12:25:15 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b08c2043-62d8-4370-8053-0313e30fcfb3 tempest-GroupSnapshotsTest-1488589904 None] Creating direct copy from snapshot {{(pid=87095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 12:25:15 devstack cinder-volume[87095]: DEBUG cinder.utils [None req-b08c2043-62d8-4370-8053-0313e30fcfb3 tempest-GroupSnapshotsTest-1488589904 None] Path /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-3fa58a73-4113-4760-b587-e2334c15f8f4 not found in is_blk_device check {{(pid=87095) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 04 12:25:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b08c2043-62d8-4370-8053-0313e30fcfb3 tempest-GroupSnapshotsTest-1488589904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-11c51894-7363-4a86-98c1-9af35549dc6b /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-3fa58a73-4113-4760-b587-e2334c15f8f4 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:15 devstack sudo[104143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-11c51894-7363-4a86-98c1-9af35549dc6b /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-3fa58a73-4113-4760-b587-e2334c15f8f4 Nov 04 12:25:15 devstack sudo[104143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:22 devstack sudo[104143]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b08c2043-62d8-4370-8053-0313e30fcfb3 tempest-GroupSnapshotsTest-1488589904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-11c51894-7363-4a86-98c1-9af35549dc6b /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-3fa58a73-4113-4760-b587-e2334c15f8f4" returned: 0 in 6.831s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:22 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-b08c2043-62d8-4370-8053-0313e30fcfb3 tempest-GroupSnapshotsTest-1488589904 None] Image conversion details: src /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-11c51894-7363-4a86-98c1-9af35549dc6b, size 1024.00 MB, duration 6.83 sec, destination /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-3fa58a73-4113-4760-b587-e2334c15f8f4 {{(pid=87095) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 12:25:22 devstack cinder-volume[87095]: INFO cinder.image.image_utils [None req-b08c2043-62d8-4370-8053-0313e30fcfb3 tempest-GroupSnapshotsTest-1488589904 None] Converted 1024.00 MB image at 149.87 MB/s Nov 04 12:25:22 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-b08c2043-62d8-4370-8053-0313e30fcfb3 tempest-GroupSnapshotsTest-1488589904 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-3fa58a73-4113-4760-b587-e2334c15f8f4 is being set with open permissions: ugo+rw: NotImplementedError Nov 04 12:25:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b08c2043-62d8-4370-8053-0313e30fcfb3 tempest-GroupSnapshotsTest-1488589904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-3fa58a73-4113-4760-b587-e2334c15f8f4 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:22 devstack sudo[104192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-3fa58a73-4113-4760-b587-e2334c15f8f4 Nov 04 12:25:22 devstack sudo[104192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:22 devstack sudo[104192]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b08c2043-62d8-4370-8053-0313e30fcfb3 tempest-GroupSnapshotsTest-1488589904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-3fa58a73-4113-4760-b587-e2334c15f8f4" returned: 0 in 0.236s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:22 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b08c2043-62d8-4370-8053-0313e30fcfb3 tempest-GroupSnapshotsTest-1488589904 None] Lock "cinder-quobyte-3fa58a73-4113-4760-b587-e2334c15f8f4" released by "_copy_volume_from_snapshot" :: held 8.070s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:25:22 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b08c2043-62d8-4370-8053-0313e30fcfb3 tempest-GroupSnapshotsTest-1488589904 None] Lock "cinder-quobyte-1e1f64f5-6cd2-405f-88da-ed7f2a4d794e-3fa58a73-4113-4760-b587-e2334c15f8f4" released by "_create_volume_from_snapshot" :: held 8.151s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:25:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b08c2043-62d8-4370-8053-0313e30fcfb3 tempest-GroupSnapshotsTest-1488589904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.179s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:25:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1c2b30a5-1ef3-40fc-94ac-6284b1997a18 tempest-CinderUnicodeTest-835344334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.144s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:25:22 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1c2b30a5-1ef3-40fc-94ac-6284b1997a18 tempest-CinderUnicodeTest-835344334 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:25:15Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f50c2f5-a1e4-4d7d-ad67-548fa26ce7e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='348d8128914b4249a3d2dc1bdf6804c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:25:16Z,use_quota=True,user_id='be5bb5cf8b5f4e6ea5b8d03e8172f75b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:25:22 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-1c2b30a5-1ef3-40fc-94ac-6284b1997a18 tempest-CinderUnicodeTest-835344334 None] Creating volume 4f50c2f5-a1e4-4d7d-ad67-548fa26ce7e7 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:25:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1c2b30a5-1ef3-40fc-94ac-6284b1997a18 tempest-CinderUnicodeTest-835344334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:25:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1c2b30a5-1ef3-40fc-94ac-6284b1997a18 tempest-CinderUnicodeTest-835344334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:25:22 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1c2b30a5-1ef3-40fc-94ac-6284b1997a18 tempest-CinderUnicodeTest-835344334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:25:22 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1c2b30a5-1ef3-40fc-94ac-6284b1997a18 tempest-CinderUnicodeTest-835344334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:25:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1c2b30a5-1ef3-40fc-94ac-6284b1997a18 tempest-CinderUnicodeTest-835344334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:25:22 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1c2b30a5-1ef3-40fc-94ac-6284b1997a18 tempest-CinderUnicodeTest-835344334 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:25:22 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-1c2b30a5-1ef3-40fc-94ac-6284b1997a18 tempest-CinderUnicodeTest-835344334 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:25:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1c2b30a5-1ef3-40fc-94ac-6284b1997a18 tempest-CinderUnicodeTest-835344334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4f50c2f5-a1e4-4d7d-ad67-548fa26ce7e7 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:22 devstack sudo[104195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4f50c2f5-a1e4-4d7d-ad67-548fa26ce7e7 1073741824 Nov 04 12:25:22 devstack sudo[104195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:23 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-b08c2043-62d8-4370-8053-0313e30fcfb3 tempest-GroupSnapshotsTest-1488589904 None] Create group from source-snapshot-009a2dad-105b-4465-80ba-88b01a752721 completed successfully. Nov 04 12:25:23 devstack sudo[104195]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1c2b30a5-1ef3-40fc-94ac-6284b1997a18 tempest-CinderUnicodeTest-835344334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4f50c2f5-a1e4-4d7d-ad67-548fa26ce7e7 1073741824" returned: 0 in 0.406s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1c2b30a5-1ef3-40fc-94ac-6284b1997a18 tempest-CinderUnicodeTest-835344334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4f50c2f5-a1e4-4d7d-ad67-548fa26ce7e7 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:23 devstack sudo[104202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4f50c2f5-a1e4-4d7d-ad67-548fa26ce7e7 Nov 04 12:25:23 devstack sudo[104202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:23 devstack sudo[104202]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1c2b30a5-1ef3-40fc-94ac-6284b1997a18 tempest-CinderUnicodeTest-835344334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4f50c2f5-a1e4-4d7d-ad67-548fa26ce7e7" returned: 0 in 0.232s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:23 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1c2b30a5-1ef3-40fc-94ac-6284b1997a18 tempest-CinderUnicodeTest-835344334 None] <== create_volume: return (675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:25:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1c2b30a5-1ef3-40fc-94ac-6284b1997a18 tempest-CinderUnicodeTest-835344334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.679s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:25:23 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1c2b30a5-1ef3-40fc-94ac-6284b1997a18 tempest-CinderUnicodeTest-835344334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df6428c5-48c1-46a5-9227-1dc85e4faf93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f50c2f5-a1e4-4d7d-ad67-548fa26ce7e7', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:25:23 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1c2b30a5-1ef3-40fc-94ac-6284b1997a18 tempest-CinderUnicodeTest-835344334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cac7f571-5c02-42b2-be3b-83897d969337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:25:23 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-1c2b30a5-1ef3-40fc-94ac-6284b1997a18 tempest-CinderUnicodeTest-835344334 None] Volume volume-4f50c2f5-a1e4-4d7d-ad67-548fa26ce7e7 (4f50c2f5-a1e4-4d7d-ad67-548fa26ce7e7): created successfully Nov 04 12:25:23 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1c2b30a5-1ef3-40fc-94ac-6284b1997a18 tempest-CinderUnicodeTest-835344334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cac7f571-5c02-42b2-be3b-83897d969337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:25:23 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1c2b30a5-1ef3-40fc-94ac-6284b1997a18 tempest-CinderUnicodeTest-835344334 None] Flow 'volume_create_manager' (f650aa68-8004-4d67-a710-7a60bc3d3bbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:25:23 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-1c2b30a5-1ef3-40fc-94ac-6284b1997a18 tempest-CinderUnicodeTest-835344334 None] Created volume successfully. Nov 04 12:25:24 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-14765091-d2f6-42ab-98f5-7977e78d82b7 tempest-GroupSnapshotsTest-1488589904 None] Acquiring lock "cinder-quobyte-3fa58a73-4113-4760-b587-e2334c15f8f4" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:25:24 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-14765091-d2f6-42ab-98f5-7977e78d82b7 tempest-GroupSnapshotsTest-1488589904 None] Lock "cinder-quobyte-3fa58a73-4113-4760-b587-e2334c15f8f4" acquired by "delete_volume" :: waited 0.020s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:25:24 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f5c293-5be4-4769-8d1d-cce6dcb7a629]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:25:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-14765091-d2f6-42ab-98f5-7977e78d82b7 tempest-GroupSnapshotsTest-1488589904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-3fa58a73-4113-4760-b587-e2334c15f8f4 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:24 devstack sudo[104205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-3fa58a73-4113-4760-b587-e2334c15f8f4 Nov 04 12:25:24 devstack sudo[104205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:24 devstack sudo[104205]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-14765091-d2f6-42ab-98f5-7977e78d82b7 tempest-GroupSnapshotsTest-1488589904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-3fa58a73-4113-4760-b587-e2334c15f8f4" returned: 0 in 0.362s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-14765091-d2f6-42ab-98f5-7977e78d82b7 tempest-GroupSnapshotsTest-1488589904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-3fa58a73-4113-4760-b587-e2334c15f8f4 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:24 devstack sudo[104210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-3fa58a73-4113-4760-b587-e2334c15f8f4 Nov 04 12:25:24 devstack sudo[104210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:24 devstack sudo[104210]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-14765091-d2f6-42ab-98f5-7977e78d82b7 tempest-GroupSnapshotsTest-1488589904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-3fa58a73-4113-4760-b587-e2334c15f8f4" returned: 0 in 0.255s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:24 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-14765091-d2f6-42ab-98f5-7977e78d82b7 tempest-GroupSnapshotsTest-1488589904 None] Lock "cinder-quobyte-3fa58a73-4113-4760-b587-e2334c15f8f4" released by "delete_volume" :: held 0.660s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:25:24 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-14765091-d2f6-42ab-98f5-7977e78d82b7 tempest-GroupSnapshotsTest-1488589904 None] Created reservations ['87003687-2632-4f09-a447-13e4d6df3a12'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:25:24 devstack cinder-volume[87095]: WARNING cinder.quota [None req-14765091-d2f6-42ab-98f5-7977e78d82b7 tempest-GroupSnapshotsTest-1488589904 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1502770435 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1502770435, it is now deprecated. Please use the default quota class for default quota. Nov 04 12:25:24 devstack cinder-volume[87095]: WARNING cinder.quota [None req-14765091-d2f6-42ab-98f5-7977e78d82b7 tempest-GroupSnapshotsTest-1488589904 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1502770435 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1502770435, it is now deprecated. Please use the default quota class for default quota. Nov 04 12:25:24 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-14765091-d2f6-42ab-98f5-7977e78d82b7 tempest-GroupSnapshotsTest-1488589904 None] Created reservations ['5f315833-4d1a-4540-9ded-36eb606190f3', '384fd003-23ba-4fd2-8783-fc0652d04c83', 'a86a697d-2c7a-4d1d-a519-e92c6d44cd30', '893f0ade-e5c2-41d7-91c1-5037ad38b285'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:25:24 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bb89586-6a51-420f-ad14-10bcfeb5ef83 tempest-CinderUnicodeTest-835344334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:25:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4bb89586-6a51-420f-ad14-10bcfeb5ef83 tempest-CinderUnicodeTest-835344334 None] Flow 'volume_create_manager' (5b84ebdb-e39a-40d1-a537-949dbc3eada4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:25:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4bb89586-6a51-420f-ad14-10bcfeb5ef83 tempest-CinderUnicodeTest-835344334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddab2d55-0448-4dfc-bf93-cb646924c1b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:25:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4bb89586-6a51-420f-ad14-10bcfeb5ef83 tempest-CinderUnicodeTest-835344334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddab2d55-0448-4dfc-bf93-cb646924c1b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:25:25Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-855836839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd91ecad-65b1-4745-8948-e69ad9e008a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='348d8128914b4249a3d2dc1bdf6804c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:25:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:25:25Z,use_quota=True,user_id='be5bb5cf8b5f4e6ea5b8d03e8172f75b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:25:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4bb89586-6a51-420f-ad14-10bcfeb5ef83 tempest-CinderUnicodeTest-835344334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (767fc851-8b6f-4693-8b1f-c0bb3e42ae86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:25:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4bb89586-6a51-420f-ad14-10bcfeb5ef83 tempest-CinderUnicodeTest-835344334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (767fc851-8b6f-4693-8b1f-c0bb3e42ae86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:25:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4bb89586-6a51-420f-ad14-10bcfeb5ef83 tempest-CinderUnicodeTest-835344334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f334258-5a87-4df7-856d-96b50551af08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:25:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4bb89586-6a51-420f-ad14-10bcfeb5ef83 tempest-CinderUnicodeTest-835344334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f334258-5a87-4df7-856d-96b50551af08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd91ecad-65b1-4745-8948-e69ad9e008a3', 'volume_name': 'volume-bd91ecad-65b1-4745-8948-e69ad9e008a3', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:25:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4bb89586-6a51-420f-ad14-10bcfeb5ef83 tempest-CinderUnicodeTest-835344334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cb4d135-fd5a-4c9b-bdb6-0b80b88ac0c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:25:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4bb89586-6a51-420f-ad14-10bcfeb5ef83 tempest-CinderUnicodeTest-835344334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cb4d135-fd5a-4c9b-bdb6-0b80b88ac0c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:25:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4bb89586-6a51-420f-ad14-10bcfeb5ef83 tempest-CinderUnicodeTest-835344334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91cbe3d0-32ca-4780-962b-55cd2c791206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:25:25 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-4bb89586-6a51-420f-ad14-10bcfeb5ef83 tempest-CinderUnicodeTest-835344334 None] Volume bd91ecad-65b1-4745-8948-e69ad9e008a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd91ecad-65b1-4745-8948-e69ad9e008a3', 'volume_size': 1} Nov 04 12:25:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4bb89586-6a51-420f-ad14-10bcfeb5ef83 tempest-CinderUnicodeTest-835344334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:25:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4bb89586-6a51-420f-ad14-10bcfeb5ef83 tempest-CinderUnicodeTest-835344334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:25:25 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4bb89586-6a51-420f-ad14-10bcfeb5ef83 tempest-CinderUnicodeTest-835344334 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:25:25Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-855836839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd91ecad-65b1-4745-8948-e69ad9e008a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='348d8128914b4249a3d2dc1bdf6804c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:25:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:25:25Z,use_quota=True,user_id='be5bb5cf8b5f4e6ea5b8d03e8172f75b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:25:25 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-4bb89586-6a51-420f-ad14-10bcfeb5ef83 tempest-CinderUnicodeTest-835344334 None] Creating volume bd91ecad-65b1-4745-8948-e69ad9e008a3 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:25:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4bb89586-6a51-420f-ad14-10bcfeb5ef83 tempest-CinderUnicodeTest-835344334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:25:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4bb89586-6a51-420f-ad14-10bcfeb5ef83 tempest-CinderUnicodeTest-835344334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:25:25 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4bb89586-6a51-420f-ad14-10bcfeb5ef83 tempest-CinderUnicodeTest-835344334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:25:25 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4bb89586-6a51-420f-ad14-10bcfeb5ef83 tempest-CinderUnicodeTest-835344334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:25:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4bb89586-6a51-420f-ad14-10bcfeb5ef83 tempest-CinderUnicodeTest-835344334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:25:25 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4bb89586-6a51-420f-ad14-10bcfeb5ef83 tempest-CinderUnicodeTest-835344334 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:25:25 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-4bb89586-6a51-420f-ad14-10bcfeb5ef83 tempest-CinderUnicodeTest-835344334 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:25:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4bb89586-6a51-420f-ad14-10bcfeb5ef83 tempest-CinderUnicodeTest-835344334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bd91ecad-65b1-4745-8948-e69ad9e008a3 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:25 devstack sudo[104213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bd91ecad-65b1-4745-8948-e69ad9e008a3 1073741824 Nov 04 12:25:25 devstack sudo[104213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-14765091-d2f6-42ab-98f5-7977e78d82b7 tempest-GroupSnapshotsTest-1488589904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:25:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-14765091-d2f6-42ab-98f5-7977e78d82b7 tempest-GroupSnapshotsTest-1488589904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:25:25 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-14765091-d2f6-42ab-98f5-7977e78d82b7 tempest-GroupSnapshotsTest-1488589904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:25:25 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-14765091-d2f6-42ab-98f5-7977e78d82b7 tempest-GroupSnapshotsTest-1488589904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:25:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-14765091-d2f6-42ab-98f5-7977e78d82b7 tempest-GroupSnapshotsTest-1488589904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:25:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-14765091-d2f6-42ab-98f5-7977e78d82b7 tempest-GroupSnapshotsTest-1488589904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:25 devstack sudo[104215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:25:25 devstack sudo[104215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:25 devstack sudo[104215]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:25 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-bcdd8a93-8a02-43cf-b4d2-0f7a3682fbbb tempest-GroupSnapshotsTest-1488589904 None] group_snapshot 009a2dad-105b-4465-80ba-88b01a752721: deleting Nov 04 12:25:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-14765091-d2f6-42ab-98f5-7977e78d82b7 tempest-GroupSnapshotsTest-1488589904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.279s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:25 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-14765091-d2f6-42ab-98f5-7977e78d82b7 tempest-GroupSnapshotsTest-1488589904 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:25:25 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-14765091-d2f6-42ab-98f5-7977e78d82b7 tempest-GroupSnapshotsTest-1488589904 None] Delete group completed successfully. Nov 04 12:25:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-bcdd8a93-8a02-43cf-b4d2-0f7a3682fbbb tempest-GroupSnapshotsTest-1488589904 None] group_snapshot 009a2dad-105b-4465-80ba-88b01a752721: deleting {{(pid=87095) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 04 12:25:25 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-bcdd8a93-8a02-43cf-b4d2-0f7a3682fbbb tempest-GroupSnapshotsTest-1488589904 None] Acquiring lock "cinder-quobyte-11c51894-7363-4a86-98c1-9af35549dc6b" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:25:25 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-bcdd8a93-8a02-43cf-b4d2-0f7a3682fbbb tempest-GroupSnapshotsTest-1488589904 None] Lock "cinder-quobyte-11c51894-7363-4a86-98c1-9af35549dc6b" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:25:25 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-bcdd8a93-8a02-43cf-b4d2-0f7a3682fbbb tempest-GroupSnapshotsTest-1488589904 None] Acquiring lock "cinder-quobyte-1e1f64f5-6cd2-405f-88da-ed7f2a4d794e" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:25:25 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-bcdd8a93-8a02-43cf-b4d2-0f7a3682fbbb tempest-GroupSnapshotsTest-1488589904 None] Lock "cinder-quobyte-1e1f64f5-6cd2-405f-88da-ed7f2a4d794e" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:25:25 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-bcdd8a93-8a02-43cf-b4d2-0f7a3682fbbb tempest-GroupSnapshotsTest-1488589904 None] Deleting offline snapshot 1e1f64f5-6cd2-405f-88da-ed7f2a4d794e of volume 11c51894-7363-4a86-98c1-9af35549dc6b {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 12:25:25 devstack sudo[104213]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:25 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-bcdd8a93-8a02-43cf-b4d2-0f7a3682fbbb tempest-GroupSnapshotsTest-1488589904 None] snapshot_file for this snap is: volume-11c51894-7363-4a86-98c1-9af35549dc6b.1e1f64f5-6cd2-405f-88da-ed7f2a4d794e {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 12:25:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4bb89586-6a51-420f-ad14-10bcfeb5ef83 tempest-CinderUnicodeTest-835344334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bd91ecad-65b1-4745-8948-e69ad9e008a3 1073741824" returned: 0 in 0.495s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:25 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e009a994-8b9e-4274-86fe-c0ad1de0f7ea]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:25:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-bcdd8a93-8a02-43cf-b4d2-0f7a3682fbbb tempest-GroupSnapshotsTest-1488589904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-11c51894-7363-4a86-98c1-9af35549dc6b.1e1f64f5-6cd2-405f-88da-ed7f2a4d794e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4bb89586-6a51-420f-ad14-10bcfeb5ef83 tempest-CinderUnicodeTest-835344334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bd91ecad-65b1-4745-8948-e69ad9e008a3 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:25 devstack sudo[104223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bd91ecad-65b1-4745-8948-e69ad9e008a3 Nov 04 12:25:25 devstack sudo[104223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:25 devstack sudo[104222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-11c51894-7363-4a86-98c1-9af35549dc6b.1e1f64f5-6cd2-405f-88da-ed7f2a4d794e Nov 04 12:25:25 devstack sudo[104222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:25 devstack sudo[104223]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4bb89586-6a51-420f-ad14-10bcfeb5ef83 tempest-CinderUnicodeTest-835344334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bd91ecad-65b1-4745-8948-e69ad9e008a3" returned: 0 in 0.287s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:25 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4bb89586-6a51-420f-ad14-10bcfeb5ef83 tempest-CinderUnicodeTest-835344334 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:25:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4bb89586-6a51-420f-ad14-10bcfeb5ef83 tempest-CinderUnicodeTest-835344334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:25:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4bb89586-6a51-420f-ad14-10bcfeb5ef83 tempest-CinderUnicodeTest-835344334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91cbe3d0-32ca-4780-962b-55cd2c791206) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd91ecad-65b1-4745-8948-e69ad9e008a3', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:25:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4bb89586-6a51-420f-ad14-10bcfeb5ef83 tempest-CinderUnicodeTest-835344334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c972b34a-d456-495a-bb48-67909372b652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:25:25 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-4bb89586-6a51-420f-ad14-10bcfeb5ef83 tempest-CinderUnicodeTest-835344334 None] Volume volume-bd91ecad-65b1-4745-8948-e69ad9e008a3 (bd91ecad-65b1-4745-8948-e69ad9e008a3): created successfully Nov 04 12:25:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4bb89586-6a51-420f-ad14-10bcfeb5ef83 tempest-CinderUnicodeTest-835344334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c972b34a-d456-495a-bb48-67909372b652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:25:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4bb89586-6a51-420f-ad14-10bcfeb5ef83 tempest-CinderUnicodeTest-835344334 None] Flow 'volume_create_manager' (5b84ebdb-e39a-40d1-a537-949dbc3eada4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:25:25 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-4bb89586-6a51-420f-ad14-10bcfeb5ef83 tempest-CinderUnicodeTest-835344334 None] Created volume successfully. Nov 04 12:25:25 devstack sudo[104222]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-bcdd8a93-8a02-43cf-b4d2-0f7a3682fbbb tempest-GroupSnapshotsTest-1488589904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-11c51894-7363-4a86-98c1-9af35549dc6b.1e1f64f5-6cd2-405f-88da-ed7f2a4d794e" returned: 0 in 0.409s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:25 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-bcdd8a93-8a02-43cf-b4d2-0f7a3682fbbb tempest-GroupSnapshotsTest-1488589904 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11c51894-7363-4a86-98c1-9af35549dc6b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 12:25:25 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcae52ed-9ac0-4ac5-9fb8-849548b83f8d]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:25:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-bcdd8a93-8a02-43cf-b4d2-0f7a3682fbbb tempest-GroupSnapshotsTest-1488589904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-11c51894-7363-4a86-98c1-9af35549dc6b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:26 devstack sudo[104230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-11c51894-7363-4a86-98c1-9af35549dc6b Nov 04 12:25:26 devstack sudo[104230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:26 devstack sudo[104230]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-bcdd8a93-8a02-43cf-b4d2-0f7a3682fbbb tempest-GroupSnapshotsTest-1488589904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-11c51894-7363-4a86-98c1-9af35549dc6b" returned: 0 in 0.512s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-bcdd8a93-8a02-43cf-b4d2-0f7a3682fbbb tempest-GroupSnapshotsTest-1488589904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-11c51894-7363-4a86-98c1-9af35549dc6b.1e1f64f5-6cd2-405f-88da-ed7f2a4d794e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:26 devstack sudo[104235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-11c51894-7363-4a86-98c1-9af35549dc6b.1e1f64f5-6cd2-405f-88da-ed7f2a4d794e Nov 04 12:25:26 devstack sudo[104235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:26 devstack sudo[104235]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-bcdd8a93-8a02-43cf-b4d2-0f7a3682fbbb tempest-GroupSnapshotsTest-1488589904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-11c51894-7363-4a86-98c1-9af35549dc6b.1e1f64f5-6cd2-405f-88da-ed7f2a4d794e" returned: 0 in 0.321s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-bcdd8a93-8a02-43cf-b4d2-0f7a3682fbbb tempest-GroupSnapshotsTest-1488589904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-11c51894-7363-4a86-98c1-9af35549dc6b.1e1f64f5-6cd2-405f-88da-ed7f2a4d794e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:26 devstack sudo[104326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-11c51894-7363-4a86-98c1-9af35549dc6b.1e1f64f5-6cd2-405f-88da-ed7f2a4d794e Nov 04 12:25:26 devstack sudo[104326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:27 devstack sudo[104326]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-bcdd8a93-8a02-43cf-b4d2-0f7a3682fbbb tempest-GroupSnapshotsTest-1488589904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-11c51894-7363-4a86-98c1-9af35549dc6b.1e1f64f5-6cd2-405f-88da-ed7f2a4d794e" returned: 0 in 0.244s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:27 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-bcdd8a93-8a02-43cf-b4d2-0f7a3682fbbb tempest-GroupSnapshotsTest-1488589904 None] Lock "cinder-quobyte-1e1f64f5-6cd2-405f-88da-ed7f2a4d794e" released by "_delete_snapshot" :: held 1.593s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:25:27 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-bcdd8a93-8a02-43cf-b4d2-0f7a3682fbbb tempest-GroupSnapshotsTest-1488589904 None] Lock "cinder-quobyte-11c51894-7363-4a86-98c1-9af35549dc6b" released by "delete_snapshot" :: held 1.616s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:25:27 devstack cinder-volume[87095]: WARNING cinder.quota [None req-bcdd8a93-8a02-43cf-b4d2-0f7a3682fbbb tempest-GroupSnapshotsTest-1488589904 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1502770435 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1502770435, it is now deprecated. Please use the default quota class for default quota. Nov 04 12:25:27 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-bcdd8a93-8a02-43cf-b4d2-0f7a3682fbbb tempest-GroupSnapshotsTest-1488589904 None] Created reservations ['de193e54-c00b-47f4-ae69-8d1572811741', '2c2d3dc1-0a59-43a2-b625-8623935db159', '8f5b7896-be85-4e07-80b0-0b8857232533', '6e72e472-da34-4189-980d-2acab17d511e'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:25:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e9d7c4d6-39c7-437e-97f8-2a495191d48d tempest-CinderUnicodeTest-835344334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:25:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e9d7c4d6-39c7-437e-97f8-2a495191d48d tempest-CinderUnicodeTest-835344334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:25:27 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-e9d7c4d6-39c7-437e-97f8-2a495191d48d tempest-CinderUnicodeTest-835344334 None] Creating offline snapshot 0d54c4fa-003b-4b9e-8f50-329b17f0c46d of volume bd91ecad-65b1-4745-8948-e69ad9e008a3 {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 12:25:27 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[41538dcd-70b2-40e6-9a17-a818edd2af50]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:25:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e9d7c4d6-39c7-437e-97f8-2a495191d48d tempest-CinderUnicodeTest-835344334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bd91ecad-65b1-4745-8948-e69ad9e008a3 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:27 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-bcdd8a93-8a02-43cf-b4d2-0f7a3682fbbb tempest-GroupSnapshotsTest-1488589904 None] group_snapshot 009a2dad-105b-4465-80ba-88b01a752721: deleted successfully Nov 04 12:25:27 devstack sudo[104329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bd91ecad-65b1-4745-8948-e69ad9e008a3 Nov 04 12:25:27 devstack sudo[104329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:27 devstack sudo[104329]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e9d7c4d6-39c7-437e-97f8-2a495191d48d tempest-CinderUnicodeTest-835344334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bd91ecad-65b1-4745-8948-e69ad9e008a3" returned: 0 in 0.380s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e9d7c4d6-39c7-437e-97f8-2a495191d48d tempest-CinderUnicodeTest-835344334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bd91ecad-65b1-4745-8948-e69ad9e008a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bd91ecad-65b1-4745-8948-e69ad9e008a3.0d54c4fa-003b-4b9e-8f50-329b17f0c46d 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:27 devstack sudo[104334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bd91ecad-65b1-4745-8948-e69ad9e008a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bd91ecad-65b1-4745-8948-e69ad9e008a3.0d54c4fa-003b-4b9e-8f50-329b17f0c46d 1G Nov 04 12:25:27 devstack sudo[104334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:28 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-512c0906-5842-43ad-91bf-60b8e2238921 tempest-GroupSnapshotsTest-1488589904 None] Acquiring lock "cinder-quobyte-11c51894-7363-4a86-98c1-9af35549dc6b" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:25:28 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-512c0906-5842-43ad-91bf-60b8e2238921 tempest-GroupSnapshotsTest-1488589904 None] Lock "cinder-quobyte-11c51894-7363-4a86-98c1-9af35549dc6b" acquired by "delete_volume" :: waited 0.022s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:25:28 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4302a3-c5b4-4e35-9221-6f4509c14548]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:25:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-512c0906-5842-43ad-91bf-60b8e2238921 tempest-GroupSnapshotsTest-1488589904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-11c51894-7363-4a86-98c1-9af35549dc6b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:28 devstack sudo[104334]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e9d7c4d6-39c7-437e-97f8-2a495191d48d tempest-CinderUnicodeTest-835344334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bd91ecad-65b1-4745-8948-e69ad9e008a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bd91ecad-65b1-4745-8948-e69ad9e008a3.0d54c4fa-003b-4b9e-8f50-329b17f0c46d 1G" returned: 0 in 0.525s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e9d7c4d6-39c7-437e-97f8-2a495191d48d tempest-CinderUnicodeTest-835344334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd91ecad-65b1-4745-8948-e69ad9e008a3 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bd91ecad-65b1-4745-8948-e69ad9e008a3.0d54c4fa-003b-4b9e-8f50-329b17f0c46d {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:28 devstack sudo[104339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-11c51894-7363-4a86-98c1-9af35549dc6b Nov 04 12:25:28 devstack sudo[104339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:28 devstack sudo[104346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd91ecad-65b1-4745-8948-e69ad9e008a3 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bd91ecad-65b1-4745-8948-e69ad9e008a3.0d54c4fa-003b-4b9e-8f50-329b17f0c46d Nov 04 12:25:28 devstack sudo[104346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:28 devstack sudo[104339]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-512c0906-5842-43ad-91bf-60b8e2238921 tempest-GroupSnapshotsTest-1488589904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-11c51894-7363-4a86-98c1-9af35549dc6b" returned: 0 in 0.411s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-512c0906-5842-43ad-91bf-60b8e2238921 tempest-GroupSnapshotsTest-1488589904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-11c51894-7363-4a86-98c1-9af35549dc6b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:28 devstack sudo[104355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-11c51894-7363-4a86-98c1-9af35549dc6b Nov 04 12:25:28 devstack sudo[104355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:28 devstack sudo[104346]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e9d7c4d6-39c7-437e-97f8-2a495191d48d tempest-CinderUnicodeTest-835344334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd91ecad-65b1-4745-8948-e69ad9e008a3 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bd91ecad-65b1-4745-8948-e69ad9e008a3.0d54c4fa-003b-4b9e-8f50-329b17f0c46d" returned: 0 in 0.343s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:28 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-e9d7c4d6-39c7-437e-97f8-2a495191d48d tempest-CinderUnicodeTest-835344334 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bd91ecad-65b1-4745-8948-e69ad9e008a3.0d54c4fa-003b-4b9e-8f50-329b17f0c46d is being set with open permissions: ugo+rw Nov 04 12:25:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e9d7c4d6-39c7-437e-97f8-2a495191d48d tempest-CinderUnicodeTest-835344334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bd91ecad-65b1-4745-8948-e69ad9e008a3.0d54c4fa-003b-4b9e-8f50-329b17f0c46d {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:28 devstack sudo[104357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bd91ecad-65b1-4745-8948-e69ad9e008a3.0d54c4fa-003b-4b9e-8f50-329b17f0c46d Nov 04 12:25:28 devstack sudo[104357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:28 devstack sudo[104355]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-512c0906-5842-43ad-91bf-60b8e2238921 tempest-GroupSnapshotsTest-1488589904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-11c51894-7363-4a86-98c1-9af35549dc6b" returned: 0 in 0.283s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:28 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-512c0906-5842-43ad-91bf-60b8e2238921 tempest-GroupSnapshotsTest-1488589904 None] Lock "cinder-quobyte-11c51894-7363-4a86-98c1-9af35549dc6b" released by "delete_volume" :: held 0.774s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:25:28 devstack sudo[104357]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e9d7c4d6-39c7-437e-97f8-2a495191d48d tempest-CinderUnicodeTest-835344334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bd91ecad-65b1-4745-8948-e69ad9e008a3.0d54c4fa-003b-4b9e-8f50-329b17f0c46d" returned: 0 in 0.279s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e9d7c4d6-39c7-437e-97f8-2a495191d48d tempest-CinderUnicodeTest-835344334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bd91ecad-65b1-4745-8948-e69ad9e008a3.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:28 devstack sudo[104362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bd91ecad-65b1-4745-8948-e69ad9e008a3.info Nov 04 12:25:28 devstack sudo[104362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:28 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-512c0906-5842-43ad-91bf-60b8e2238921 tempest-GroupSnapshotsTest-1488589904 None] Created reservations ['37da4e7e-9adc-4582-a71f-f68bd47c8c22'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:25:29 devstack cinder-volume[87095]: WARNING cinder.db.api [None req-512c0906-5842-43ad-91bf-60b8e2238921 tempest-GroupSnapshotsTest-1488589904 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1502770435'] Nov 04 12:25:29 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-512c0906-5842-43ad-91bf-60b8e2238921 tempest-GroupSnapshotsTest-1488589904 None] Created reservations ['e5351773-5ab2-4c80-a516-aa05c5be2795', '8bb80e52-df2a-44d0-9f28-427265a05209', '61f32fdf-4c6e-49e2-ac8c-252e8c62eb9b', '270d9ca8-fc38-419b-bd3c-4caf5b4e6223'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:25:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-512c0906-5842-43ad-91bf-60b8e2238921 tempest-GroupSnapshotsTest-1488589904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:25:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-512c0906-5842-43ad-91bf-60b8e2238921 tempest-GroupSnapshotsTest-1488589904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:25:29 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-512c0906-5842-43ad-91bf-60b8e2238921 tempest-GroupSnapshotsTest-1488589904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:25:29 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-512c0906-5842-43ad-91bf-60b8e2238921 tempest-GroupSnapshotsTest-1488589904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:25:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-512c0906-5842-43ad-91bf-60b8e2238921 tempest-GroupSnapshotsTest-1488589904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:25:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-512c0906-5842-43ad-91bf-60b8e2238921 tempest-GroupSnapshotsTest-1488589904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:29 devstack sudo[104397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:25:29 devstack sudo[104397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:29 devstack sudo[104362]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e9d7c4d6-39c7-437e-97f8-2a495191d48d tempest-CinderUnicodeTest-835344334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bd91ecad-65b1-4745-8948-e69ad9e008a3.info" returned: 0 in 0.293s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:29 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-e9d7c4d6-39c7-437e-97f8-2a495191d48d tempest-CinderUnicodeTest-835344334 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bd91ecad-65b1-4745-8948-e69ad9e008a3.info is being set with open permissions: ugo+rw Nov 04 12:25:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e9d7c4d6-39c7-437e-97f8-2a495191d48d tempest-CinderUnicodeTest-835344334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bd91ecad-65b1-4745-8948-e69ad9e008a3.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:29 devstack sudo[104408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bd91ecad-65b1-4745-8948-e69ad9e008a3.info Nov 04 12:25:29 devstack sudo[104408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:29 devstack sudo[104397]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-512c0906-5842-43ad-91bf-60b8e2238921 tempest-GroupSnapshotsTest-1488589904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.327s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:29 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-512c0906-5842-43ad-91bf-60b8e2238921 tempest-GroupSnapshotsTest-1488589904 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:25:29 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-512c0906-5842-43ad-91bf-60b8e2238921 tempest-GroupSnapshotsTest-1488589904 None] Delete group completed successfully. Nov 04 12:25:29 devstack sudo[104408]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e9d7c4d6-39c7-437e-97f8-2a495191d48d tempest-CinderUnicodeTest-835344334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bd91ecad-65b1-4745-8948-e69ad9e008a3.info" returned: 0 in 0.399s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e9d7c4d6-39c7-437e-97f8-2a495191d48d tempest-CinderUnicodeTest-835344334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.336s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:25:29 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-e9d7c4d6-39c7-437e-97f8-2a495191d48d tempest-CinderUnicodeTest-835344334 None] Create snapshot completed successfully Nov 04 12:25:29 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-3e009ef4-2bd7-43d9-95ec-b17dd5318482 tempest-GroupSnapshotsTest-1488589904 None] Group tempest-GroupSnapshotsTest-Group-1111554392: creating Nov 04 12:25:29 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-3e009ef4-2bd7-43d9-95ec-b17dd5318482 tempest-GroupSnapshotsTest-1488589904 None] Group tempest-GroupSnapshotsTest-Group-1111554392: created successfully Nov 04 12:25:29 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-3e009ef4-2bd7-43d9-95ec-b17dd5318482 tempest-GroupSnapshotsTest-1488589904 None] Create group completed successfully. Nov 04 12:25:30 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e826fa96-6a86-460e-a3f8-c59790e2ebc2 tempest-CinderUnicodeTest-835344334 None] Acquiring lock "cinder-0d54c4fa-003b-4b9e-8f50-329b17f0c46d-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:25:30 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e826fa96-6a86-460e-a3f8-c59790e2ebc2 tempest-CinderUnicodeTest-835344334 None] Lock "cinder-0d54c4fa-003b-4b9e-8f50-329b17f0c46d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:25:30 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e826fa96-6a86-460e-a3f8-c59790e2ebc2 tempest-CinderUnicodeTest-835344334 None] Acquiring lock "cinder-quobyte-bd91ecad-65b1-4745-8948-e69ad9e008a3" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:25:30 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e826fa96-6a86-460e-a3f8-c59790e2ebc2 tempest-CinderUnicodeTest-835344334 None] Lock "cinder-quobyte-bd91ecad-65b1-4745-8948-e69ad9e008a3" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:25:30 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e826fa96-6a86-460e-a3f8-c59790e2ebc2 tempest-CinderUnicodeTest-835344334 None] Acquiring lock "cinder-quobyte-0d54c4fa-003b-4b9e-8f50-329b17f0c46d" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:25:30 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e826fa96-6a86-460e-a3f8-c59790e2ebc2 tempest-CinderUnicodeTest-835344334 None] Lock "cinder-quobyte-0d54c4fa-003b-4b9e-8f50-329b17f0c46d" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:25:30 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-e826fa96-6a86-460e-a3f8-c59790e2ebc2 tempest-CinderUnicodeTest-835344334 None] Deleting offline snapshot 0d54c4fa-003b-4b9e-8f50-329b17f0c46d of volume bd91ecad-65b1-4745-8948-e69ad9e008a3 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 12:25:30 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-e826fa96-6a86-460e-a3f8-c59790e2ebc2 tempest-CinderUnicodeTest-835344334 None] snapshot_file for this snap is: volume-bd91ecad-65b1-4745-8948-e69ad9e008a3.0d54c4fa-003b-4b9e-8f50-329b17f0c46d {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 12:25:30 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14262f2-4cf4-4970-8fd9-2432cb5debcb]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:25:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e826fa96-6a86-460e-a3f8-c59790e2ebc2 tempest-CinderUnicodeTest-835344334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bd91ecad-65b1-4745-8948-e69ad9e008a3.0d54c4fa-003b-4b9e-8f50-329b17f0c46d {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:30 devstack sudo[104416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bd91ecad-65b1-4745-8948-e69ad9e008a3.0d54c4fa-003b-4b9e-8f50-329b17f0c46d Nov 04 12:25:30 devstack sudo[104416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:30 devstack sudo[104416]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e826fa96-6a86-460e-a3f8-c59790e2ebc2 tempest-CinderUnicodeTest-835344334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bd91ecad-65b1-4745-8948-e69ad9e008a3.0d54c4fa-003b-4b9e-8f50-329b17f0c46d" returned: 0 in 0.429s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:30 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-e826fa96-6a86-460e-a3f8-c59790e2ebc2 tempest-CinderUnicodeTest-835344334 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd91ecad-65b1-4745-8948-e69ad9e008a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 12:25:31 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ea08d2-d40d-401f-9de3-6d8b77a2cf96]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:25:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e826fa96-6a86-460e-a3f8-c59790e2ebc2 tempest-CinderUnicodeTest-835344334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bd91ecad-65b1-4745-8948-e69ad9e008a3 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:31 devstack sudo[104426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bd91ecad-65b1-4745-8948-e69ad9e008a3 Nov 04 12:25:31 devstack sudo[104426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:31 devstack sudo[104426]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e826fa96-6a86-460e-a3f8-c59790e2ebc2 tempest-CinderUnicodeTest-835344334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bd91ecad-65b1-4745-8948-e69ad9e008a3" returned: 0 in 0.464s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e826fa96-6a86-460e-a3f8-c59790e2ebc2 tempest-CinderUnicodeTest-835344334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bd91ecad-65b1-4745-8948-e69ad9e008a3.0d54c4fa-003b-4b9e-8f50-329b17f0c46d {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:31 devstack sudo[104435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bd91ecad-65b1-4745-8948-e69ad9e008a3.0d54c4fa-003b-4b9e-8f50-329b17f0c46d Nov 04 12:25:31 devstack sudo[104435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:31 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-d476e5e8-244e-4de3-992a-c68e763dbafc tempest-GroupSnapshotsTest-1488589904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:25:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d476e5e8-244e-4de3-992a-c68e763dbafc tempest-GroupSnapshotsTest-1488589904 None] Flow 'volume_create_manager' (2f687370-747f-49b8-ada9-76b305266906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:25:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d476e5e8-244e-4de3-992a-c68e763dbafc tempest-GroupSnapshotsTest-1488589904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9258abe4-6596-4cd4-bf04-006904ac22f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:25:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d476e5e8-244e-4de3-992a-c68e763dbafc tempest-GroupSnapshotsTest-1488589904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9258abe4-6596-4cd4-bf04-006904ac22f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:25:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-514985512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e9c8d19f-fcdc-488b-8b6b-3f69387bbb14,host='devstack@QuobyteHD#QuobyteHD',id=1cc985e1-5cf3-4001-b8d7-7c75c01d72d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6740e312316a4752b9477b306727b158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:25:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:25:32Z,use_quota=True,user_id='e00bfc613c6743edb2db220f7cc9b5ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ea9be12-f8f7-449c-a9b8-e8ac6251e498),volume_type_id=1ea9be12-f8f7-449c-a9b8-e8ac6251e498)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:25:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d476e5e8-244e-4de3-992a-c68e763dbafc tempest-GroupSnapshotsTest-1488589904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c66600c-036c-4b21-b1d5-ca35e7b1fcb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:25:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d476e5e8-244e-4de3-992a-c68e763dbafc tempest-GroupSnapshotsTest-1488589904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c66600c-036c-4b21-b1d5-ca35e7b1fcb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:25:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d476e5e8-244e-4de3-992a-c68e763dbafc tempest-GroupSnapshotsTest-1488589904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d769273-10c1-4d22-8420-042242d5f9a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:25:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d476e5e8-244e-4de3-992a-c68e763dbafc tempest-GroupSnapshotsTest-1488589904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d769273-10c1-4d22-8420-042242d5f9a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cc985e1-5cf3-4001-b8d7-7c75c01d72d4', 'volume_name': 'volume-1cc985e1-5cf3-4001-b8d7-7c75c01d72d4', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:25:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d476e5e8-244e-4de3-992a-c68e763dbafc tempest-GroupSnapshotsTest-1488589904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4edc79d-9d96-4c39-ab05-889368da2f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:25:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d476e5e8-244e-4de3-992a-c68e763dbafc tempest-GroupSnapshotsTest-1488589904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4edc79d-9d96-4c39-ab05-889368da2f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:25:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d476e5e8-244e-4de3-992a-c68e763dbafc tempest-GroupSnapshotsTest-1488589904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a40067e4-0395-4462-9616-88077e3d922b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:25:31 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-d476e5e8-244e-4de3-992a-c68e763dbafc tempest-GroupSnapshotsTest-1488589904 None] Volume 1cc985e1-5cf3-4001-b8d7-7c75c01d72d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cc985e1-5cf3-4001-b8d7-7c75c01d72d4', 'volume_size': 1} Nov 04 12:25:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d476e5e8-244e-4de3-992a-c68e763dbafc tempest-GroupSnapshotsTest-1488589904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:25:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d476e5e8-244e-4de3-992a-c68e763dbafc tempest-GroupSnapshotsTest-1488589904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:25:31 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d476e5e8-244e-4de3-992a-c68e763dbafc tempest-GroupSnapshotsTest-1488589904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e9c8d19f-fcdc-488b-8b6b-3f69387bbb14,created_at=2026-11-04T11:25:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-514985512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e9c8d19f-fcdc-488b-8b6b-3f69387bbb14,host='devstack@QuobyteHD#QuobyteHD',id=1cc985e1-5cf3-4001-b8d7-7c75c01d72d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6740e312316a4752b9477b306727b158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:25:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:25:32Z,use_quota=True,user_id='e00bfc613c6743edb2db220f7cc9b5ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ea9be12-f8f7-449c-a9b8-e8ac6251e498),volume_type_id=1ea9be12-f8f7-449c-a9b8-e8ac6251e498)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:25:31 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-d476e5e8-244e-4de3-992a-c68e763dbafc tempest-GroupSnapshotsTest-1488589904 None] Creating volume 1cc985e1-5cf3-4001-b8d7-7c75c01d72d4 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:25:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d476e5e8-244e-4de3-992a-c68e763dbafc tempest-GroupSnapshotsTest-1488589904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:25:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d476e5e8-244e-4de3-992a-c68e763dbafc tempest-GroupSnapshotsTest-1488589904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:25:31 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d476e5e8-244e-4de3-992a-c68e763dbafc tempest-GroupSnapshotsTest-1488589904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:25:31 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d476e5e8-244e-4de3-992a-c68e763dbafc tempest-GroupSnapshotsTest-1488589904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:25:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d476e5e8-244e-4de3-992a-c68e763dbafc tempest-GroupSnapshotsTest-1488589904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:25:31 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d476e5e8-244e-4de3-992a-c68e763dbafc tempest-GroupSnapshotsTest-1488589904 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:25:31 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-d476e5e8-244e-4de3-992a-c68e763dbafc tempest-GroupSnapshotsTest-1488589904 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:25:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d476e5e8-244e-4de3-992a-c68e763dbafc tempest-GroupSnapshotsTest-1488589904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1cc985e1-5cf3-4001-b8d7-7c75c01d72d4 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:31 devstack sudo[104442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1cc985e1-5cf3-4001-b8d7-7c75c01d72d4 1073741824 Nov 04 12:25:31 devstack sudo[104442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:32 devstack sudo[104435]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e826fa96-6a86-460e-a3f8-c59790e2ebc2 tempest-CinderUnicodeTest-835344334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bd91ecad-65b1-4745-8948-e69ad9e008a3.0d54c4fa-003b-4b9e-8f50-329b17f0c46d" returned: 0 in 0.527s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e826fa96-6a86-460e-a3f8-c59790e2ebc2 tempest-CinderUnicodeTest-835344334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bd91ecad-65b1-4745-8948-e69ad9e008a3.0d54c4fa-003b-4b9e-8f50-329b17f0c46d {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:32 devstack sudo[104445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bd91ecad-65b1-4745-8948-e69ad9e008a3.0d54c4fa-003b-4b9e-8f50-329b17f0c46d Nov 04 12:25:32 devstack sudo[104445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:32 devstack sudo[104445]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e826fa96-6a86-460e-a3f8-c59790e2ebc2 tempest-CinderUnicodeTest-835344334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bd91ecad-65b1-4745-8948-e69ad9e008a3.0d54c4fa-003b-4b9e-8f50-329b17f0c46d" returned: 0 in 0.288s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:32 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e826fa96-6a86-460e-a3f8-c59790e2ebc2 tempest-CinderUnicodeTest-835344334 None] Lock "cinder-quobyte-0d54c4fa-003b-4b9e-8f50-329b17f0c46d" released by "_delete_snapshot" :: held 1.849s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:25:32 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e826fa96-6a86-460e-a3f8-c59790e2ebc2 tempest-CinderUnicodeTest-835344334 None] Lock "cinder-quobyte-bd91ecad-65b1-4745-8948-e69ad9e008a3" released by "delete_snapshot" :: held 1.876s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:25:32 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-e826fa96-6a86-460e-a3f8-c59790e2ebc2 tempest-CinderUnicodeTest-835344334 None] Created reservations ['32d7bf1b-da09-4581-b703-76c2b5ad22db', 'e56175ca-c45b-4469-8e10-ce6ac51bdab4', 'fede31d5-cef2-408f-af54-cadf3452cfed', 'c9a6f0ef-fdf1-4fa9-98d4-86900a1da0d0'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:25:32 devstack sudo[104442]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d476e5e8-244e-4de3-992a-c68e763dbafc tempest-GroupSnapshotsTest-1488589904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1cc985e1-5cf3-4001-b8d7-7c75c01d72d4 1073741824" returned: 0 in 0.602s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d476e5e8-244e-4de3-992a-c68e763dbafc tempest-GroupSnapshotsTest-1488589904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1cc985e1-5cf3-4001-b8d7-7c75c01d72d4 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:32 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-e826fa96-6a86-460e-a3f8-c59790e2ebc2 tempest-CinderUnicodeTest-835344334 None] Delete snapshot completed successfully. Nov 04 12:25:32 devstack sudo[104452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1cc985e1-5cf3-4001-b8d7-7c75c01d72d4 Nov 04 12:25:32 devstack sudo[104452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:32 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e826fa96-6a86-460e-a3f8-c59790e2ebc2 tempest-CinderUnicodeTest-835344334 None] Lock "cinder-0d54c4fa-003b-4b9e-8f50-329b17f0c46d-delete_snapshot" released by "delete_snapshot" :: held 2.087s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:25:32 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c9f9eda3-24a5-41ea-bcf3-3f0c8754e3da tempest-CinderUnicodeTest-835344334 None] Acquiring lock "cinder-bd91ecad-65b1-4745-8948-e69ad9e008a3-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:25:32 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c9f9eda3-24a5-41ea-bcf3-3f0c8754e3da tempest-CinderUnicodeTest-835344334 None] Lock "cinder-bd91ecad-65b1-4745-8948-e69ad9e008a3-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:25:32 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c9f9eda3-24a5-41ea-bcf3-3f0c8754e3da tempest-CinderUnicodeTest-835344334 None] Acquiring lock "cinder-quobyte-bd91ecad-65b1-4745-8948-e69ad9e008a3" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:25:32 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c9f9eda3-24a5-41ea-bcf3-3f0c8754e3da tempest-CinderUnicodeTest-835344334 None] Lock "cinder-quobyte-bd91ecad-65b1-4745-8948-e69ad9e008a3" acquired by "delete_volume" :: waited 0.031s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:25:32 devstack sudo[104452]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d476e5e8-244e-4de3-992a-c68e763dbafc tempest-GroupSnapshotsTest-1488589904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1cc985e1-5cf3-4001-b8d7-7c75c01d72d4" returned: 0 in 0.382s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:32 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d476e5e8-244e-4de3-992a-c68e763dbafc tempest-GroupSnapshotsTest-1488589904 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:25:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d476e5e8-244e-4de3-992a-c68e763dbafc tempest-GroupSnapshotsTest-1488589904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:25:32 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a2fef1-6b7c-46ad-8ea5-85f39af12e81]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:25:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c9f9eda3-24a5-41ea-bcf3-3f0c8754e3da tempest-CinderUnicodeTest-835344334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bd91ecad-65b1-4745-8948-e69ad9e008a3 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d476e5e8-244e-4de3-992a-c68e763dbafc tempest-GroupSnapshotsTest-1488589904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a40067e4-0395-4462-9616-88077e3d922b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cc985e1-5cf3-4001-b8d7-7c75c01d72d4', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:25:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d476e5e8-244e-4de3-992a-c68e763dbafc tempest-GroupSnapshotsTest-1488589904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24c0f69b-8a67-4d26-aa4d-9fb502e25a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:25:32 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-d476e5e8-244e-4de3-992a-c68e763dbafc tempest-GroupSnapshotsTest-1488589904 None] Volume volume-1cc985e1-5cf3-4001-b8d7-7c75c01d72d4 (1cc985e1-5cf3-4001-b8d7-7c75c01d72d4): created successfully Nov 04 12:25:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d476e5e8-244e-4de3-992a-c68e763dbafc tempest-GroupSnapshotsTest-1488589904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24c0f69b-8a67-4d26-aa4d-9fb502e25a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:25:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d476e5e8-244e-4de3-992a-c68e763dbafc tempest-GroupSnapshotsTest-1488589904 None] Flow 'volume_create_manager' (2f687370-747f-49b8-ada9-76b305266906) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:25:32 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-d476e5e8-244e-4de3-992a-c68e763dbafc tempest-GroupSnapshotsTest-1488589904 None] Created volume successfully. Nov 04 12:25:33 devstack sudo[104455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bd91ecad-65b1-4745-8948-e69ad9e008a3 Nov 04 12:25:33 devstack sudo[104455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:33 devstack sudo[104455]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c9f9eda3-24a5-41ea-bcf3-3f0c8754e3da tempest-CinderUnicodeTest-835344334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bd91ecad-65b1-4745-8948-e69ad9e008a3" returned: 0 in 0.409s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c9f9eda3-24a5-41ea-bcf3-3f0c8754e3da tempest-CinderUnicodeTest-835344334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bd91ecad-65b1-4745-8948-e69ad9e008a3 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:33 devstack sudo[104462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bd91ecad-65b1-4745-8948-e69ad9e008a3 Nov 04 12:25:33 devstack sudo[104462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:33 devstack sudo[104462]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c9f9eda3-24a5-41ea-bcf3-3f0c8754e3da tempest-CinderUnicodeTest-835344334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bd91ecad-65b1-4745-8948-e69ad9e008a3" returned: 0 in 0.321s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:33 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c9f9eda3-24a5-41ea-bcf3-3f0c8754e3da tempest-CinderUnicodeTest-835344334 None] Lock "cinder-quobyte-bd91ecad-65b1-4745-8948-e69ad9e008a3" released by "delete_volume" :: held 0.857s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:25:33 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-c9f9eda3-24a5-41ea-bcf3-3f0c8754e3da tempest-CinderUnicodeTest-835344334 None] Created reservations ['e1448769-d8e9-4135-933c-1bda2e7f3b96', 'c0155cff-d231-4ffb-aeaa-c9aa6c44c959', '406984d3-84f6-4a4d-ab2d-d99dd934349b', 'e7a8c95e-dd5c-47b7-9f2b-bcbe3ddb5af1'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:25:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c9f9eda3-24a5-41ea-bcf3-3f0c8754e3da tempest-CinderUnicodeTest-835344334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:25:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c9f9eda3-24a5-41ea-bcf3-3f0c8754e3da tempest-CinderUnicodeTest-835344334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:25:33 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c9f9eda3-24a5-41ea-bcf3-3f0c8754e3da tempest-CinderUnicodeTest-835344334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:25:33 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c9f9eda3-24a5-41ea-bcf3-3f0c8754e3da tempest-CinderUnicodeTest-835344334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:25:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c9f9eda3-24a5-41ea-bcf3-3f0c8754e3da tempest-CinderUnicodeTest-835344334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:25:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c9f9eda3-24a5-41ea-bcf3-3f0c8754e3da tempest-CinderUnicodeTest-835344334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:33 devstack sudo[104486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:25:33 devstack sudo[104486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:34 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b07fcbf0-c68e-4103-b83f-5f8a9f81f8a6 tempest-CinderUnicodeTest-835344334 None] Acquiring lock "cinder-4f50c2f5-a1e4-4d7d-ad67-548fa26ce7e7-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:25:34 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b07fcbf0-c68e-4103-b83f-5f8a9f81f8a6 tempest-CinderUnicodeTest-835344334 None] Lock "cinder-4f50c2f5-a1e4-4d7d-ad67-548fa26ce7e7-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:25:34 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b07fcbf0-c68e-4103-b83f-5f8a9f81f8a6 tempest-CinderUnicodeTest-835344334 None] Acquiring lock "cinder-quobyte-4f50c2f5-a1e4-4d7d-ad67-548fa26ce7e7" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:25:34 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b07fcbf0-c68e-4103-b83f-5f8a9f81f8a6 tempest-CinderUnicodeTest-835344334 None] Lock "cinder-quobyte-4f50c2f5-a1e4-4d7d-ad67-548fa26ce7e7" acquired by "delete_volume" :: waited 0.035s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:25:34 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce8529f-237a-4c30-947d-ea5ddc7672e6]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:25:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b07fcbf0-c68e-4103-b83f-5f8a9f81f8a6 tempest-CinderUnicodeTest-835344334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4f50c2f5-a1e4-4d7d-ad67-548fa26ce7e7 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:34 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-b248b65e-7b5e-4ed8-b0e5-33550436286a req-bde9fe30-d0d8-4311-8152-60a57b0f7647 tempest-TestShelveInstance-181440490 None] Terminate volume connection completed successfully. Nov 04 12:25:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-b248b65e-7b5e-4ed8-b0e5-33550436286a req-bde9fe30-d0d8-4311-8152-60a57b0f7647 tempest-TestShelveInstance-181440490 None] Deleting attachment ec79918f-6d8e-40da-a1e3-e572b21f5423. {{(pid=87095) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 12:25:34 devstack sudo[104486]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c9f9eda3-24a5-41ea-bcf3-3f0c8754e3da tempest-CinderUnicodeTest-835344334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.408s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:34 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-c9f9eda3-24a5-41ea-bcf3-3f0c8754e3da tempest-CinderUnicodeTest-835344334 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:25:34 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-c9f9eda3-24a5-41ea-bcf3-3f0c8754e3da tempest-CinderUnicodeTest-835344334 None] Deleted volume successfully. Nov 04 12:25:34 devstack sudo[104488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4f50c2f5-a1e4-4d7d-ad67-548fa26ce7e7 Nov 04 12:25:34 devstack sudo[104488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:34 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c9f9eda3-24a5-41ea-bcf3-3f0c8754e3da tempest-CinderUnicodeTest-835344334 None] Lock "cinder-bd91ecad-65b1-4745-8948-e69ad9e008a3-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:25:34 devstack sudo[104488]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b07fcbf0-c68e-4103-b83f-5f8a9f81f8a6 tempest-CinderUnicodeTest-835344334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4f50c2f5-a1e4-4d7d-ad67-548fa26ce7e7" returned: 0 in 0.452s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b07fcbf0-c68e-4103-b83f-5f8a9f81f8a6 tempest-CinderUnicodeTest-835344334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4f50c2f5-a1e4-4d7d-ad67-548fa26ce7e7 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:34 devstack sudo[104495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4f50c2f5-a1e4-4d7d-ad67-548fa26ce7e7 Nov 04 12:25:34 devstack sudo[104495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:34 devstack sudo[104495]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b07fcbf0-c68e-4103-b83f-5f8a9f81f8a6 tempest-CinderUnicodeTest-835344334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4f50c2f5-a1e4-4d7d-ad67-548fa26ce7e7" returned: 0 in 0.305s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:34 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b07fcbf0-c68e-4103-b83f-5f8a9f81f8a6 tempest-CinderUnicodeTest-835344334 None] Lock "cinder-quobyte-4f50c2f5-a1e4-4d7d-ad67-548fa26ce7e7" released by "delete_volume" :: held 0.821s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:25:35 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-b07fcbf0-c68e-4103-b83f-5f8a9f81f8a6 tempest-CinderUnicodeTest-835344334 None] Created reservations ['c9e0390e-2f12-4fec-8b28-b64cb542c5bb', '2f4e9bdd-5d0b-4b80-b4e8-0b2ca36d86d9', 'e02f2ee8-798c-4540-997c-1cc1d463fe79', '7ed8c7a8-7c34-434d-8f0d-f6781d96b28f'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:25:35 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-d21a7353-4ab1-4b21-a03a-5e82a4d8ded1 tempest-GroupSnapshotsTest-1488589904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:25:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d21a7353-4ab1-4b21-a03a-5e82a4d8ded1 tempest-GroupSnapshotsTest-1488589904 None] Flow 'volume_create_manager' (5217c14f-7358-40ab-85e7-6ada7d96443c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:25:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d21a7353-4ab1-4b21-a03a-5e82a4d8ded1 tempest-GroupSnapshotsTest-1488589904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d17e7f13-83bc-4a54-86a4-67b2bb2cb6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:25:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d21a7353-4ab1-4b21-a03a-5e82a4d8ded1 tempest-GroupSnapshotsTest-1488589904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d17e7f13-83bc-4a54-86a4-67b2bb2cb6e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-844980548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e9c8d19f-fcdc-488b-8b6b-3f69387bbb14,host='devstack@QuobyteHD#QuobyteHD',id=b2e0458c-6d38-4295-b908-6b85329a58fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6740e312316a4752b9477b306727b158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:25:35Z,use_quota=True,user_id='e00bfc613c6743edb2db220f7cc9b5ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ea9be12-f8f7-449c-a9b8-e8ac6251e498),volume_type_id=1ea9be12-f8f7-449c-a9b8-e8ac6251e498)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:25:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d21a7353-4ab1-4b21-a03a-5e82a4d8ded1 tempest-GroupSnapshotsTest-1488589904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eedcc5a5-8dae-41d7-ad70-cdc189a9f78f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:25:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d21a7353-4ab1-4b21-a03a-5e82a4d8ded1 tempest-GroupSnapshotsTest-1488589904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eedcc5a5-8dae-41d7-ad70-cdc189a9f78f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:25:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d21a7353-4ab1-4b21-a03a-5e82a4d8ded1 tempest-GroupSnapshotsTest-1488589904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (281a79fb-037d-4d7e-9717-522bab1d518e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:25:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d21a7353-4ab1-4b21-a03a-5e82a4d8ded1 tempest-GroupSnapshotsTest-1488589904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (281a79fb-037d-4d7e-9717-522bab1d518e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2e0458c-6d38-4295-b908-6b85329a58fb', 'volume_name': 'volume-b2e0458c-6d38-4295-b908-6b85329a58fb', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:25:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d21a7353-4ab1-4b21-a03a-5e82a4d8ded1 tempest-GroupSnapshotsTest-1488589904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23194c77-6177-4385-843f-a97bde9ee033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:25:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d21a7353-4ab1-4b21-a03a-5e82a4d8ded1 tempest-GroupSnapshotsTest-1488589904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23194c77-6177-4385-843f-a97bde9ee033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:25:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d21a7353-4ab1-4b21-a03a-5e82a4d8ded1 tempest-GroupSnapshotsTest-1488589904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be95d4d4-33df-4da3-bffb-6d16b8345eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:25:35 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-d21a7353-4ab1-4b21-a03a-5e82a4d8ded1 tempest-GroupSnapshotsTest-1488589904 None] Volume b2e0458c-6d38-4295-b908-6b85329a58fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2e0458c-6d38-4295-b908-6b85329a58fb', 'volume_size': 1} Nov 04 12:25:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d21a7353-4ab1-4b21-a03a-5e82a4d8ded1 tempest-GroupSnapshotsTest-1488589904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:25:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d21a7353-4ab1-4b21-a03a-5e82a4d8ded1 tempest-GroupSnapshotsTest-1488589904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:25:35 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d21a7353-4ab1-4b21-a03a-5e82a4d8ded1 tempest-GroupSnapshotsTest-1488589904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e9c8d19f-fcdc-488b-8b6b-3f69387bbb14,created_at=2026-11-04T11:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-844980548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e9c8d19f-fcdc-488b-8b6b-3f69387bbb14,host='devstack@QuobyteHD#QuobyteHD',id=b2e0458c-6d38-4295-b908-6b85329a58fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6740e312316a4752b9477b306727b158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:25:35Z,use_quota=True,user_id='e00bfc613c6743edb2db220f7cc9b5ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ea9be12-f8f7-449c-a9b8-e8ac6251e498),volume_type_id=1ea9be12-f8f7-449c-a9b8-e8ac6251e498)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:25:35 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-d21a7353-4ab1-4b21-a03a-5e82a4d8ded1 tempest-GroupSnapshotsTest-1488589904 None] Creating volume b2e0458c-6d38-4295-b908-6b85329a58fb {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:25:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d21a7353-4ab1-4b21-a03a-5e82a4d8ded1 tempest-GroupSnapshotsTest-1488589904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:25:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d21a7353-4ab1-4b21-a03a-5e82a4d8ded1 tempest-GroupSnapshotsTest-1488589904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:25:35 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d21a7353-4ab1-4b21-a03a-5e82a4d8ded1 tempest-GroupSnapshotsTest-1488589904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:25:35 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d21a7353-4ab1-4b21-a03a-5e82a4d8ded1 tempest-GroupSnapshotsTest-1488589904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:25:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d21a7353-4ab1-4b21-a03a-5e82a4d8ded1 tempest-GroupSnapshotsTest-1488589904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:25:35 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d21a7353-4ab1-4b21-a03a-5e82a4d8ded1 tempest-GroupSnapshotsTest-1488589904 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:25:35 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-d21a7353-4ab1-4b21-a03a-5e82a4d8ded1 tempest-GroupSnapshotsTest-1488589904 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:25:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d21a7353-4ab1-4b21-a03a-5e82a4d8ded1 tempest-GroupSnapshotsTest-1488589904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b2e0458c-6d38-4295-b908-6b85329a58fb 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:35 devstack sudo[104498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b2e0458c-6d38-4295-b908-6b85329a58fb 1073741824 Nov 04 12:25:35 devstack sudo[104498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b07fcbf0-c68e-4103-b83f-5f8a9f81f8a6 tempest-CinderUnicodeTest-835344334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:25:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b07fcbf0-c68e-4103-b83f-5f8a9f81f8a6 tempest-CinderUnicodeTest-835344334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:25:35 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b07fcbf0-c68e-4103-b83f-5f8a9f81f8a6 tempest-CinderUnicodeTest-835344334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:25:35 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b07fcbf0-c68e-4103-b83f-5f8a9f81f8a6 tempest-CinderUnicodeTest-835344334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:25:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b07fcbf0-c68e-4103-b83f-5f8a9f81f8a6 tempest-CinderUnicodeTest-835344334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:25:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b07fcbf0-c68e-4103-b83f-5f8a9f81f8a6 tempest-CinderUnicodeTest-835344334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:35 devstack sudo[104500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:25:35 devstack sudo[104500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:35 devstack sudo[104500]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b07fcbf0-c68e-4103-b83f-5f8a9f81f8a6 tempest-CinderUnicodeTest-835344334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.282s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:35 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-b07fcbf0-c68e-4103-b83f-5f8a9f81f8a6 tempest-CinderUnicodeTest-835344334 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:25:35 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-b07fcbf0-c68e-4103-b83f-5f8a9f81f8a6 tempest-CinderUnicodeTest-835344334 None] Deleted volume successfully. Nov 04 12:25:35 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b07fcbf0-c68e-4103-b83f-5f8a9f81f8a6 tempest-CinderUnicodeTest-835344334 None] Lock "cinder-4f50c2f5-a1e4-4d7d-ad67-548fa26ce7e7-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:25:35 devstack sudo[104498]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d21a7353-4ab1-4b21-a03a-5e82a4d8ded1 tempest-GroupSnapshotsTest-1488589904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b2e0458c-6d38-4295-b908-6b85329a58fb 1073741824" returned: 0 in 0.525s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d21a7353-4ab1-4b21-a03a-5e82a4d8ded1 tempest-GroupSnapshotsTest-1488589904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b2e0458c-6d38-4295-b908-6b85329a58fb {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:35 devstack sudo[104506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b2e0458c-6d38-4295-b908-6b85329a58fb Nov 04 12:25:35 devstack sudo[104506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:35 devstack sudo[104506]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d21a7353-4ab1-4b21-a03a-5e82a4d8ded1 tempest-GroupSnapshotsTest-1488589904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b2e0458c-6d38-4295-b908-6b85329a58fb" returned: 0 in 0.264s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:36 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d21a7353-4ab1-4b21-a03a-5e82a4d8ded1 tempest-GroupSnapshotsTest-1488589904 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:25:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d21a7353-4ab1-4b21-a03a-5e82a4d8ded1 tempest-GroupSnapshotsTest-1488589904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:25:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d21a7353-4ab1-4b21-a03a-5e82a4d8ded1 tempest-GroupSnapshotsTest-1488589904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be95d4d4-33df-4da3-bffb-6d16b8345eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2e0458c-6d38-4295-b908-6b85329a58fb', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:25:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d21a7353-4ab1-4b21-a03a-5e82a4d8ded1 tempest-GroupSnapshotsTest-1488589904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae3b4ed1-f0c9-4cb8-b889-c8dd7e4f6118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:25:36 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-d21a7353-4ab1-4b21-a03a-5e82a4d8ded1 tempest-GroupSnapshotsTest-1488589904 None] Volume volume-b2e0458c-6d38-4295-b908-6b85329a58fb (b2e0458c-6d38-4295-b908-6b85329a58fb): created successfully Nov 04 12:25:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d21a7353-4ab1-4b21-a03a-5e82a4d8ded1 tempest-GroupSnapshotsTest-1488589904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae3b4ed1-f0c9-4cb8-b889-c8dd7e4f6118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:25:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d21a7353-4ab1-4b21-a03a-5e82a4d8ded1 tempest-GroupSnapshotsTest-1488589904 None] Flow 'volume_create_manager' (5217c14f-7358-40ab-85e7-6ada7d96443c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:25:36 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-d21a7353-4ab1-4b21-a03a-5e82a4d8ded1 tempest-GroupSnapshotsTest-1488589904 None] Created volume successfully. Nov 04 12:25:36 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-784273f1-883e-4529-8c16-e328f2d46589 tempest-GroupSnapshotsTest-1488589904 None] Update group completed successfully. Nov 04 12:25:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-018a3e2e-61a0-4629-8c1f-abc56a4f1638 req-babe7184-6a17-4854-9b46-86bd26b2f85b tempest-TestShelveInstance-181440490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:25:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-018a3e2e-61a0-4629-8c1f-abc56a4f1638 req-babe7184-6a17-4854-9b46-86bd26b2f85b tempest-TestShelveInstance-181440490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:25:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-018a3e2e-61a0-4629-8c1f-abc56a4f1638 req-babe7184-6a17-4854-9b46-86bd26b2f85b tempest-TestShelveInstance-181440490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:25:37 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-018a3e2e-61a0-4629-8c1f-abc56a4f1638 req-babe7184-6a17-4854-9b46-86bd26b2f85b tempest-TestShelveInstance-181440490 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784', 'name': 'volume-3657e41b-da17-451a-8749-edb5fed7bcd6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7d8609d9-2d05-4506-bc6b-f16c8c5e6e58', 'enforce_multipath': True} {{(pid=87095) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 12:25:37 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-018a3e2e-61a0-4629-8c1f-abc56a4f1638 req-babe7184-6a17-4854-9b46-86bd26b2f85b tempest-TestShelveInstance-181440490 None] attachment_update completed successfully. Nov 04 12:25:37 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-75209a32-ec9d-4f21-b339-46d667229e68 tempest-GroupSnapshotsTest-1488589904 None] Update group completed successfully. Nov 04 12:25:38 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-2caa6a0e-296b-4faf-8cec-9e8d9b010709 tempest-GroupSnapshotsTest-1488589904 None] Update group completed successfully. Nov 04 12:25:40 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-8282d403-0cf0-473d-843a-5ce879dd7c18 tempest-GroupSnapshotsTest-1488589904 None] Update group completed successfully. Nov 04 12:25:40 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-46df59fc-d90a-47e0-82bb-033a522b8646 tempest-ProjectReaderTests-1986742016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:25:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-46df59fc-d90a-47e0-82bb-033a522b8646 tempest-ProjectReaderTests-1986742016 None] Flow 'volume_create_manager' (b86ce089-2ac9-453a-83c1-c4a6ca78dc35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:25:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-46df59fc-d90a-47e0-82bb-033a522b8646 tempest-ProjectReaderTests-1986742016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb763be3-2fa0-4430-aa4a-74b902cc5650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:25:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-46df59fc-d90a-47e0-82bb-033a522b8646 tempest-ProjectReaderTests-1986742016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb763be3-2fa0-4430-aa4a-74b902cc5650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:25:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-375754401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05a8d487-b990-4076-a2df-28feeba3ee0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c46e6d7f8e94fa2a7fab2cdcc7ce515',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:25:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:25:40Z,use_quota=True,user_id='365b9962642b4f23add13335e39cf66e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:25:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-46df59fc-d90a-47e0-82bb-033a522b8646 tempest-ProjectReaderTests-1986742016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8d08438-a19b-4b53-a584-83b843bd09df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:25:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-46df59fc-d90a-47e0-82bb-033a522b8646 tempest-ProjectReaderTests-1986742016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8d08438-a19b-4b53-a584-83b843bd09df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:25:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-46df59fc-d90a-47e0-82bb-033a522b8646 tempest-ProjectReaderTests-1986742016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd7b1697-e4fd-49c2-a69b-f244af05aa82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:25:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-46df59fc-d90a-47e0-82bb-033a522b8646 tempest-ProjectReaderTests-1986742016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd7b1697-e4fd-49c2-a69b-f244af05aa82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05a8d487-b990-4076-a2df-28feeba3ee0b', 'volume_name': 'volume-05a8d487-b990-4076-a2df-28feeba3ee0b', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:25:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-46df59fc-d90a-47e0-82bb-033a522b8646 tempest-ProjectReaderTests-1986742016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4390b59e-9f3b-4a00-9124-5dc48fe754ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:25:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-46df59fc-d90a-47e0-82bb-033a522b8646 tempest-ProjectReaderTests-1986742016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4390b59e-9f3b-4a00-9124-5dc48fe754ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:25:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-46df59fc-d90a-47e0-82bb-033a522b8646 tempest-ProjectReaderTests-1986742016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aaac5d3-52cf-416b-95b3-36f71dfe676d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:25:40 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-46df59fc-d90a-47e0-82bb-033a522b8646 tempest-ProjectReaderTests-1986742016 None] Volume 05a8d487-b990-4076-a2df-28feeba3ee0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05a8d487-b990-4076-a2df-28feeba3ee0b', 'volume_size': 1} Nov 04 12:25:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-46df59fc-d90a-47e0-82bb-033a522b8646 tempest-ProjectReaderTests-1986742016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:25:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-46df59fc-d90a-47e0-82bb-033a522b8646 tempest-ProjectReaderTests-1986742016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:25:40 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-46df59fc-d90a-47e0-82bb-033a522b8646 tempest-ProjectReaderTests-1986742016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:25:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-375754401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05a8d487-b990-4076-a2df-28feeba3ee0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c46e6d7f8e94fa2a7fab2cdcc7ce515',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:25:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:25:40Z,use_quota=True,user_id='365b9962642b4f23add13335e39cf66e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:25:40 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-46df59fc-d90a-47e0-82bb-033a522b8646 tempest-ProjectReaderTests-1986742016 None] Creating volume 05a8d487-b990-4076-a2df-28feeba3ee0b {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:25:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-46df59fc-d90a-47e0-82bb-033a522b8646 tempest-ProjectReaderTests-1986742016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:25:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-46df59fc-d90a-47e0-82bb-033a522b8646 tempest-ProjectReaderTests-1986742016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:25:40 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-46df59fc-d90a-47e0-82bb-033a522b8646 tempest-ProjectReaderTests-1986742016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:25:40 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-46df59fc-d90a-47e0-82bb-033a522b8646 tempest-ProjectReaderTests-1986742016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:25:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-46df59fc-d90a-47e0-82bb-033a522b8646 tempest-ProjectReaderTests-1986742016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:25:40 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-46df59fc-d90a-47e0-82bb-033a522b8646 tempest-ProjectReaderTests-1986742016 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:25:40 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-46df59fc-d90a-47e0-82bb-033a522b8646 tempest-ProjectReaderTests-1986742016 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:25:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-46df59fc-d90a-47e0-82bb-033a522b8646 tempest-ProjectReaderTests-1986742016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-05a8d487-b990-4076-a2df-28feeba3ee0b 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:40 devstack sudo[104579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-05a8d487-b990-4076-a2df-28feeba3ee0b 1073741824 Nov 04 12:25:40 devstack sudo[104579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:41 devstack sudo[104579]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-46df59fc-d90a-47e0-82bb-033a522b8646 tempest-ProjectReaderTests-1986742016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-05a8d487-b990-4076-a2df-28feeba3ee0b 1073741824" returned: 0 in 0.892s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-46df59fc-d90a-47e0-82bb-033a522b8646 tempest-ProjectReaderTests-1986742016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-05a8d487-b990-4076-a2df-28feeba3ee0b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:41 devstack sudo[104980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-05a8d487-b990-4076-a2df-28feeba3ee0b Nov 04 12:25:41 devstack sudo[104980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:41 devstack sudo[104980]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-46df59fc-d90a-47e0-82bb-033a522b8646 tempest-ProjectReaderTests-1986742016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-05a8d487-b990-4076-a2df-28feeba3ee0b" returned: 0 in 0.494s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:41 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-46df59fc-d90a-47e0-82bb-033a522b8646 tempest-ProjectReaderTests-1986742016 None] <== create_volume: return (1477ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:25:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-46df59fc-d90a-47e0-82bb-033a522b8646 tempest-ProjectReaderTests-1986742016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.480s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:25:41 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-46df59fc-d90a-47e0-82bb-033a522b8646 tempest-ProjectReaderTests-1986742016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aaac5d3-52cf-416b-95b3-36f71dfe676d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05a8d487-b990-4076-a2df-28feeba3ee0b', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:25:41 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-46df59fc-d90a-47e0-82bb-033a522b8646 tempest-ProjectReaderTests-1986742016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a12bcfc1-0a32-4ad8-9140-12cfa10b2b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:25:41 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-46df59fc-d90a-47e0-82bb-033a522b8646 tempest-ProjectReaderTests-1986742016 None] Volume volume-05a8d487-b990-4076-a2df-28feeba3ee0b (05a8d487-b990-4076-a2df-28feeba3ee0b): created successfully Nov 04 12:25:41 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-46df59fc-d90a-47e0-82bb-033a522b8646 tempest-ProjectReaderTests-1986742016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a12bcfc1-0a32-4ad8-9140-12cfa10b2b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:25:41 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-46df59fc-d90a-47e0-82bb-033a522b8646 tempest-ProjectReaderTests-1986742016 None] Flow 'volume_create_manager' (b86ce089-2ac9-453a-83c1-c4a6ca78dc35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:25:41 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-46df59fc-d90a-47e0-82bb-033a522b8646 tempest-ProjectReaderTests-1986742016 None] Created volume successfully. Nov 04 12:25:42 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-abc73884-ba1f-41ba-aa85-3cba819309bc tempest-GroupSnapshotsTest-1488589904 None] GroupSnapshot f2dc5123-b01e-46c3-8b11-0ae8e31daa65: creating. Nov 04 12:25:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-abc73884-ba1f-41ba-aa85-3cba819309bc tempest-GroupSnapshotsTest-1488589904 None] Group snapshot f2dc5123-b01e-46c3-8b11-0ae8e31daa65: creating. {{(pid=87095) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 04 12:25:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-abc73884-ba1f-41ba-aa85-3cba819309bc tempest-GroupSnapshotsTest-1488589904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:25:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-abc73884-ba1f-41ba-aa85-3cba819309bc tempest-GroupSnapshotsTest-1488589904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:25:42 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-abc73884-ba1f-41ba-aa85-3cba819309bc tempest-GroupSnapshotsTest-1488589904 None] Creating offline snapshot 17b81918-cc30-495a-b8bf-ab68e46125db of volume 1cc985e1-5cf3-4001-b8d7-7c75c01d72d4 {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 12:25:42 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d39730f0-4f84-4089-bf32-13bdd68d393b]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:25:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-abc73884-ba1f-41ba-aa85-3cba819309bc tempest-GroupSnapshotsTest-1488589904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1cc985e1-5cf3-4001-b8d7-7c75c01d72d4 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:42 devstack sudo[105007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1cc985e1-5cf3-4001-b8d7-7c75c01d72d4 Nov 04 12:25:42 devstack sudo[105007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:42 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-91789540-46af-4ed8-a91f-4222f267dd00 tempest-ProjectReaderTests-1986742016 None] Acquiring lock "cinder-05a8d487-b990-4076-a2df-28feeba3ee0b-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:25:42 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-91789540-46af-4ed8-a91f-4222f267dd00 tempest-ProjectReaderTests-1986742016 None] Lock "cinder-05a8d487-b990-4076-a2df-28feeba3ee0b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:25:42 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-91789540-46af-4ed8-a91f-4222f267dd00 tempest-ProjectReaderTests-1986742016 None] Acquiring lock "cinder-quobyte-05a8d487-b990-4076-a2df-28feeba3ee0b" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:25:42 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-91789540-46af-4ed8-a91f-4222f267dd00 tempest-ProjectReaderTests-1986742016 None] Lock "cinder-quobyte-05a8d487-b990-4076-a2df-28feeba3ee0b" acquired by "delete_volume" :: waited 0.021s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:25:42 devstack sudo[105007]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-abc73884-ba1f-41ba-aa85-3cba819309bc tempest-GroupSnapshotsTest-1488589904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1cc985e1-5cf3-4001-b8d7-7c75c01d72d4" returned: 0 in 0.527s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-abc73884-ba1f-41ba-aa85-3cba819309bc tempest-GroupSnapshotsTest-1488589904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1cc985e1-5cf3-4001-b8d7-7c75c01d72d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1cc985e1-5cf3-4001-b8d7-7c75c01d72d4.17b81918-cc30-495a-b8bf-ab68e46125db 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:42 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[7944a85e-f254-4a27-8436-34903d4b12f1]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:25:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-91789540-46af-4ed8-a91f-4222f267dd00 tempest-ProjectReaderTests-1986742016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-05a8d487-b990-4076-a2df-28feeba3ee0b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:42 devstack sudo[105012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1cc985e1-5cf3-4001-b8d7-7c75c01d72d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1cc985e1-5cf3-4001-b8d7-7c75c01d72d4.17b81918-cc30-495a-b8bf-ab68e46125db 1G Nov 04 12:25:42 devstack sudo[105012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:42 devstack sudo[105014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-05a8d487-b990-4076-a2df-28feeba3ee0b Nov 04 12:25:42 devstack sudo[105014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:43 devstack sudo[105012]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-abc73884-ba1f-41ba-aa85-3cba819309bc tempest-GroupSnapshotsTest-1488589904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1cc985e1-5cf3-4001-b8d7-7c75c01d72d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1cc985e1-5cf3-4001-b8d7-7c75c01d72d4.17b81918-cc30-495a-b8bf-ab68e46125db 1G" returned: 0 in 0.534s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-abc73884-ba1f-41ba-aa85-3cba819309bc tempest-GroupSnapshotsTest-1488589904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cc985e1-5cf3-4001-b8d7-7c75c01d72d4 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1cc985e1-5cf3-4001-b8d7-7c75c01d72d4.17b81918-cc30-495a-b8bf-ab68e46125db {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:43 devstack sudo[105014]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-91789540-46af-4ed8-a91f-4222f267dd00 tempest-ProjectReaderTests-1986742016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-05a8d487-b990-4076-a2df-28feeba3ee0b" returned: 0 in 0.524s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-91789540-46af-4ed8-a91f-4222f267dd00 tempest-ProjectReaderTests-1986742016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-05a8d487-b990-4076-a2df-28feeba3ee0b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:43 devstack sudo[105026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cc985e1-5cf3-4001-b8d7-7c75c01d72d4 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1cc985e1-5cf3-4001-b8d7-7c75c01d72d4.17b81918-cc30-495a-b8bf-ab68e46125db Nov 04 12:25:43 devstack sudo[105026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:43 devstack sudo[105027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-05a8d487-b990-4076-a2df-28feeba3ee0b Nov 04 12:25:43 devstack sudo[105027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:43 devstack sudo[105027]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-91789540-46af-4ed8-a91f-4222f267dd00 tempest-ProjectReaderTests-1986742016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-05a8d487-b990-4076-a2df-28feeba3ee0b" returned: 0 in 0.296s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:43 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-91789540-46af-4ed8-a91f-4222f267dd00 tempest-ProjectReaderTests-1986742016 None] Lock "cinder-quobyte-05a8d487-b990-4076-a2df-28feeba3ee0b" released by "delete_volume" :: held 0.905s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:25:43 devstack sudo[105026]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-abc73884-ba1f-41ba-aa85-3cba819309bc tempest-GroupSnapshotsTest-1488589904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cc985e1-5cf3-4001-b8d7-7c75c01d72d4 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1cc985e1-5cf3-4001-b8d7-7c75c01d72d4.17b81918-cc30-495a-b8bf-ab68e46125db" returned: 0 in 0.356s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:43 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-abc73884-ba1f-41ba-aa85-3cba819309bc tempest-GroupSnapshotsTest-1488589904 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1cc985e1-5cf3-4001-b8d7-7c75c01d72d4.17b81918-cc30-495a-b8bf-ab68e46125db is being set with open permissions: ugo+rw: NotImplementedError Nov 04 12:25:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-abc73884-ba1f-41ba-aa85-3cba819309bc tempest-GroupSnapshotsTest-1488589904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1cc985e1-5cf3-4001-b8d7-7c75c01d72d4.17b81918-cc30-495a-b8bf-ab68e46125db {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:43 devstack sudo[105034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1cc985e1-5cf3-4001-b8d7-7c75c01d72d4.17b81918-cc30-495a-b8bf-ab68e46125db Nov 04 12:25:43 devstack sudo[105034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:43 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-91789540-46af-4ed8-a91f-4222f267dd00 tempest-ProjectReaderTests-1986742016 None] Created reservations ['22754c78-4ba5-44bd-af00-a79788f2ad7f', '2ff3295b-ffc6-4ec5-8055-54e0b64577b9', 'fc70fcc0-949a-4598-ba2e-8ff87842c68b', '185f733c-a933-4672-9b96-5990e3bc6b77'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:25:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-91789540-46af-4ed8-a91f-4222f267dd00 tempest-ProjectReaderTests-1986742016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:25:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-91789540-46af-4ed8-a91f-4222f267dd00 tempest-ProjectReaderTests-1986742016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:25:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-91789540-46af-4ed8-a91f-4222f267dd00 tempest-ProjectReaderTests-1986742016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:25:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-91789540-46af-4ed8-a91f-4222f267dd00 tempest-ProjectReaderTests-1986742016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:25:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-91789540-46af-4ed8-a91f-4222f267dd00 tempest-ProjectReaderTests-1986742016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:25:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-91789540-46af-4ed8-a91f-4222f267dd00 tempest-ProjectReaderTests-1986742016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:43 devstack sudo[105036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:25:43 devstack sudo[105036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:44 devstack sudo[105036]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-91789540-46af-4ed8-a91f-4222f267dd00 tempest-ProjectReaderTests-1986742016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.327s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:44 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-91789540-46af-4ed8-a91f-4222f267dd00 tempest-ProjectReaderTests-1986742016 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:25:44 devstack sudo[105034]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:44 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-91789540-46af-4ed8-a91f-4222f267dd00 tempest-ProjectReaderTests-1986742016 None] Deleted volume successfully. Nov 04 12:25:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-abc73884-ba1f-41ba-aa85-3cba819309bc tempest-GroupSnapshotsTest-1488589904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1cc985e1-5cf3-4001-b8d7-7c75c01d72d4.17b81918-cc30-495a-b8bf-ab68e46125db" returned: 0 in 0.531s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:44 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-91789540-46af-4ed8-a91f-4222f267dd00 tempest-ProjectReaderTests-1986742016 None] Lock "cinder-05a8d487-b990-4076-a2df-28feeba3ee0b-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:25:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-abc73884-ba1f-41ba-aa85-3cba819309bc tempest-GroupSnapshotsTest-1488589904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1cc985e1-5cf3-4001-b8d7-7c75c01d72d4.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:44 devstack sudo[105041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1cc985e1-5cf3-4001-b8d7-7c75c01d72d4.info Nov 04 12:25:44 devstack sudo[105041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:44 devstack sudo[105041]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-abc73884-ba1f-41ba-aa85-3cba819309bc tempest-GroupSnapshotsTest-1488589904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1cc985e1-5cf3-4001-b8d7-7c75c01d72d4.info" returned: 0 in 0.406s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:44 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-abc73884-ba1f-41ba-aa85-3cba819309bc tempest-GroupSnapshotsTest-1488589904 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1cc985e1-5cf3-4001-b8d7-7c75c01d72d4.info is being set with open permissions: ugo+rw: NotImplementedError Nov 04 12:25:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-abc73884-ba1f-41ba-aa85-3cba819309bc tempest-GroupSnapshotsTest-1488589904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1cc985e1-5cf3-4001-b8d7-7c75c01d72d4.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:44 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-32a2c3d2-eafc-478b-8d87-73bbfbcd3b80 tempest-ProjectReaderTests-1986742016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:25:44 devstack sudo[105044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1cc985e1-5cf3-4001-b8d7-7c75c01d72d4.info Nov 04 12:25:44 devstack sudo[105044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-32a2c3d2-eafc-478b-8d87-73bbfbcd3b80 tempest-ProjectReaderTests-1986742016 None] Flow 'volume_create_manager' (9eabe8d7-65c1-4bbc-9b9c-1c4a2f380ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:25:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-32a2c3d2-eafc-478b-8d87-73bbfbcd3b80 tempest-ProjectReaderTests-1986742016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82acc240-f86f-4ec1-8c1e-64be362d679f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:25:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-32a2c3d2-eafc-478b-8d87-73bbfbcd3b80 tempest-ProjectReaderTests-1986742016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82acc240-f86f-4ec1-8c1e-64be362d679f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:25:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-584619474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58b775ed-b8a6-4b3f-abe4-db584ad7663d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c46e6d7f8e94fa2a7fab2cdcc7ce515',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:25:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:25:45Z,use_quota=True,user_id='365b9962642b4f23add13335e39cf66e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:25:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-32a2c3d2-eafc-478b-8d87-73bbfbcd3b80 tempest-ProjectReaderTests-1986742016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eed0d916-4a1d-4959-b31d-4af512d6b934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:25:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-32a2c3d2-eafc-478b-8d87-73bbfbcd3b80 tempest-ProjectReaderTests-1986742016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eed0d916-4a1d-4959-b31d-4af512d6b934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:25:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-32a2c3d2-eafc-478b-8d87-73bbfbcd3b80 tempest-ProjectReaderTests-1986742016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d0dfd6d-5612-4501-ae1e-e0aa29c6b30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:25:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-32a2c3d2-eafc-478b-8d87-73bbfbcd3b80 tempest-ProjectReaderTests-1986742016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d0dfd6d-5612-4501-ae1e-e0aa29c6b30d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58b775ed-b8a6-4b3f-abe4-db584ad7663d', 'volume_name': 'volume-58b775ed-b8a6-4b3f-abe4-db584ad7663d', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:25:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-32a2c3d2-eafc-478b-8d87-73bbfbcd3b80 tempest-ProjectReaderTests-1986742016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8c10599-9133-4fe0-8884-7fd6abbbb98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:25:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-32a2c3d2-eafc-478b-8d87-73bbfbcd3b80 tempest-ProjectReaderTests-1986742016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8c10599-9133-4fe0-8884-7fd6abbbb98c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:25:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-32a2c3d2-eafc-478b-8d87-73bbfbcd3b80 tempest-ProjectReaderTests-1986742016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9009c946-dd88-4c13-99e8-cda1d712aeeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:25:44 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-32a2c3d2-eafc-478b-8d87-73bbfbcd3b80 tempest-ProjectReaderTests-1986742016 None] Volume 58b775ed-b8a6-4b3f-abe4-db584ad7663d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58b775ed-b8a6-4b3f-abe4-db584ad7663d', 'volume_size': 1} Nov 04 12:25:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-32a2c3d2-eafc-478b-8d87-73bbfbcd3b80 tempest-ProjectReaderTests-1986742016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:25:44 devstack sudo[105044]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-abc73884-ba1f-41ba-aa85-3cba819309bc tempest-GroupSnapshotsTest-1488589904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1cc985e1-5cf3-4001-b8d7-7c75c01d72d4.info" returned: 0 in 0.290s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-abc73884-ba1f-41ba-aa85-3cba819309bc tempest-GroupSnapshotsTest-1488589904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.796s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:25:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-abc73884-ba1f-41ba-aa85-3cba819309bc tempest-GroupSnapshotsTest-1488589904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:25:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-abc73884-ba1f-41ba-aa85-3cba819309bc tempest-GroupSnapshotsTest-1488589904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:25:44 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-abc73884-ba1f-41ba-aa85-3cba819309bc tempest-GroupSnapshotsTest-1488589904 None] Creating offline snapshot ff7c7168-7ddb-44b2-84ce-0b526c595c58 of volume b2e0458c-6d38-4295-b908-6b85329a58fb {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 12:25:44 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c54a3bec-f8be-4a4b-93f2-557ac01e2a34]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:25:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-abc73884-ba1f-41ba-aa85-3cba819309bc tempest-GroupSnapshotsTest-1488589904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b2e0458c-6d38-4295-b908-6b85329a58fb {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:45 devstack sudo[105047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b2e0458c-6d38-4295-b908-6b85329a58fb Nov 04 12:25:45 devstack sudo[105047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:45 devstack sudo[105047]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-abc73884-ba1f-41ba-aa85-3cba819309bc tempest-GroupSnapshotsTest-1488589904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b2e0458c-6d38-4295-b908-6b85329a58fb" returned: 0 in 0.412s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-abc73884-ba1f-41ba-aa85-3cba819309bc tempest-GroupSnapshotsTest-1488589904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b2e0458c-6d38-4295-b908-6b85329a58fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b2e0458c-6d38-4295-b908-6b85329a58fb.ff7c7168-7ddb-44b2-84ce-0b526c595c58 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:45 devstack sudo[105053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b2e0458c-6d38-4295-b908-6b85329a58fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b2e0458c-6d38-4295-b908-6b85329a58fb.ff7c7168-7ddb-44b2-84ce-0b526c595c58 1G Nov 04 12:25:45 devstack sudo[105053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:45 devstack sudo[105053]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-abc73884-ba1f-41ba-aa85-3cba819309bc tempest-GroupSnapshotsTest-1488589904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b2e0458c-6d38-4295-b908-6b85329a58fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b2e0458c-6d38-4295-b908-6b85329a58fb.ff7c7168-7ddb-44b2-84ce-0b526c595c58 1G" returned: 0 in 0.448s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-abc73884-ba1f-41ba-aa85-3cba819309bc tempest-GroupSnapshotsTest-1488589904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2e0458c-6d38-4295-b908-6b85329a58fb -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b2e0458c-6d38-4295-b908-6b85329a58fb.ff7c7168-7ddb-44b2-84ce-0b526c595c58 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:45 devstack sudo[105058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2e0458c-6d38-4295-b908-6b85329a58fb -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b2e0458c-6d38-4295-b908-6b85329a58fb.ff7c7168-7ddb-44b2-84ce-0b526c595c58 Nov 04 12:25:45 devstack sudo[105058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:46 devstack sudo[105058]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-abc73884-ba1f-41ba-aa85-3cba819309bc tempest-GroupSnapshotsTest-1488589904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2e0458c-6d38-4295-b908-6b85329a58fb -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b2e0458c-6d38-4295-b908-6b85329a58fb.ff7c7168-7ddb-44b2-84ce-0b526c595c58" returned: 0 in 0.314s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:46 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-abc73884-ba1f-41ba-aa85-3cba819309bc tempest-GroupSnapshotsTest-1488589904 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b2e0458c-6d38-4295-b908-6b85329a58fb.ff7c7168-7ddb-44b2-84ce-0b526c595c58 is being set with open permissions: ugo+rw: NotImplementedError Nov 04 12:25:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-abc73884-ba1f-41ba-aa85-3cba819309bc tempest-GroupSnapshotsTest-1488589904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b2e0458c-6d38-4295-b908-6b85329a58fb.ff7c7168-7ddb-44b2-84ce-0b526c595c58 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:46 devstack sudo[105064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b2e0458c-6d38-4295-b908-6b85329a58fb.ff7c7168-7ddb-44b2-84ce-0b526c595c58 Nov 04 12:25:46 devstack sudo[105064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:46 devstack sudo[105064]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-abc73884-ba1f-41ba-aa85-3cba819309bc tempest-GroupSnapshotsTest-1488589904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b2e0458c-6d38-4295-b908-6b85329a58fb.ff7c7168-7ddb-44b2-84ce-0b526c595c58" returned: 0 in 0.315s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-abc73884-ba1f-41ba-aa85-3cba819309bc tempest-GroupSnapshotsTest-1488589904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b2e0458c-6d38-4295-b908-6b85329a58fb.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:46 devstack sudo[105067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b2e0458c-6d38-4295-b908-6b85329a58fb.info Nov 04 12:25:46 devstack sudo[105067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:46 devstack sudo[105067]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-abc73884-ba1f-41ba-aa85-3cba819309bc tempest-GroupSnapshotsTest-1488589904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b2e0458c-6d38-4295-b908-6b85329a58fb.info" returned: 0 in 0.315s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:46 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-abc73884-ba1f-41ba-aa85-3cba819309bc tempest-GroupSnapshotsTest-1488589904 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b2e0458c-6d38-4295-b908-6b85329a58fb.info is being set with open permissions: ugo+rw: NotImplementedError Nov 04 12:25:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-abc73884-ba1f-41ba-aa85-3cba819309bc tempest-GroupSnapshotsTest-1488589904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b2e0458c-6d38-4295-b908-6b85329a58fb.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:46 devstack sudo[105070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b2e0458c-6d38-4295-b908-6b85329a58fb.info Nov 04 12:25:46 devstack sudo[105070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:47 devstack sudo[105070]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-abc73884-ba1f-41ba-aa85-3cba819309bc tempest-GroupSnapshotsTest-1488589904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b2e0458c-6d38-4295-b908-6b85329a58fb.info" returned: 0 in 0.284s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-abc73884-ba1f-41ba-aa85-3cba819309bc tempest-GroupSnapshotsTest-1488589904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.181s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:25:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-32a2c3d2-eafc-478b-8d87-73bbfbcd3b80 tempest-ProjectReaderTests-1986742016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.354s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:25:47 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-32a2c3d2-eafc-478b-8d87-73bbfbcd3b80 tempest-ProjectReaderTests-1986742016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:25:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-584619474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58b775ed-b8a6-4b3f-abe4-db584ad7663d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c46e6d7f8e94fa2a7fab2cdcc7ce515',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:25:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:25:45Z,use_quota=True,user_id='365b9962642b4f23add13335e39cf66e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:25:47 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-32a2c3d2-eafc-478b-8d87-73bbfbcd3b80 tempest-ProjectReaderTests-1986742016 None] Creating volume 58b775ed-b8a6-4b3f-abe4-db584ad7663d {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:25:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-32a2c3d2-eafc-478b-8d87-73bbfbcd3b80 tempest-ProjectReaderTests-1986742016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:25:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-32a2c3d2-eafc-478b-8d87-73bbfbcd3b80 tempest-ProjectReaderTests-1986742016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:25:47 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-32a2c3d2-eafc-478b-8d87-73bbfbcd3b80 tempest-ProjectReaderTests-1986742016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:25:47 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-32a2c3d2-eafc-478b-8d87-73bbfbcd3b80 tempest-ProjectReaderTests-1986742016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:25:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-32a2c3d2-eafc-478b-8d87-73bbfbcd3b80 tempest-ProjectReaderTests-1986742016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:25:47 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-32a2c3d2-eafc-478b-8d87-73bbfbcd3b80 tempest-ProjectReaderTests-1986742016 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:25:47 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-32a2c3d2-eafc-478b-8d87-73bbfbcd3b80 tempest-ProjectReaderTests-1986742016 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:25:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-32a2c3d2-eafc-478b-8d87-73bbfbcd3b80 tempest-ProjectReaderTests-1986742016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-58b775ed-b8a6-4b3f-abe4-db584ad7663d 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:47 devstack sudo[105073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-58b775ed-b8a6-4b3f-abe4-db584ad7663d 1073741824 Nov 04 12:25:47 devstack sudo[105073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:47 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-abc73884-ba1f-41ba-aa85-3cba819309bc tempest-GroupSnapshotsTest-1488589904 None] group_snapshot f2dc5123-b01e-46c3-8b11-0ae8e31daa65: created successfully Nov 04 12:25:47 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-734f556a-4059-4582-9baf-96f16942e226 tempest-GroupSnapshotsTest-1488589904 None] group_snapshot f2dc5123-b01e-46c3-8b11-0ae8e31daa65: deleting Nov 04 12:25:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-734f556a-4059-4582-9baf-96f16942e226 tempest-GroupSnapshotsTest-1488589904 None] group_snapshot f2dc5123-b01e-46c3-8b11-0ae8e31daa65: deleting {{(pid=87095) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 04 12:25:47 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-734f556a-4059-4582-9baf-96f16942e226 tempest-GroupSnapshotsTest-1488589904 None] Acquiring lock "cinder-quobyte-1cc985e1-5cf3-4001-b8d7-7c75c01d72d4" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:25:47 devstack sudo[105073]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-32a2c3d2-eafc-478b-8d87-73bbfbcd3b80 tempest-ProjectReaderTests-1986742016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-58b775ed-b8a6-4b3f-abe4-db584ad7663d 1073741824" returned: 0 in 0.635s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:47 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-734f556a-4059-4582-9baf-96f16942e226 tempest-GroupSnapshotsTest-1488589904 None] Lock "cinder-quobyte-1cc985e1-5cf3-4001-b8d7-7c75c01d72d4" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:25:47 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-734f556a-4059-4582-9baf-96f16942e226 tempest-GroupSnapshotsTest-1488589904 None] Acquiring lock "cinder-quobyte-17b81918-cc30-495a-b8bf-ab68e46125db" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:25:47 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-734f556a-4059-4582-9baf-96f16942e226 tempest-GroupSnapshotsTest-1488589904 None] Lock "cinder-quobyte-17b81918-cc30-495a-b8bf-ab68e46125db" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:25:47 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-734f556a-4059-4582-9baf-96f16942e226 tempest-GroupSnapshotsTest-1488589904 None] Deleting offline snapshot 17b81918-cc30-495a-b8bf-ab68e46125db of volume 1cc985e1-5cf3-4001-b8d7-7c75c01d72d4 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 12:25:47 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-734f556a-4059-4582-9baf-96f16942e226 tempest-GroupSnapshotsTest-1488589904 None] snapshot_file for this snap is: volume-1cc985e1-5cf3-4001-b8d7-7c75c01d72d4.17b81918-cc30-495a-b8bf-ab68e46125db {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 12:25:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-32a2c3d2-eafc-478b-8d87-73bbfbcd3b80 tempest-ProjectReaderTests-1986742016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-58b775ed-b8a6-4b3f-abe4-db584ad7663d {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:47 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0919eb1-5f60-426f-916a-aed174b1a160]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:25:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-734f556a-4059-4582-9baf-96f16942e226 tempest-GroupSnapshotsTest-1488589904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1cc985e1-5cf3-4001-b8d7-7c75c01d72d4.17b81918-cc30-495a-b8bf-ab68e46125db {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:47 devstack sudo[105080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-58b775ed-b8a6-4b3f-abe4-db584ad7663d Nov 04 12:25:47 devstack sudo[105080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:47 devstack sudo[105082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1cc985e1-5cf3-4001-b8d7-7c75c01d72d4.17b81918-cc30-495a-b8bf-ab68e46125db Nov 04 12:25:47 devstack sudo[105082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:48 devstack sudo[105080]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-32a2c3d2-eafc-478b-8d87-73bbfbcd3b80 tempest-ProjectReaderTests-1986742016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-58b775ed-b8a6-4b3f-abe4-db584ad7663d" returned: 0 in 0.388s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:48 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-32a2c3d2-eafc-478b-8d87-73bbfbcd3b80 tempest-ProjectReaderTests-1986742016 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:25:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-32a2c3d2-eafc-478b-8d87-73bbfbcd3b80 tempest-ProjectReaderTests-1986742016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:25:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-32a2c3d2-eafc-478b-8d87-73bbfbcd3b80 tempest-ProjectReaderTests-1986742016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9009c946-dd88-4c13-99e8-cda1d712aeeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58b775ed-b8a6-4b3f-abe4-db584ad7663d', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:25:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-32a2c3d2-eafc-478b-8d87-73bbfbcd3b80 tempest-ProjectReaderTests-1986742016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32f4fd3b-7471-4017-83e7-9a7d4710610b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:25:48 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-32a2c3d2-eafc-478b-8d87-73bbfbcd3b80 tempest-ProjectReaderTests-1986742016 None] Volume volume-58b775ed-b8a6-4b3f-abe4-db584ad7663d (58b775ed-b8a6-4b3f-abe4-db584ad7663d): created successfully Nov 04 12:25:48 devstack sudo[105082]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-32a2c3d2-eafc-478b-8d87-73bbfbcd3b80 tempest-ProjectReaderTests-1986742016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32f4fd3b-7471-4017-83e7-9a7d4710610b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:25:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-32a2c3d2-eafc-478b-8d87-73bbfbcd3b80 tempest-ProjectReaderTests-1986742016 None] Flow 'volume_create_manager' (9eabe8d7-65c1-4bbc-9b9c-1c4a2f380ed5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:25:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-734f556a-4059-4582-9baf-96f16942e226 tempest-GroupSnapshotsTest-1488589904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1cc985e1-5cf3-4001-b8d7-7c75c01d72d4.17b81918-cc30-495a-b8bf-ab68e46125db" returned: 0 in 0.427s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:48 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-734f556a-4059-4582-9baf-96f16942e226 tempest-GroupSnapshotsTest-1488589904 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1cc985e1-5cf3-4001-b8d7-7c75c01d72d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 12:25:48 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e34780-cda4-4e13-ab18-43acf7d677c0]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:25:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-734f556a-4059-4582-9baf-96f16942e226 tempest-GroupSnapshotsTest-1488589904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1cc985e1-5cf3-4001-b8d7-7c75c01d72d4 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:48 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-32a2c3d2-eafc-478b-8d87-73bbfbcd3b80 tempest-ProjectReaderTests-1986742016 None] Created volume successfully. Nov 04 12:25:48 devstack sudo[105090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1cc985e1-5cf3-4001-b8d7-7c75c01d72d4 Nov 04 12:25:48 devstack sudo[105090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:48 devstack sudo[105090]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-734f556a-4059-4582-9baf-96f16942e226 tempest-GroupSnapshotsTest-1488589904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1cc985e1-5cf3-4001-b8d7-7c75c01d72d4" returned: 0 in 0.373s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-734f556a-4059-4582-9baf-96f16942e226 tempest-GroupSnapshotsTest-1488589904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1cc985e1-5cf3-4001-b8d7-7c75c01d72d4.17b81918-cc30-495a-b8bf-ab68e46125db {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:48 devstack sudo[105095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1cc985e1-5cf3-4001-b8d7-7c75c01d72d4.17b81918-cc30-495a-b8bf-ab68e46125db Nov 04 12:25:48 devstack sudo[105095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:48 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a7ca2216-f7c8-4405-83eb-ee98e274245d tempest-ProjectReaderTests-1986742016 None] Acquiring lock "cinder-58b775ed-b8a6-4b3f-abe4-db584ad7663d-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:25:48 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a7ca2216-f7c8-4405-83eb-ee98e274245d tempest-ProjectReaderTests-1986742016 None] Lock "cinder-58b775ed-b8a6-4b3f-abe4-db584ad7663d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:25:48 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a7ca2216-f7c8-4405-83eb-ee98e274245d tempest-ProjectReaderTests-1986742016 None] Acquiring lock "cinder-quobyte-58b775ed-b8a6-4b3f-abe4-db584ad7663d" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:25:48 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a7ca2216-f7c8-4405-83eb-ee98e274245d tempest-ProjectReaderTests-1986742016 None] Lock "cinder-quobyte-58b775ed-b8a6-4b3f-abe4-db584ad7663d" acquired by "delete_volume" :: waited 0.016s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:25:49 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e62009-27d8-4662-9570-1b372284df2f]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:25:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a7ca2216-f7c8-4405-83eb-ee98e274245d tempest-ProjectReaderTests-1986742016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-58b775ed-b8a6-4b3f-abe4-db584ad7663d {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:49 devstack sudo[105095]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-734f556a-4059-4582-9baf-96f16942e226 tempest-GroupSnapshotsTest-1488589904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1cc985e1-5cf3-4001-b8d7-7c75c01d72d4.17b81918-cc30-495a-b8bf-ab68e46125db" returned: 0 in 0.407s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-734f556a-4059-4582-9baf-96f16942e226 tempest-GroupSnapshotsTest-1488589904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1cc985e1-5cf3-4001-b8d7-7c75c01d72d4.17b81918-cc30-495a-b8bf-ab68e46125db {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:49 devstack sudo[105102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1cc985e1-5cf3-4001-b8d7-7c75c01d72d4.17b81918-cc30-495a-b8bf-ab68e46125db Nov 04 12:25:49 devstack sudo[105102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:49 devstack sudo[105101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-58b775ed-b8a6-4b3f-abe4-db584ad7663d Nov 04 12:25:49 devstack sudo[105101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:49 devstack sudo[105102]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-734f556a-4059-4582-9baf-96f16942e226 tempest-GroupSnapshotsTest-1488589904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1cc985e1-5cf3-4001-b8d7-7c75c01d72d4.17b81918-cc30-495a-b8bf-ab68e46125db" returned: 0 in 0.283s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:49 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-734f556a-4059-4582-9baf-96f16942e226 tempest-GroupSnapshotsTest-1488589904 None] Lock "cinder-quobyte-17b81918-cc30-495a-b8bf-ab68e46125db" released by "_delete_snapshot" :: held 1.626s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:25:49 devstack sudo[105101]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:49 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-734f556a-4059-4582-9baf-96f16942e226 tempest-GroupSnapshotsTest-1488589904 None] Lock "cinder-quobyte-1cc985e1-5cf3-4001-b8d7-7c75c01d72d4" released by "delete_snapshot" :: held 1.659s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:25:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a7ca2216-f7c8-4405-83eb-ee98e274245d tempest-ProjectReaderTests-1986742016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-58b775ed-b8a6-4b3f-abe4-db584ad7663d" returned: 0 in 0.417s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a7ca2216-f7c8-4405-83eb-ee98e274245d tempest-ProjectReaderTests-1986742016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-58b775ed-b8a6-4b3f-abe4-db584ad7663d {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:49 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-734f556a-4059-4582-9baf-96f16942e226 tempest-GroupSnapshotsTest-1488589904 None] Acquiring lock "cinder-quobyte-b2e0458c-6d38-4295-b908-6b85329a58fb" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:25:49 devstack sudo[105109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-58b775ed-b8a6-4b3f-abe4-db584ad7663d Nov 04 12:25:49 devstack sudo[105109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:49 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-734f556a-4059-4582-9baf-96f16942e226 tempest-GroupSnapshotsTest-1488589904 None] Lock "cinder-quobyte-b2e0458c-6d38-4295-b908-6b85329a58fb" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:25:49 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-734f556a-4059-4582-9baf-96f16942e226 tempest-GroupSnapshotsTest-1488589904 None] Acquiring lock "cinder-quobyte-ff7c7168-7ddb-44b2-84ce-0b526c595c58" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:25:49 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-734f556a-4059-4582-9baf-96f16942e226 tempest-GroupSnapshotsTest-1488589904 None] Lock "cinder-quobyte-ff7c7168-7ddb-44b2-84ce-0b526c595c58" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:25:49 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-734f556a-4059-4582-9baf-96f16942e226 tempest-GroupSnapshotsTest-1488589904 None] Deleting offline snapshot ff7c7168-7ddb-44b2-84ce-0b526c595c58 of volume b2e0458c-6d38-4295-b908-6b85329a58fb {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 12:25:49 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-734f556a-4059-4582-9baf-96f16942e226 tempest-GroupSnapshotsTest-1488589904 None] snapshot_file for this snap is: volume-b2e0458c-6d38-4295-b908-6b85329a58fb.ff7c7168-7ddb-44b2-84ce-0b526c595c58 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 12:25:49 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06aaab4-6c2e-4549-811f-69f3e699a966]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:25:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-734f556a-4059-4582-9baf-96f16942e226 tempest-GroupSnapshotsTest-1488589904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b2e0458c-6d38-4295-b908-6b85329a58fb.ff7c7168-7ddb-44b2-84ce-0b526c595c58 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:49 devstack sudo[105109]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a7ca2216-f7c8-4405-83eb-ee98e274245d tempest-ProjectReaderTests-1986742016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-58b775ed-b8a6-4b3f-abe4-db584ad7663d" returned: 0 in 0.283s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:49 devstack sudo[105111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b2e0458c-6d38-4295-b908-6b85329a58fb.ff7c7168-7ddb-44b2-84ce-0b526c595c58 Nov 04 12:25:49 devstack sudo[105111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:49 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a7ca2216-f7c8-4405-83eb-ee98e274245d tempest-ProjectReaderTests-1986742016 None] Lock "cinder-quobyte-58b775ed-b8a6-4b3f-abe4-db584ad7663d" released by "delete_volume" :: held 0.749s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:25:49 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-a7ca2216-f7c8-4405-83eb-ee98e274245d tempest-ProjectReaderTests-1986742016 None] Created reservations ['76040a65-3cd1-4e84-ae9b-6ce90ad6e028', 'b5307925-097f-423c-b4f8-9d685216f1f2', 'c98b39ce-2f32-48a9-a779-2d5010c786a6', '526dce04-3058-4341-9674-f41a0564fd86'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:25:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a7ca2216-f7c8-4405-83eb-ee98e274245d tempest-ProjectReaderTests-1986742016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:25:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a7ca2216-f7c8-4405-83eb-ee98e274245d tempest-ProjectReaderTests-1986742016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:25:49 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a7ca2216-f7c8-4405-83eb-ee98e274245d tempest-ProjectReaderTests-1986742016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:25:49 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a7ca2216-f7c8-4405-83eb-ee98e274245d tempest-ProjectReaderTests-1986742016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:25:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a7ca2216-f7c8-4405-83eb-ee98e274245d tempest-ProjectReaderTests-1986742016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:25:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a7ca2216-f7c8-4405-83eb-ee98e274245d tempest-ProjectReaderTests-1986742016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:49 devstack sudo[105114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:25:49 devstack sudo[105114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:49 devstack sudo[105111]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-734f556a-4059-4582-9baf-96f16942e226 tempest-GroupSnapshotsTest-1488589904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b2e0458c-6d38-4295-b908-6b85329a58fb.ff7c7168-7ddb-44b2-84ce-0b526c595c58" returned: 0 in 0.377s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:49 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-734f556a-4059-4582-9baf-96f16942e226 tempest-GroupSnapshotsTest-1488589904 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2e0458c-6d38-4295-b908-6b85329a58fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 12:25:50 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f53eac-025c-4c8d-9805-236e11b93d15]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:25:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-734f556a-4059-4582-9baf-96f16942e226 tempest-GroupSnapshotsTest-1488589904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b2e0458c-6d38-4295-b908-6b85329a58fb {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:50 devstack sudo[105114]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a7ca2216-f7c8-4405-83eb-ee98e274245d tempest-ProjectReaderTests-1986742016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.289s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:50 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-a7ca2216-f7c8-4405-83eb-ee98e274245d tempest-ProjectReaderTests-1986742016 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:25:50 devstack sudo[105120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b2e0458c-6d38-4295-b908-6b85329a58fb Nov 04 12:25:50 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-a7ca2216-f7c8-4405-83eb-ee98e274245d tempest-ProjectReaderTests-1986742016 None] Deleted volume successfully. Nov 04 12:25:50 devstack sudo[105120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:50 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a7ca2216-f7c8-4405-83eb-ee98e274245d tempest-ProjectReaderTests-1986742016 None] Lock "cinder-58b775ed-b8a6-4b3f-abe4-db584ad7663d-delete_volume" released by "delete_volume" :: held 1.294s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:25:50 devstack sudo[105120]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-734f556a-4059-4582-9baf-96f16942e226 tempest-GroupSnapshotsTest-1488589904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b2e0458c-6d38-4295-b908-6b85329a58fb" returned: 0 in 0.452s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-734f556a-4059-4582-9baf-96f16942e226 tempest-GroupSnapshotsTest-1488589904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b2e0458c-6d38-4295-b908-6b85329a58fb.ff7c7168-7ddb-44b2-84ce-0b526c595c58 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:50 devstack sudo[105126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b2e0458c-6d38-4295-b908-6b85329a58fb.ff7c7168-7ddb-44b2-84ce-0b526c595c58 Nov 04 12:25:50 devstack sudo[105126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:50 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a747d05-4fcc-4231-ad79-0f3682c1014e tempest-ProjectReaderTests-1986742016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:25:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6a747d05-4fcc-4231-ad79-0f3682c1014e tempest-ProjectReaderTests-1986742016 None] Flow 'volume_create_manager' (29dd3d5d-0534-4bfc-8001-a33679c1084b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:25:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6a747d05-4fcc-4231-ad79-0f3682c1014e tempest-ProjectReaderTests-1986742016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c0274d3-3b8d-48a5-9faf-085db697dd94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:25:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6a747d05-4fcc-4231-ad79-0f3682c1014e tempest-ProjectReaderTests-1986742016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c0274d3-3b8d-48a5-9faf-085db697dd94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:25:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-408830833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c33c611-5d25-41b7-aea6-18ba24f562c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c46e6d7f8e94fa2a7fab2cdcc7ce515',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:25:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:25:51Z,use_quota=True,user_id='365b9962642b4f23add13335e39cf66e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:25:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6a747d05-4fcc-4231-ad79-0f3682c1014e tempest-ProjectReaderTests-1986742016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46c8fa2c-3d2d-4be5-99ed-8287557dc897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:25:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6a747d05-4fcc-4231-ad79-0f3682c1014e tempest-ProjectReaderTests-1986742016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46c8fa2c-3d2d-4be5-99ed-8287557dc897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:25:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6a747d05-4fcc-4231-ad79-0f3682c1014e tempest-ProjectReaderTests-1986742016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed194caa-47ac-491f-9ef3-2840202ec136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:25:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6a747d05-4fcc-4231-ad79-0f3682c1014e tempest-ProjectReaderTests-1986742016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed194caa-47ac-491f-9ef3-2840202ec136) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c33c611-5d25-41b7-aea6-18ba24f562c8', 'volume_name': 'volume-6c33c611-5d25-41b7-aea6-18ba24f562c8', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:25:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6a747d05-4fcc-4231-ad79-0f3682c1014e tempest-ProjectReaderTests-1986742016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0736e79-1c32-4fe7-bc03-db63585a1be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:25:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6a747d05-4fcc-4231-ad79-0f3682c1014e tempest-ProjectReaderTests-1986742016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0736e79-1c32-4fe7-bc03-db63585a1be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:25:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6a747d05-4fcc-4231-ad79-0f3682c1014e tempest-ProjectReaderTests-1986742016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f13c4f3-93e1-4e9e-bc64-74c0105db854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:25:50 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-6a747d05-4fcc-4231-ad79-0f3682c1014e tempest-ProjectReaderTests-1986742016 None] Volume 6c33c611-5d25-41b7-aea6-18ba24f562c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c33c611-5d25-41b7-aea6-18ba24f562c8', 'volume_size': 1} Nov 04 12:25:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6a747d05-4fcc-4231-ad79-0f3682c1014e tempest-ProjectReaderTests-1986742016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:25:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6a747d05-4fcc-4231-ad79-0f3682c1014e tempest-ProjectReaderTests-1986742016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:25:50 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6a747d05-4fcc-4231-ad79-0f3682c1014e tempest-ProjectReaderTests-1986742016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:25:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-408830833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c33c611-5d25-41b7-aea6-18ba24f562c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c46e6d7f8e94fa2a7fab2cdcc7ce515',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:25:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:25:51Z,use_quota=True,user_id='365b9962642b4f23add13335e39cf66e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:25:50 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-6a747d05-4fcc-4231-ad79-0f3682c1014e tempest-ProjectReaderTests-1986742016 None] Creating volume 6c33c611-5d25-41b7-aea6-18ba24f562c8 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:25:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6a747d05-4fcc-4231-ad79-0f3682c1014e tempest-ProjectReaderTests-1986742016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:25:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6a747d05-4fcc-4231-ad79-0f3682c1014e tempest-ProjectReaderTests-1986742016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:25:50 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6a747d05-4fcc-4231-ad79-0f3682c1014e tempest-ProjectReaderTests-1986742016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:25:50 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6a747d05-4fcc-4231-ad79-0f3682c1014e tempest-ProjectReaderTests-1986742016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:25:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6a747d05-4fcc-4231-ad79-0f3682c1014e tempest-ProjectReaderTests-1986742016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:25:50 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6a747d05-4fcc-4231-ad79-0f3682c1014e tempest-ProjectReaderTests-1986742016 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:25:50 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-6a747d05-4fcc-4231-ad79-0f3682c1014e tempest-ProjectReaderTests-1986742016 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:25:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6a747d05-4fcc-4231-ad79-0f3682c1014e tempest-ProjectReaderTests-1986742016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6c33c611-5d25-41b7-aea6-18ba24f562c8 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:50 devstack sudo[105131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6c33c611-5d25-41b7-aea6-18ba24f562c8 1073741824 Nov 04 12:25:50 devstack sudo[105131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:50 devstack sudo[105126]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-734f556a-4059-4582-9baf-96f16942e226 tempest-GroupSnapshotsTest-1488589904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b2e0458c-6d38-4295-b908-6b85329a58fb.ff7c7168-7ddb-44b2-84ce-0b526c595c58" returned: 0 in 0.392s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-734f556a-4059-4582-9baf-96f16942e226 tempest-GroupSnapshotsTest-1488589904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b2e0458c-6d38-4295-b908-6b85329a58fb.ff7c7168-7ddb-44b2-84ce-0b526c595c58 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:50 devstack sudo[105133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b2e0458c-6d38-4295-b908-6b85329a58fb.ff7c7168-7ddb-44b2-84ce-0b526c595c58 Nov 04 12:25:50 devstack sudo[105133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:51 devstack sudo[105133]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-734f556a-4059-4582-9baf-96f16942e226 tempest-GroupSnapshotsTest-1488589904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b2e0458c-6d38-4295-b908-6b85329a58fb.ff7c7168-7ddb-44b2-84ce-0b526c595c58" returned: 0 in 0.284s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:51 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-734f556a-4059-4582-9baf-96f16942e226 tempest-GroupSnapshotsTest-1488589904 None] Lock "cinder-quobyte-ff7c7168-7ddb-44b2-84ce-0b526c595c58" released by "_delete_snapshot" :: held 1.702s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:25:51 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-734f556a-4059-4582-9baf-96f16942e226 tempest-GroupSnapshotsTest-1488589904 None] Lock "cinder-quobyte-b2e0458c-6d38-4295-b908-6b85329a58fb" released by "delete_snapshot" :: held 1.758s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:25:51 devstack sudo[105131]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6a747d05-4fcc-4231-ad79-0f3682c1014e tempest-ProjectReaderTests-1986742016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6c33c611-5d25-41b7-aea6-18ba24f562c8 1073741824" returned: 0 in 0.490s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:51 devstack cinder-volume[87095]: WARNING cinder.quota [None req-734f556a-4059-4582-9baf-96f16942e226 tempest-GroupSnapshotsTest-1488589904 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1229904872 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1229904872, it is now deprecated. Please use the default quota class for default quota. Nov 04 12:25:51 devstack cinder-volume[87095]: WARNING cinder.quota [None req-734f556a-4059-4582-9baf-96f16942e226 tempest-GroupSnapshotsTest-1488589904 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1229904872 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1229904872, it is now deprecated. Please use the default quota class for default quota. Nov 04 12:25:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6a747d05-4fcc-4231-ad79-0f3682c1014e tempest-ProjectReaderTests-1986742016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6c33c611-5d25-41b7-aea6-18ba24f562c8 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:51 devstack sudo[105139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6c33c611-5d25-41b7-aea6-18ba24f562c8 Nov 04 12:25:51 devstack sudo[105139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:51 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-734f556a-4059-4582-9baf-96f16942e226 tempest-GroupSnapshotsTest-1488589904 None] Created reservations ['26324a0f-8392-4bdf-8b0e-f916c1cb8c53', '2fcd20e8-3994-4c1a-952d-55a4cf57101e', 'd5893ab9-9ea3-4e3e-b2c4-711908521665', '42feea66-b5fe-4983-8dda-99435df19628'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:25:51 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-734f556a-4059-4582-9baf-96f16942e226 tempest-GroupSnapshotsTest-1488589904 None] Created reservations ['f75947e6-cd05-4c01-a0ea-8d24db62f422', 'aeda15ca-f17f-4ec6-942b-f6b22c82e393', 'fe59742d-8932-4bb5-b94b-7a91b159a917', '98b3b099-876d-4d0a-b972-f04dafd47029'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:25:51 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-734f556a-4059-4582-9baf-96f16942e226 tempest-GroupSnapshotsTest-1488589904 None] group_snapshot f2dc5123-b01e-46c3-8b11-0ae8e31daa65: deleted successfully Nov 04 12:25:51 devstack sudo[105139]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6a747d05-4fcc-4231-ad79-0f3682c1014e tempest-ProjectReaderTests-1986742016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6c33c611-5d25-41b7-aea6-18ba24f562c8" returned: 0 in 0.299s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:51 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6a747d05-4fcc-4231-ad79-0f3682c1014e tempest-ProjectReaderTests-1986742016 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:25:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6a747d05-4fcc-4231-ad79-0f3682c1014e tempest-ProjectReaderTests-1986742016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:25:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6a747d05-4fcc-4231-ad79-0f3682c1014e tempest-ProjectReaderTests-1986742016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f13c4f3-93e1-4e9e-bc64-74c0105db854) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c33c611-5d25-41b7-aea6-18ba24f562c8', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:25:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6a747d05-4fcc-4231-ad79-0f3682c1014e tempest-ProjectReaderTests-1986742016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc90c9d6-c0f5-471d-a8e5-6ec415d39db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:25:51 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-6a747d05-4fcc-4231-ad79-0f3682c1014e tempest-ProjectReaderTests-1986742016 None] Volume volume-6c33c611-5d25-41b7-aea6-18ba24f562c8 (6c33c611-5d25-41b7-aea6-18ba24f562c8): created successfully Nov 04 12:25:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6a747d05-4fcc-4231-ad79-0f3682c1014e tempest-ProjectReaderTests-1986742016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc90c9d6-c0f5-471d-a8e5-6ec415d39db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:25:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6a747d05-4fcc-4231-ad79-0f3682c1014e tempest-ProjectReaderTests-1986742016 None] Flow 'volume_create_manager' (29dd3d5d-0534-4bfc-8001-a33679c1084b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:25:51 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-6a747d05-4fcc-4231-ad79-0f3682c1014e tempest-ProjectReaderTests-1986742016 None] Created volume successfully. Nov 04 12:25:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-430c9851-4a73-4781-b26b-f2afde5e3a27 tempest-GroupSnapshotsTest-1488589904 None] Acquiring lock "cinder-quobyte-1cc985e1-5cf3-4001-b8d7-7c75c01d72d4" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:25:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-430c9851-4a73-4781-b26b-f2afde5e3a27 tempest-GroupSnapshotsTest-1488589904 None] Lock "cinder-quobyte-1cc985e1-5cf3-4001-b8d7-7c75c01d72d4" acquired by "delete_volume" :: waited 0.036s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:25:52 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f51e8549-615d-442c-a6f1-e27572e0a74c]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:25:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-430c9851-4a73-4781-b26b-f2afde5e3a27 tempest-GroupSnapshotsTest-1488589904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1cc985e1-5cf3-4001-b8d7-7c75c01d72d4 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e27d0084-b112-4370-a909-b8fe375b1ecf tempest-ProjectReaderTests-1986742016 None] Acquiring lock "cinder-6c33c611-5d25-41b7-aea6-18ba24f562c8-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:25:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e27d0084-b112-4370-a909-b8fe375b1ecf tempest-ProjectReaderTests-1986742016 None] Lock "cinder-6c33c611-5d25-41b7-aea6-18ba24f562c8-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:25:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e27d0084-b112-4370-a909-b8fe375b1ecf tempest-ProjectReaderTests-1986742016 None] Acquiring lock "cinder-quobyte-6c33c611-5d25-41b7-aea6-18ba24f562c8" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:25:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e27d0084-b112-4370-a909-b8fe375b1ecf tempest-ProjectReaderTests-1986742016 None] Lock "cinder-quobyte-6c33c611-5d25-41b7-aea6-18ba24f562c8" acquired by "delete_volume" :: waited 0.023s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:25:52 devstack sudo[105142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1cc985e1-5cf3-4001-b8d7-7c75c01d72d4 Nov 04 12:25:52 devstack sudo[105142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:52 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34fa931-fb0c-4620-8876-be28014296c2]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:25:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e27d0084-b112-4370-a909-b8fe375b1ecf tempest-ProjectReaderTests-1986742016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6c33c611-5d25-41b7-aea6-18ba24f562c8 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:53 devstack sudo[105144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6c33c611-5d25-41b7-aea6-18ba24f562c8 Nov 04 12:25:53 devstack sudo[105144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:53 devstack sudo[105142]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-430c9851-4a73-4781-b26b-f2afde5e3a27 tempest-GroupSnapshotsTest-1488589904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1cc985e1-5cf3-4001-b8d7-7c75c01d72d4" returned: 0 in 0.468s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-430c9851-4a73-4781-b26b-f2afde5e3a27 tempest-GroupSnapshotsTest-1488589904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1cc985e1-5cf3-4001-b8d7-7c75c01d72d4 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:53 devstack sudo[105151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1cc985e1-5cf3-4001-b8d7-7c75c01d72d4 Nov 04 12:25:53 devstack sudo[105151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:53 devstack sudo[105144]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e27d0084-b112-4370-a909-b8fe375b1ecf tempest-ProjectReaderTests-1986742016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6c33c611-5d25-41b7-aea6-18ba24f562c8" returned: 0 in 0.431s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e27d0084-b112-4370-a909-b8fe375b1ecf tempest-ProjectReaderTests-1986742016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6c33c611-5d25-41b7-aea6-18ba24f562c8 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:53 devstack sudo[105156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6c33c611-5d25-41b7-aea6-18ba24f562c8 Nov 04 12:25:53 devstack sudo[105156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:53 devstack sudo[105151]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-430c9851-4a73-4781-b26b-f2afde5e3a27 tempest-GroupSnapshotsTest-1488589904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1cc985e1-5cf3-4001-b8d7-7c75c01d72d4" returned: 0 in 0.297s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:53 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-430c9851-4a73-4781-b26b-f2afde5e3a27 tempest-GroupSnapshotsTest-1488589904 None] Lock "cinder-quobyte-1cc985e1-5cf3-4001-b8d7-7c75c01d72d4" released by "delete_volume" :: held 0.852s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:25:53 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-430c9851-4a73-4781-b26b-f2afde5e3a27 tempest-GroupSnapshotsTest-1488589904 None] Acquiring lock "cinder-quobyte-b2e0458c-6d38-4295-b908-6b85329a58fb" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:25:53 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-430c9851-4a73-4781-b26b-f2afde5e3a27 tempest-GroupSnapshotsTest-1488589904 None] Lock "cinder-quobyte-b2e0458c-6d38-4295-b908-6b85329a58fb" acquired by "delete_volume" :: waited 0.019s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:25:53 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0bcfd8-44a5-40d0-b10c-e59658f4c333]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:25:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-430c9851-4a73-4781-b26b-f2afde5e3a27 tempest-GroupSnapshotsTest-1488589904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b2e0458c-6d38-4295-b908-6b85329a58fb {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:53 devstack sudo[105156]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e27d0084-b112-4370-a909-b8fe375b1ecf tempest-ProjectReaderTests-1986742016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6c33c611-5d25-41b7-aea6-18ba24f562c8" returned: 0 in 0.297s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:53 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e27d0084-b112-4370-a909-b8fe375b1ecf tempest-ProjectReaderTests-1986742016 None] Lock "cinder-quobyte-6c33c611-5d25-41b7-aea6-18ba24f562c8" released by "delete_volume" :: held 0.793s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:25:53 devstack sudo[105160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b2e0458c-6d38-4295-b908-6b85329a58fb Nov 04 12:25:53 devstack sudo[105160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:53 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-e27d0084-b112-4370-a909-b8fe375b1ecf tempest-ProjectReaderTests-1986742016 None] Created reservations ['aa52f417-9491-4b7b-9b8e-6a3efa3bef0c', '64c6b826-2f32-4b93-aa9f-d0612e765735', '02e6fa36-4870-4ef5-a5b5-525b1eee6c2f', '1c81ac0b-93a7-44db-a0ce-7c3673026721'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:25:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e27d0084-b112-4370-a909-b8fe375b1ecf tempest-ProjectReaderTests-1986742016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:25:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e27d0084-b112-4370-a909-b8fe375b1ecf tempest-ProjectReaderTests-1986742016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:25:53 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e27d0084-b112-4370-a909-b8fe375b1ecf tempest-ProjectReaderTests-1986742016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:25:53 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e27d0084-b112-4370-a909-b8fe375b1ecf tempest-ProjectReaderTests-1986742016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:25:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e27d0084-b112-4370-a909-b8fe375b1ecf tempest-ProjectReaderTests-1986742016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:25:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e27d0084-b112-4370-a909-b8fe375b1ecf tempest-ProjectReaderTests-1986742016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:53 devstack sudo[105162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:25:53 devstack sudo[105162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:54 devstack sudo[105160]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-430c9851-4a73-4781-b26b-f2afde5e3a27 tempest-GroupSnapshotsTest-1488589904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b2e0458c-6d38-4295-b908-6b85329a58fb" returned: 0 in 0.465s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-430c9851-4a73-4781-b26b-f2afde5e3a27 tempest-GroupSnapshotsTest-1488589904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b2e0458c-6d38-4295-b908-6b85329a58fb {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:54 devstack sudo[105167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b2e0458c-6d38-4295-b908-6b85329a58fb Nov 04 12:25:54 devstack sudo[105167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:54 devstack sudo[105162]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e27d0084-b112-4370-a909-b8fe375b1ecf tempest-ProjectReaderTests-1986742016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.354s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:54 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-e27d0084-b112-4370-a909-b8fe375b1ecf tempest-ProjectReaderTests-1986742016 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:25:54 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-e27d0084-b112-4370-a909-b8fe375b1ecf tempest-ProjectReaderTests-1986742016 None] Deleted volume successfully. Nov 04 12:25:54 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e27d0084-b112-4370-a909-b8fe375b1ecf tempest-ProjectReaderTests-1986742016 None] Lock "cinder-6c33c611-5d25-41b7-aea6-18ba24f562c8-delete_volume" released by "delete_volume" :: held 1.414s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:25:54 devstack sudo[105167]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-430c9851-4a73-4781-b26b-f2afde5e3a27 tempest-GroupSnapshotsTest-1488589904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b2e0458c-6d38-4295-b908-6b85329a58fb" returned: 0 in 0.327s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:54 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-430c9851-4a73-4781-b26b-f2afde5e3a27 tempest-GroupSnapshotsTest-1488589904 None] Lock "cinder-quobyte-b2e0458c-6d38-4295-b908-6b85329a58fb" released by "delete_volume" :: held 0.871s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:25:54 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-430c9851-4a73-4781-b26b-f2afde5e3a27 tempest-GroupSnapshotsTest-1488589904 None] Created reservations ['551f275f-20de-4d44-bb45-776e78b02a8c'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:25:54 devstack cinder-volume[87095]: WARNING cinder.quota [None req-430c9851-4a73-4781-b26b-f2afde5e3a27 tempest-GroupSnapshotsTest-1488589904 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1229904872 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1229904872, it is now deprecated. Please use the default quota class for default quota. Nov 04 12:25:54 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-430c9851-4a73-4781-b26b-f2afde5e3a27 tempest-GroupSnapshotsTest-1488589904 None] Created reservations ['ec9df61f-72dc-48c3-8e5f-c92a09d56694', 'f8c09eea-c0fc-4192-bee7-a469fe26017c', '89a68be3-e955-42e5-9466-c5689cdb86af', '9dbe0ed8-fb76-4384-bb64-5ca2916e00d3'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:25:54 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-6869c6a6-4af8-4da8-88d1-baccf8403a12 tempest-ProjectReaderTests-1986742016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:25:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6869c6a6-4af8-4da8-88d1-baccf8403a12 tempest-ProjectReaderTests-1986742016 None] Flow 'volume_create_manager' (72594b2f-0255-4f0d-90e6-dcb8965f5719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:25:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6869c6a6-4af8-4da8-88d1-baccf8403a12 tempest-ProjectReaderTests-1986742016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66dedfa1-f112-4a7d-92a0-326a9c308b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:25:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6869c6a6-4af8-4da8-88d1-baccf8403a12 tempest-ProjectReaderTests-1986742016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66dedfa1-f112-4a7d-92a0-326a9c308b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:25:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2025901623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ba5f140-51d1-4aca-8d26-4742061e1004,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c46e6d7f8e94fa2a7fab2cdcc7ce515',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:25:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:25:55Z,use_quota=True,user_id='365b9962642b4f23add13335e39cf66e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:25:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6869c6a6-4af8-4da8-88d1-baccf8403a12 tempest-ProjectReaderTests-1986742016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b28d23ef-379b-40fd-80ad-502bcd9c2ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:25:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6869c6a6-4af8-4da8-88d1-baccf8403a12 tempest-ProjectReaderTests-1986742016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b28d23ef-379b-40fd-80ad-502bcd9c2ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:25:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6869c6a6-4af8-4da8-88d1-baccf8403a12 tempest-ProjectReaderTests-1986742016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3843ef74-bd73-4c21-9a52-380bb4deaff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:25:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6869c6a6-4af8-4da8-88d1-baccf8403a12 tempest-ProjectReaderTests-1986742016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3843ef74-bd73-4c21-9a52-380bb4deaff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ba5f140-51d1-4aca-8d26-4742061e1004', 'volume_name': 'volume-9ba5f140-51d1-4aca-8d26-4742061e1004', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:25:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6869c6a6-4af8-4da8-88d1-baccf8403a12 tempest-ProjectReaderTests-1986742016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e084c34-c7f5-45a5-bed0-718ec013e83b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:25:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6869c6a6-4af8-4da8-88d1-baccf8403a12 tempest-ProjectReaderTests-1986742016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e084c34-c7f5-45a5-bed0-718ec013e83b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:25:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6869c6a6-4af8-4da8-88d1-baccf8403a12 tempest-ProjectReaderTests-1986742016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a973672b-47e7-4800-8490-5a47e30ab5a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:25:54 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-6869c6a6-4af8-4da8-88d1-baccf8403a12 tempest-ProjectReaderTests-1986742016 None] Volume 9ba5f140-51d1-4aca-8d26-4742061e1004: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ba5f140-51d1-4aca-8d26-4742061e1004', 'volume_size': 1} Nov 04 12:25:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6869c6a6-4af8-4da8-88d1-baccf8403a12 tempest-ProjectReaderTests-1986742016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:25:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6869c6a6-4af8-4da8-88d1-baccf8403a12 tempest-ProjectReaderTests-1986742016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:25:54 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6869c6a6-4af8-4da8-88d1-baccf8403a12 tempest-ProjectReaderTests-1986742016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:25:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2025901623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ba5f140-51d1-4aca-8d26-4742061e1004,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c46e6d7f8e94fa2a7fab2cdcc7ce515',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:25:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:25:55Z,use_quota=True,user_id='365b9962642b4f23add13335e39cf66e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:25:54 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-6869c6a6-4af8-4da8-88d1-baccf8403a12 tempest-ProjectReaderTests-1986742016 None] Creating volume 9ba5f140-51d1-4aca-8d26-4742061e1004 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:25:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6869c6a6-4af8-4da8-88d1-baccf8403a12 tempest-ProjectReaderTests-1986742016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:25:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6869c6a6-4af8-4da8-88d1-baccf8403a12 tempest-ProjectReaderTests-1986742016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:25:54 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6869c6a6-4af8-4da8-88d1-baccf8403a12 tempest-ProjectReaderTests-1986742016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:25:54 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6869c6a6-4af8-4da8-88d1-baccf8403a12 tempest-ProjectReaderTests-1986742016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:25:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6869c6a6-4af8-4da8-88d1-baccf8403a12 tempest-ProjectReaderTests-1986742016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:25:54 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6869c6a6-4af8-4da8-88d1-baccf8403a12 tempest-ProjectReaderTests-1986742016 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:25:54 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-6869c6a6-4af8-4da8-88d1-baccf8403a12 tempest-ProjectReaderTests-1986742016 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:25:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6869c6a6-4af8-4da8-88d1-baccf8403a12 tempest-ProjectReaderTests-1986742016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9ba5f140-51d1-4aca-8d26-4742061e1004 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:54 devstack sudo[105171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9ba5f140-51d1-4aca-8d26-4742061e1004 1073741824 Nov 04 12:25:54 devstack sudo[105171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:54 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-430c9851-4a73-4781-b26b-f2afde5e3a27 tempest-GroupSnapshotsTest-1488589904 None] Created reservations ['149acea8-9645-428b-bd8e-64f6b075eab8', 'd75db427-160e-43c5-957a-cf6818d2cccd', '272ed9de-4b45-4ca7-a076-34c6e14d3131', '4fb092c3-1d56-4c9a-aa5f-9f9c2d448c08'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:25:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-430c9851-4a73-4781-b26b-f2afde5e3a27 tempest-GroupSnapshotsTest-1488589904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:25:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-430c9851-4a73-4781-b26b-f2afde5e3a27 tempest-GroupSnapshotsTest-1488589904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:25:55 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-430c9851-4a73-4781-b26b-f2afde5e3a27 tempest-GroupSnapshotsTest-1488589904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:25:55 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-430c9851-4a73-4781-b26b-f2afde5e3a27 tempest-GroupSnapshotsTest-1488589904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:25:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-430c9851-4a73-4781-b26b-f2afde5e3a27 tempest-GroupSnapshotsTest-1488589904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:25:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-430c9851-4a73-4781-b26b-f2afde5e3a27 tempest-GroupSnapshotsTest-1488589904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:55 devstack sudo[105175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:25:55 devstack sudo[105175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:55 devstack sudo[105171]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6869c6a6-4af8-4da8-88d1-baccf8403a12 tempest-ProjectReaderTests-1986742016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9ba5f140-51d1-4aca-8d26-4742061e1004 1073741824" returned: 0 in 0.525s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6869c6a6-4af8-4da8-88d1-baccf8403a12 tempest-ProjectReaderTests-1986742016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9ba5f140-51d1-4aca-8d26-4742061e1004 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:55 devstack sudo[105175]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-430c9851-4a73-4781-b26b-f2afde5e3a27 tempest-GroupSnapshotsTest-1488589904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.344s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:55 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-430c9851-4a73-4781-b26b-f2afde5e3a27 tempest-GroupSnapshotsTest-1488589904 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:25:55 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-430c9851-4a73-4781-b26b-f2afde5e3a27 tempest-GroupSnapshotsTest-1488589904 None] Delete group completed successfully. Nov 04 12:25:55 devstack sudo[105180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9ba5f140-51d1-4aca-8d26-4742061e1004 Nov 04 12:25:55 devstack sudo[105180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:55 devstack sudo[105180]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6869c6a6-4af8-4da8-88d1-baccf8403a12 tempest-ProjectReaderTests-1986742016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9ba5f140-51d1-4aca-8d26-4742061e1004" returned: 0 in 0.296s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:55 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6869c6a6-4af8-4da8-88d1-baccf8403a12 tempest-ProjectReaderTests-1986742016 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:25:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6869c6a6-4af8-4da8-88d1-baccf8403a12 tempest-ProjectReaderTests-1986742016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:25:55 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6869c6a6-4af8-4da8-88d1-baccf8403a12 tempest-ProjectReaderTests-1986742016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a973672b-47e7-4800-8490-5a47e30ab5a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ba5f140-51d1-4aca-8d26-4742061e1004', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:25:55 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6869c6a6-4af8-4da8-88d1-baccf8403a12 tempest-ProjectReaderTests-1986742016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79ea77c1-b912-40ac-b235-2f5e1a06df50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:25:55 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-6869c6a6-4af8-4da8-88d1-baccf8403a12 tempest-ProjectReaderTests-1986742016 None] Volume volume-9ba5f140-51d1-4aca-8d26-4742061e1004 (9ba5f140-51d1-4aca-8d26-4742061e1004): created successfully Nov 04 12:25:55 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6869c6a6-4af8-4da8-88d1-baccf8403a12 tempest-ProjectReaderTests-1986742016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79ea77c1-b912-40ac-b235-2f5e1a06df50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:25:55 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6869c6a6-4af8-4da8-88d1-baccf8403a12 tempest-ProjectReaderTests-1986742016 None] Flow 'volume_create_manager' (72594b2f-0255-4f0d-90e6-dcb8965f5719) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:25:55 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-6869c6a6-4af8-4da8-88d1-baccf8403a12 tempest-ProjectReaderTests-1986742016 None] Created volume successfully. Nov 04 12:25:55 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-14aed569-df76-4129-bb38-25a31cef746d tempest-GroupSnapshotsTest-1488589904 None] Group tempest-GroupSnapshotsTest-Group-19723767: creating Nov 04 12:25:55 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-14aed569-df76-4129-bb38-25a31cef746d tempest-GroupSnapshotsTest-1488589904 None] Group tempest-GroupSnapshotsTest-Group-19723767: created successfully Nov 04 12:25:55 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-14aed569-df76-4129-bb38-25a31cef746d tempest-GroupSnapshotsTest-1488589904 None] Create group completed successfully. Nov 04 12:25:56 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c0d768c5-c814-40d8-ba2a-4d0d586ea6e5 tempest-ProjectReaderTests-1986742016 None] Acquiring lock "cinder-9ba5f140-51d1-4aca-8d26-4742061e1004-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:25:56 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c0d768c5-c814-40d8-ba2a-4d0d586ea6e5 tempest-ProjectReaderTests-1986742016 None] Lock "cinder-9ba5f140-51d1-4aca-8d26-4742061e1004-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:25:56 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c0d768c5-c814-40d8-ba2a-4d0d586ea6e5 tempest-ProjectReaderTests-1986742016 None] Acquiring lock "cinder-quobyte-9ba5f140-51d1-4aca-8d26-4742061e1004" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:25:56 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c0d768c5-c814-40d8-ba2a-4d0d586ea6e5 tempest-ProjectReaderTests-1986742016 None] Lock "cinder-quobyte-9ba5f140-51d1-4aca-8d26-4742061e1004" acquired by "delete_volume" :: waited 0.014s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:25:56 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[101be3bf-01db-4223-a732-6142822dff76]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:25:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c0d768c5-c814-40d8-ba2a-4d0d586ea6e5 tempest-ProjectReaderTests-1986742016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9ba5f140-51d1-4aca-8d26-4742061e1004 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:57 devstack sudo[105183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9ba5f140-51d1-4aca-8d26-4742061e1004 Nov 04 12:25:57 devstack sudo[105183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:57 devstack sudo[105183]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c0d768c5-c814-40d8-ba2a-4d0d586ea6e5 tempest-ProjectReaderTests-1986742016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9ba5f140-51d1-4aca-8d26-4742061e1004" returned: 0 in 0.469s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c0d768c5-c814-40d8-ba2a-4d0d586ea6e5 tempest-ProjectReaderTests-1986742016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9ba5f140-51d1-4aca-8d26-4742061e1004 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:57 devstack sudo[105188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9ba5f140-51d1-4aca-8d26-4742061e1004 Nov 04 12:25:57 devstack sudo[105188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:57 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-11e87a90-402d-4660-80d7-6f5fced8ff2d tempest-GroupSnapshotsTest-1488589904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:25:57 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-11e87a90-402d-4660-80d7-6f5fced8ff2d tempest-GroupSnapshotsTest-1488589904 None] Flow 'volume_create_manager' (ea91910e-6be6-4273-b2cc-31888a31a46c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:25:57 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-11e87a90-402d-4660-80d7-6f5fced8ff2d tempest-GroupSnapshotsTest-1488589904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb19053a-a309-49f7-99b2-c12484d0cc6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:25:57 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-11e87a90-402d-4660-80d7-6f5fced8ff2d tempest-GroupSnapshotsTest-1488589904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb19053a-a309-49f7-99b2-c12484d0cc6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:25:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-775647154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=51fdfefb-19d1-46e5-93ea-ca27ae9d9651,host='devstack@QuobyteHD#QuobyteHD',id=a34065d8-6b37-41a8-a58b-abfdb93cb7e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6740e312316a4752b9477b306727b158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:25:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:25:57Z,use_quota=True,user_id='e00bfc613c6743edb2db220f7cc9b5ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcfb52f-3d1f-4991-8ae7-4ed49857c387),volume_type_id=ebcfb52f-3d1f-4991-8ae7-4ed49857c387)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:25:57 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-11e87a90-402d-4660-80d7-6f5fced8ff2d tempest-GroupSnapshotsTest-1488589904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (010ab112-9746-4822-b2f9-601fb6ac130d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:25:57 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-11e87a90-402d-4660-80d7-6f5fced8ff2d tempest-GroupSnapshotsTest-1488589904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (010ab112-9746-4822-b2f9-601fb6ac130d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:25:57 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-11e87a90-402d-4660-80d7-6f5fced8ff2d tempest-GroupSnapshotsTest-1488589904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f571b88a-e63d-4966-97f8-411e5a8d5bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:25:57 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-11e87a90-402d-4660-80d7-6f5fced8ff2d tempest-GroupSnapshotsTest-1488589904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f571b88a-e63d-4966-97f8-411e5a8d5bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a34065d8-6b37-41a8-a58b-abfdb93cb7e2', 'volume_name': 'volume-a34065d8-6b37-41a8-a58b-abfdb93cb7e2', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:25:57 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-11e87a90-402d-4660-80d7-6f5fced8ff2d tempest-GroupSnapshotsTest-1488589904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60bbf35b-6010-4b7d-9c26-af2c7d15e6af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:25:57 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-11e87a90-402d-4660-80d7-6f5fced8ff2d tempest-GroupSnapshotsTest-1488589904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60bbf35b-6010-4b7d-9c26-af2c7d15e6af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:25:57 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-11e87a90-402d-4660-80d7-6f5fced8ff2d tempest-GroupSnapshotsTest-1488589904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60aa55bd-b7c7-4e84-9818-a2f3a10ac976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:25:57 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-11e87a90-402d-4660-80d7-6f5fced8ff2d tempest-GroupSnapshotsTest-1488589904 None] Volume a34065d8-6b37-41a8-a58b-abfdb93cb7e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a34065d8-6b37-41a8-a58b-abfdb93cb7e2', 'volume_size': 1} Nov 04 12:25:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-11e87a90-402d-4660-80d7-6f5fced8ff2d tempest-GroupSnapshotsTest-1488589904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:25:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-11e87a90-402d-4660-80d7-6f5fced8ff2d tempest-GroupSnapshotsTest-1488589904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:25:57 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-11e87a90-402d-4660-80d7-6f5fced8ff2d tempest-GroupSnapshotsTest-1488589904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=51fdfefb-19d1-46e5-93ea-ca27ae9d9651,created_at=2026-11-04T11:25:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-775647154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=51fdfefb-19d1-46e5-93ea-ca27ae9d9651,host='devstack@QuobyteHD#QuobyteHD',id=a34065d8-6b37-41a8-a58b-abfdb93cb7e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6740e312316a4752b9477b306727b158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:25:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:25:57Z,use_quota=True,user_id='e00bfc613c6743edb2db220f7cc9b5ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebcfb52f-3d1f-4991-8ae7-4ed49857c387),volume_type_id=ebcfb52f-3d1f-4991-8ae7-4ed49857c387)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:25:57 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-11e87a90-402d-4660-80d7-6f5fced8ff2d tempest-GroupSnapshotsTest-1488589904 None] Creating volume a34065d8-6b37-41a8-a58b-abfdb93cb7e2 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:25:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-11e87a90-402d-4660-80d7-6f5fced8ff2d tempest-GroupSnapshotsTest-1488589904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:25:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-11e87a90-402d-4660-80d7-6f5fced8ff2d tempest-GroupSnapshotsTest-1488589904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:25:57 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-11e87a90-402d-4660-80d7-6f5fced8ff2d tempest-GroupSnapshotsTest-1488589904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:25:57 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-11e87a90-402d-4660-80d7-6f5fced8ff2d tempest-GroupSnapshotsTest-1488589904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:25:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-11e87a90-402d-4660-80d7-6f5fced8ff2d tempest-GroupSnapshotsTest-1488589904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:25:57 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-11e87a90-402d-4660-80d7-6f5fced8ff2d tempest-GroupSnapshotsTest-1488589904 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:25:57 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-11e87a90-402d-4660-80d7-6f5fced8ff2d tempest-GroupSnapshotsTest-1488589904 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:25:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-11e87a90-402d-4660-80d7-6f5fced8ff2d tempest-GroupSnapshotsTest-1488589904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a34065d8-6b37-41a8-a58b-abfdb93cb7e2 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:57 devstack sudo[105201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a34065d8-6b37-41a8-a58b-abfdb93cb7e2 1073741824 Nov 04 12:25:57 devstack sudo[105201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:57 devstack sudo[105188]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c0d768c5-c814-40d8-ba2a-4d0d586ea6e5 tempest-ProjectReaderTests-1986742016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9ba5f140-51d1-4aca-8d26-4742061e1004" returned: 0 in 0.330s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:57 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c0d768c5-c814-40d8-ba2a-4d0d586ea6e5 tempest-ProjectReaderTests-1986742016 None] Lock "cinder-quobyte-9ba5f140-51d1-4aca-8d26-4742061e1004" released by "delete_volume" :: held 0.852s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:25:57 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-c0d768c5-c814-40d8-ba2a-4d0d586ea6e5 tempest-ProjectReaderTests-1986742016 None] Created reservations ['d57cd131-51ea-4d55-aa07-f69ca47f154c', 'fc004af9-ef79-4e49-9d6d-be13f55a6bb7', 'a5534fde-a196-4d2b-aed3-149aff9058ba', '836df32b-72a4-43be-b1df-3bfcb66a7b2e'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:25:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c0d768c5-c814-40d8-ba2a-4d0d586ea6e5 tempest-ProjectReaderTests-1986742016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:25:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c0d768c5-c814-40d8-ba2a-4d0d586ea6e5 tempest-ProjectReaderTests-1986742016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:25:57 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c0d768c5-c814-40d8-ba2a-4d0d586ea6e5 tempest-ProjectReaderTests-1986742016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:25:57 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c0d768c5-c814-40d8-ba2a-4d0d586ea6e5 tempest-ProjectReaderTests-1986742016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:25:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c0d768c5-c814-40d8-ba2a-4d0d586ea6e5 tempest-ProjectReaderTests-1986742016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:25:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c0d768c5-c814-40d8-ba2a-4d0d586ea6e5 tempest-ProjectReaderTests-1986742016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:57 devstack sudo[105206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:25:57 devstack sudo[105206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:58 devstack sudo[105206]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c0d768c5-c814-40d8-ba2a-4d0d586ea6e5 tempest-ProjectReaderTests-1986742016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.307s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:58 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-c0d768c5-c814-40d8-ba2a-4d0d586ea6e5 tempest-ProjectReaderTests-1986742016 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:25:58 devstack sudo[105201]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-11e87a90-402d-4660-80d7-6f5fced8ff2d tempest-GroupSnapshotsTest-1488589904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a34065d8-6b37-41a8-a58b-abfdb93cb7e2 1073741824" returned: 0 in 0.567s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:58 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-c0d768c5-c814-40d8-ba2a-4d0d586ea6e5 tempest-ProjectReaderTests-1986742016 None] Deleted volume successfully. Nov 04 12:25:58 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c0d768c5-c814-40d8-ba2a-4d0d586ea6e5 tempest-ProjectReaderTests-1986742016 None] Lock "cinder-9ba5f140-51d1-4aca-8d26-4742061e1004-delete_volume" released by "delete_volume" :: held 1.390s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:25:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-11e87a90-402d-4660-80d7-6f5fced8ff2d tempest-GroupSnapshotsTest-1488589904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a34065d8-6b37-41a8-a58b-abfdb93cb7e2 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:58 devstack sudo[105211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a34065d8-6b37-41a8-a58b-abfdb93cb7e2 Nov 04 12:25:58 devstack sudo[105211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:58 devstack sudo[105211]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-11e87a90-402d-4660-80d7-6f5fced8ff2d tempest-GroupSnapshotsTest-1488589904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a34065d8-6b37-41a8-a58b-abfdb93cb7e2" returned: 0 in 0.275s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:58 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-11e87a90-402d-4660-80d7-6f5fced8ff2d tempest-GroupSnapshotsTest-1488589904 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:25:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-11e87a90-402d-4660-80d7-6f5fced8ff2d tempest-GroupSnapshotsTest-1488589904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:25:58 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-11e87a90-402d-4660-80d7-6f5fced8ff2d tempest-GroupSnapshotsTest-1488589904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60aa55bd-b7c7-4e84-9818-a2f3a10ac976) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a34065d8-6b37-41a8-a58b-abfdb93cb7e2', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:25:58 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-11e87a90-402d-4660-80d7-6f5fced8ff2d tempest-GroupSnapshotsTest-1488589904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d2d566f-f3e6-424f-8627-6d67e7226067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:25:58 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-11e87a90-402d-4660-80d7-6f5fced8ff2d tempest-GroupSnapshotsTest-1488589904 None] Volume volume-a34065d8-6b37-41a8-a58b-abfdb93cb7e2 (a34065d8-6b37-41a8-a58b-abfdb93cb7e2): created successfully Nov 04 12:25:58 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-11e87a90-402d-4660-80d7-6f5fced8ff2d tempest-GroupSnapshotsTest-1488589904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d2d566f-f3e6-424f-8627-6d67e7226067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:25:58 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-11e87a90-402d-4660-80d7-6f5fced8ff2d tempest-GroupSnapshotsTest-1488589904 None] Flow 'volume_create_manager' (ea91910e-6be6-4273-b2cc-31888a31a46c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:25:58 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-11e87a90-402d-4660-80d7-6f5fced8ff2d tempest-GroupSnapshotsTest-1488589904 None] Created volume successfully. Nov 04 12:25:58 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-33f2af0a-fab3-408c-bb6e-70e85b9ade65 tempest-GroupSnapshotsTest-1488589904 None] GroupSnapshot 0002e297-85d8-49dc-9b4d-5f01855355e2: creating. Nov 04 12:25:58 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-33f2af0a-fab3-408c-bb6e-70e85b9ade65 tempest-GroupSnapshotsTest-1488589904 None] Group snapshot 0002e297-85d8-49dc-9b4d-5f01855355e2: creating. {{(pid=87095) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 04 12:25:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-33f2af0a-fab3-408c-bb6e-70e85b9ade65 tempest-GroupSnapshotsTest-1488589904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:25:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-33f2af0a-fab3-408c-bb6e-70e85b9ade65 tempest-GroupSnapshotsTest-1488589904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:25:59 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-33f2af0a-fab3-408c-bb6e-70e85b9ade65 tempest-GroupSnapshotsTest-1488589904 None] Creating offline snapshot 3ff288c6-92cd-4301-867f-410168dec34c of volume a34065d8-6b37-41a8-a58b-abfdb93cb7e2 {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 12:25:59 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e80c5d-4fca-4f08-9f80-8d03108b75fc]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:25:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-33f2af0a-fab3-408c-bb6e-70e85b9ade65 tempest-GroupSnapshotsTest-1488589904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a34065d8-6b37-41a8-a58b-abfdb93cb7e2 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:59 devstack sudo[105214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a34065d8-6b37-41a8-a58b-abfdb93cb7e2 Nov 04 12:25:59 devstack sudo[105214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:59 devstack sudo[105214]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-33f2af0a-fab3-408c-bb6e-70e85b9ade65 tempest-GroupSnapshotsTest-1488589904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a34065d8-6b37-41a8-a58b-abfdb93cb7e2" returned: 0 in 0.389s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-33f2af0a-fab3-408c-bb6e-70e85b9ade65 tempest-GroupSnapshotsTest-1488589904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a34065d8-6b37-41a8-a58b-abfdb93cb7e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a34065d8-6b37-41a8-a58b-abfdb93cb7e2.3ff288c6-92cd-4301-867f-410168dec34c 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:59 devstack sudo[105219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a34065d8-6b37-41a8-a58b-abfdb93cb7e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a34065d8-6b37-41a8-a58b-abfdb93cb7e2.3ff288c6-92cd-4301-867f-410168dec34c 1G Nov 04 12:25:59 devstack sudo[105219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:25:59 devstack sudo[105219]: pam_unix(sudo:session): session closed for user root Nov 04 12:25:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-33f2af0a-fab3-408c-bb6e-70e85b9ade65 tempest-GroupSnapshotsTest-1488589904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a34065d8-6b37-41a8-a58b-abfdb93cb7e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a34065d8-6b37-41a8-a58b-abfdb93cb7e2.3ff288c6-92cd-4301-867f-410168dec34c 1G" returned: 0 in 0.454s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:25:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-33f2af0a-fab3-408c-bb6e-70e85b9ade65 tempest-GroupSnapshotsTest-1488589904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a34065d8-6b37-41a8-a58b-abfdb93cb7e2 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a34065d8-6b37-41a8-a58b-abfdb93cb7e2.3ff288c6-92cd-4301-867f-410168dec34c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:25:59 devstack sudo[105224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a34065d8-6b37-41a8-a58b-abfdb93cb7e2 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a34065d8-6b37-41a8-a58b-abfdb93cb7e2.3ff288c6-92cd-4301-867f-410168dec34c Nov 04 12:25:59 devstack sudo[105224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:26:00 devstack sudo[105224]: pam_unix(sudo:session): session closed for user root Nov 04 12:26:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-33f2af0a-fab3-408c-bb6e-70e85b9ade65 tempest-GroupSnapshotsTest-1488589904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a34065d8-6b37-41a8-a58b-abfdb93cb7e2 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a34065d8-6b37-41a8-a58b-abfdb93cb7e2.3ff288c6-92cd-4301-867f-410168dec34c" returned: 0 in 0.294s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:26:00 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-33f2af0a-fab3-408c-bb6e-70e85b9ade65 tempest-GroupSnapshotsTest-1488589904 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a34065d8-6b37-41a8-a58b-abfdb93cb7e2.3ff288c6-92cd-4301-867f-410168dec34c is being set with open permissions: ugo+rw: NotImplementedError Nov 04 12:26:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-33f2af0a-fab3-408c-bb6e-70e85b9ade65 tempest-GroupSnapshotsTest-1488589904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a34065d8-6b37-41a8-a58b-abfdb93cb7e2.3ff288c6-92cd-4301-867f-410168dec34c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:26:00 devstack sudo[105230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a34065d8-6b37-41a8-a58b-abfdb93cb7e2.3ff288c6-92cd-4301-867f-410168dec34c Nov 04 12:26:00 devstack sudo[105230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:26:00 devstack sudo[105230]: pam_unix(sudo:session): session closed for user root Nov 04 12:26:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-33f2af0a-fab3-408c-bb6e-70e85b9ade65 tempest-GroupSnapshotsTest-1488589904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a34065d8-6b37-41a8-a58b-abfdb93cb7e2.3ff288c6-92cd-4301-867f-410168dec34c" returned: 0 in 0.242s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:26:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-33f2af0a-fab3-408c-bb6e-70e85b9ade65 tempest-GroupSnapshotsTest-1488589904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a34065d8-6b37-41a8-a58b-abfdb93cb7e2.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:26:00 devstack sudo[105257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a34065d8-6b37-41a8-a58b-abfdb93cb7e2.info Nov 04 12:26:00 devstack sudo[105257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:26:00 devstack sudo[105257]: pam_unix(sudo:session): session closed for user root Nov 04 12:26:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-33f2af0a-fab3-408c-bb6e-70e85b9ade65 tempest-GroupSnapshotsTest-1488589904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a34065d8-6b37-41a8-a58b-abfdb93cb7e2.info" returned: 0 in 0.233s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:26:00 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-33f2af0a-fab3-408c-bb6e-70e85b9ade65 tempest-GroupSnapshotsTest-1488589904 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a34065d8-6b37-41a8-a58b-abfdb93cb7e2.info is being set with open permissions: ugo+rw: NotImplementedError Nov 04 12:26:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-33f2af0a-fab3-408c-bb6e-70e85b9ade65 tempest-GroupSnapshotsTest-1488589904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a34065d8-6b37-41a8-a58b-abfdb93cb7e2.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:26:00 devstack sudo[105260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a34065d8-6b37-41a8-a58b-abfdb93cb7e2.info Nov 04 12:26:00 devstack sudo[105260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:26:00 devstack sudo[105260]: pam_unix(sudo:session): session closed for user root Nov 04 12:26:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-33f2af0a-fab3-408c-bb6e-70e85b9ade65 tempest-GroupSnapshotsTest-1488589904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a34065d8-6b37-41a8-a58b-abfdb93cb7e2.info" returned: 0 in 0.235s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:26:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-33f2af0a-fab3-408c-bb6e-70e85b9ade65 tempest-GroupSnapshotsTest-1488589904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.929s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:26:00 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-33f2af0a-fab3-408c-bb6e-70e85b9ade65 tempest-GroupSnapshotsTest-1488589904 None] group_snapshot 0002e297-85d8-49dc-9b4d-5f01855355e2: created successfully Nov 04 12:26:01 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-15fde32d-2817-4c39-bbf3-b05dc5995230 tempest-GroupSnapshotsTest-1488589904 None] group_snapshot 0002e297-85d8-49dc-9b4d-5f01855355e2: deleting Nov 04 12:26:01 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-15fde32d-2817-4c39-bbf3-b05dc5995230 tempest-GroupSnapshotsTest-1488589904 None] group_snapshot 0002e297-85d8-49dc-9b4d-5f01855355e2: deleting {{(pid=87095) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 04 12:26:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-15fde32d-2817-4c39-bbf3-b05dc5995230 tempest-GroupSnapshotsTest-1488589904 None] Acquiring lock "cinder-quobyte-a34065d8-6b37-41a8-a58b-abfdb93cb7e2" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:26:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-15fde32d-2817-4c39-bbf3-b05dc5995230 tempest-GroupSnapshotsTest-1488589904 None] Lock "cinder-quobyte-a34065d8-6b37-41a8-a58b-abfdb93cb7e2" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:26:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-15fde32d-2817-4c39-bbf3-b05dc5995230 tempest-GroupSnapshotsTest-1488589904 None] Acquiring lock "cinder-quobyte-3ff288c6-92cd-4301-867f-410168dec34c" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:26:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-15fde32d-2817-4c39-bbf3-b05dc5995230 tempest-GroupSnapshotsTest-1488589904 None] Lock "cinder-quobyte-3ff288c6-92cd-4301-867f-410168dec34c" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:26:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-15fde32d-2817-4c39-bbf3-b05dc5995230 tempest-GroupSnapshotsTest-1488589904 None] Deleting offline snapshot 3ff288c6-92cd-4301-867f-410168dec34c of volume a34065d8-6b37-41a8-a58b-abfdb93cb7e2 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 12:26:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-15fde32d-2817-4c39-bbf3-b05dc5995230 tempest-GroupSnapshotsTest-1488589904 None] snapshot_file for this snap is: volume-a34065d8-6b37-41a8-a58b-abfdb93cb7e2.3ff288c6-92cd-4301-867f-410168dec34c {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 12:26:01 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d521f6dd-960f-4d31-bacd-42d8a49d3655]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:26:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-15fde32d-2817-4c39-bbf3-b05dc5995230 tempest-GroupSnapshotsTest-1488589904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a34065d8-6b37-41a8-a58b-abfdb93cb7e2.3ff288c6-92cd-4301-867f-410168dec34c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:26:01 devstack sudo[105263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a34065d8-6b37-41a8-a58b-abfdb93cb7e2.3ff288c6-92cd-4301-867f-410168dec34c Nov 04 12:26:01 devstack sudo[105263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:26:01 devstack sudo[105263]: pam_unix(sudo:session): session closed for user root Nov 04 12:26:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-15fde32d-2817-4c39-bbf3-b05dc5995230 tempest-GroupSnapshotsTest-1488589904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a34065d8-6b37-41a8-a58b-abfdb93cb7e2.3ff288c6-92cd-4301-867f-410168dec34c" returned: 0 in 0.351s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:26:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-15fde32d-2817-4c39-bbf3-b05dc5995230 tempest-GroupSnapshotsTest-1488589904 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a34065d8-6b37-41a8-a58b-abfdb93cb7e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 12:26:01 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d784664-d662-4742-99a8-3db2a6032ecc]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:26:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-15fde32d-2817-4c39-bbf3-b05dc5995230 tempest-GroupSnapshotsTest-1488589904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a34065d8-6b37-41a8-a58b-abfdb93cb7e2 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:26:01 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 12:26:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:26:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:26:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:26:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:26:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:26:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:26:01 devstack sudo[105268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a34065d8-6b37-41a8-a58b-abfdb93cb7e2 Nov 04 12:26:01 devstack sudo[105268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:26:01 devstack sudo[105269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:26:01 devstack sudo[105269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:26:02 devstack sudo[105269]: pam_unix(sudo:session): session closed for user root Nov 04 12:26:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.253s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:26:02 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:26:02 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Running periodic task VolumeManager._thread_info {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 12:26:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] thread count: 28 {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 12:26:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] thread info: [<_MainThread(MainThread, started 140610387472512)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 12:26:02 devstack sudo[105268]: pam_unix(sudo:session): session closed for user root Nov 04 12:26:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-15fde32d-2817-4c39-bbf3-b05dc5995230 tempest-GroupSnapshotsTest-1488589904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a34065d8-6b37-41a8-a58b-abfdb93cb7e2" returned: 0 in 0.379s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:26:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-15fde32d-2817-4c39-bbf3-b05dc5995230 tempest-GroupSnapshotsTest-1488589904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a34065d8-6b37-41a8-a58b-abfdb93cb7e2.3ff288c6-92cd-4301-867f-410168dec34c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:26:02 devstack sudo[105276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a34065d8-6b37-41a8-a58b-abfdb93cb7e2.3ff288c6-92cd-4301-867f-410168dec34c Nov 04 12:26:02 devstack sudo[105276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:26:02 devstack sudo[105276]: pam_unix(sudo:session): session closed for user root Nov 04 12:26:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-15fde32d-2817-4c39-bbf3-b05dc5995230 tempest-GroupSnapshotsTest-1488589904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a34065d8-6b37-41a8-a58b-abfdb93cb7e2.3ff288c6-92cd-4301-867f-410168dec34c" returned: 0 in 0.339s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:26:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-15fde32d-2817-4c39-bbf3-b05dc5995230 tempest-GroupSnapshotsTest-1488589904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a34065d8-6b37-41a8-a58b-abfdb93cb7e2.3ff288c6-92cd-4301-867f-410168dec34c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:26:02 devstack sudo[105281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a34065d8-6b37-41a8-a58b-abfdb93cb7e2.3ff288c6-92cd-4301-867f-410168dec34c Nov 04 12:26:02 devstack sudo[105281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:26:02 devstack sudo[105281]: pam_unix(sudo:session): session closed for user root Nov 04 12:26:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-15fde32d-2817-4c39-bbf3-b05dc5995230 tempest-GroupSnapshotsTest-1488589904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a34065d8-6b37-41a8-a58b-abfdb93cb7e2.3ff288c6-92cd-4301-867f-410168dec34c" returned: 0 in 0.244s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:26:02 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-15fde32d-2817-4c39-bbf3-b05dc5995230 tempest-GroupSnapshotsTest-1488589904 None] Lock "cinder-quobyte-3ff288c6-92cd-4301-867f-410168dec34c" released by "_delete_snapshot" :: held 1.417s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:26:02 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-15fde32d-2817-4c39-bbf3-b05dc5995230 tempest-GroupSnapshotsTest-1488589904 None] Lock "cinder-quobyte-a34065d8-6b37-41a8-a58b-abfdb93cb7e2" released by "delete_snapshot" :: held 1.440s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:26:02 devstack cinder-volume[87095]: WARNING cinder.quota [None req-15fde32d-2817-4c39-bbf3-b05dc5995230 tempest-GroupSnapshotsTest-1488589904 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-280769207 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-280769207, it is now deprecated. Please use the default quota class for default quota. Nov 04 12:26:02 devstack cinder-volume[87095]: WARNING cinder.quota [None req-15fde32d-2817-4c39-bbf3-b05dc5995230 tempest-GroupSnapshotsTest-1488589904 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-280769207 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-280769207, it is now deprecated. Please use the default quota class for default quota. Nov 04 12:26:02 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-15fde32d-2817-4c39-bbf3-b05dc5995230 tempest-GroupSnapshotsTest-1488589904 None] Created reservations ['de25c40b-ee33-4ff4-9f27-3a5d95a9128f', 'a0b4cd8c-8093-44f9-97ca-f5893b89685d', '4fb576d0-987f-4566-869c-e86c3f637318', '66c70871-6486-4fdc-9245-14ea3253db07'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:26:02 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-15fde32d-2817-4c39-bbf3-b05dc5995230 tempest-GroupSnapshotsTest-1488589904 None] group_snapshot 0002e297-85d8-49dc-9b4d-5f01855355e2: deleted successfully Nov 04 12:26:03 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-19e31222-8f7d-4735-961e-854e40bed31f tempest-GroupSnapshotsTest-1488589904 None] Acquiring lock "cinder-quobyte-a34065d8-6b37-41a8-a58b-abfdb93cb7e2" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:26:03 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-19e31222-8f7d-4735-961e-854e40bed31f tempest-GroupSnapshotsTest-1488589904 None] Lock "cinder-quobyte-a34065d8-6b37-41a8-a58b-abfdb93cb7e2" acquired by "delete_volume" :: waited 0.016s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:26:03 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a1048e-0f4e-4239-91dc-23c15f1bb902]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:26:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-19e31222-8f7d-4735-961e-854e40bed31f tempest-GroupSnapshotsTest-1488589904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a34065d8-6b37-41a8-a58b-abfdb93cb7e2 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:26:03 devstack sudo[105285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a34065d8-6b37-41a8-a58b-abfdb93cb7e2 Nov 04 12:26:03 devstack sudo[105285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:26:04 devstack sudo[105285]: pam_unix(sudo:session): session closed for user root Nov 04 12:26:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-19e31222-8f7d-4735-961e-854e40bed31f tempest-GroupSnapshotsTest-1488589904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a34065d8-6b37-41a8-a58b-abfdb93cb7e2" returned: 0 in 0.362s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:26:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-19e31222-8f7d-4735-961e-854e40bed31f tempest-GroupSnapshotsTest-1488589904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a34065d8-6b37-41a8-a58b-abfdb93cb7e2 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:26:04 devstack sudo[105290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a34065d8-6b37-41a8-a58b-abfdb93cb7e2 Nov 04 12:26:04 devstack sudo[105290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:26:04 devstack sudo[105290]: pam_unix(sudo:session): session closed for user root Nov 04 12:26:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-19e31222-8f7d-4735-961e-854e40bed31f tempest-GroupSnapshotsTest-1488589904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a34065d8-6b37-41a8-a58b-abfdb93cb7e2" returned: 0 in 0.258s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:26:04 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-19e31222-8f7d-4735-961e-854e40bed31f tempest-GroupSnapshotsTest-1488589904 None] Lock "cinder-quobyte-a34065d8-6b37-41a8-a58b-abfdb93cb7e2" released by "delete_volume" :: held 0.690s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:26:04 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-19e31222-8f7d-4735-961e-854e40bed31f tempest-GroupSnapshotsTest-1488589904 None] Created reservations ['1b8499f8-ecf2-4bd3-8033-0c6aef323621'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:26:04 devstack cinder-volume[87095]: WARNING cinder.quota [None req-19e31222-8f7d-4735-961e-854e40bed31f tempest-GroupSnapshotsTest-1488589904 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-280769207 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-280769207, it is now deprecated. Please use the default quota class for default quota. Nov 04 12:26:04 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-19e31222-8f7d-4735-961e-854e40bed31f tempest-GroupSnapshotsTest-1488589904 None] Created reservations ['9c0a2516-b248-42a0-a00b-c7e53a844b24', 'fc68fd9f-cb6b-4ca2-b806-76107fc27262', 'fab15715-8676-4be5-932c-30883155e370', '74fac210-31d3-4a58-92a3-216caad897fe'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:26:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-19e31222-8f7d-4735-961e-854e40bed31f tempest-GroupSnapshotsTest-1488589904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:26:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-19e31222-8f7d-4735-961e-854e40bed31f tempest-GroupSnapshotsTest-1488589904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:26:04 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-19e31222-8f7d-4735-961e-854e40bed31f tempest-GroupSnapshotsTest-1488589904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:26:04 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-19e31222-8f7d-4735-961e-854e40bed31f tempest-GroupSnapshotsTest-1488589904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:26:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-19e31222-8f7d-4735-961e-854e40bed31f tempest-GroupSnapshotsTest-1488589904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:26:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-19e31222-8f7d-4735-961e-854e40bed31f tempest-GroupSnapshotsTest-1488589904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:26:04 devstack sudo[105293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:26:04 devstack sudo[105293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:26:05 devstack sudo[105293]: pam_unix(sudo:session): session closed for user root Nov 04 12:26:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-19e31222-8f7d-4735-961e-854e40bed31f tempest-GroupSnapshotsTest-1488589904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.269s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:26:05 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-19e31222-8f7d-4735-961e-854e40bed31f tempest-GroupSnapshotsTest-1488589904 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:26:05 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-19e31222-8f7d-4735-961e-854e40bed31f tempest-GroupSnapshotsTest-1488589904 None] Delete group completed successfully. Nov 04 12:26:14 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=178,cinder:UPDATE=211,cinder:INSERT=53,cinder:DELETE=7 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 12:26:14 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=193,cinder:UPDATE=195,cinder:INSERT=44,cinder:DELETE=13 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 12:26:15 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-738cb7f7-dabc-48f3-9155-650160317356 tempest-GroupsV314Test-1574689884 None] Group tempest-GroupsV314Test-Group-147125268: creating Nov 04 12:26:15 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-738cb7f7-dabc-48f3-9155-650160317356 tempest-GroupsV314Test-1574689884 None] Group tempest-GroupsV314Test-Group-147125268: created successfully Nov 04 12:26:15 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-738cb7f7-dabc-48f3-9155-650160317356 tempest-GroupsV314Test-1574689884 None] Create group completed successfully. Nov 04 12:26:17 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc79fa81-2bbe-4aca-bc09-a1daff963b74 tempest-GroupsV314Test-1574689884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:26:17 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-bc79fa81-2bbe-4aca-bc09-a1daff963b74 tempest-GroupsV314Test-1574689884 None] Flow 'volume_create_manager' (4ca28296-44e6-4f85-98b1-7a188be495de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:26:17 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-bc79fa81-2bbe-4aca-bc09-a1daff963b74 tempest-GroupsV314Test-1574689884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da6225e5-19d6-42be-92d7-d55645eacc9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:26:17 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-bc79fa81-2bbe-4aca-bc09-a1daff963b74 tempest-GroupsV314Test-1574689884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da6225e5-19d6-42be-92d7-d55645eacc9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:26:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1528502350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=898d5746-9f12-4a52-b113-f3d7a1de9f58,host='devstack@QuobyteHD#QuobyteHD',id=bf771731-d9d4-4c7a-9d3b-7c2346134ac3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58721438b01b4c59ac5502bf52de1304',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:26:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:26:17Z,use_quota=True,user_id='7bc899532981455c89127be84ed69566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f79709-c24b-44fd-84d5-0ac00d3e45ee),volume_type_id=b5f79709-c24b-44fd-84d5-0ac00d3e45ee)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:26:17 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-bc79fa81-2bbe-4aca-bc09-a1daff963b74 tempest-GroupsV314Test-1574689884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7c56037-0c2d-465f-a85a-32c9dcb5f4ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:26:17 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-bc79fa81-2bbe-4aca-bc09-a1daff963b74 tempest-GroupsV314Test-1574689884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7c56037-0c2d-465f-a85a-32c9dcb5f4ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:26:17 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-bc79fa81-2bbe-4aca-bc09-a1daff963b74 tempest-GroupsV314Test-1574689884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (428a39ca-a80f-438f-9c90-161e48a8276b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:26:17 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-bc79fa81-2bbe-4aca-bc09-a1daff963b74 tempest-GroupsV314Test-1574689884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (428a39ca-a80f-438f-9c90-161e48a8276b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf771731-d9d4-4c7a-9d3b-7c2346134ac3', 'volume_name': 'volume-bf771731-d9d4-4c7a-9d3b-7c2346134ac3', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:26:17 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-bc79fa81-2bbe-4aca-bc09-a1daff963b74 tempest-GroupsV314Test-1574689884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfdfa29b-7f1e-44de-b1f7-f37ad8efd733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:26:17 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-bc79fa81-2bbe-4aca-bc09-a1daff963b74 tempest-GroupsV314Test-1574689884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfdfa29b-7f1e-44de-b1f7-f37ad8efd733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:26:17 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-bc79fa81-2bbe-4aca-bc09-a1daff963b74 tempest-GroupsV314Test-1574689884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01c67cb9-8fe9-46b5-858c-3bd8e7701b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:26:17 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-bc79fa81-2bbe-4aca-bc09-a1daff963b74 tempest-GroupsV314Test-1574689884 None] Volume bf771731-d9d4-4c7a-9d3b-7c2346134ac3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf771731-d9d4-4c7a-9d3b-7c2346134ac3', 'volume_size': 1} Nov 04 12:26:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-bc79fa81-2bbe-4aca-bc09-a1daff963b74 tempest-GroupsV314Test-1574689884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:26:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-bc79fa81-2bbe-4aca-bc09-a1daff963b74 tempest-GroupsV314Test-1574689884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:26:17 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-bc79fa81-2bbe-4aca-bc09-a1daff963b74 tempest-GroupsV314Test-1574689884 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=898d5746-9f12-4a52-b113-f3d7a1de9f58,created_at=2026-11-04T11:26:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1528502350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=898d5746-9f12-4a52-b113-f3d7a1de9f58,host='devstack@QuobyteHD#QuobyteHD',id=bf771731-d9d4-4c7a-9d3b-7c2346134ac3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58721438b01b4c59ac5502bf52de1304',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:26:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:26:17Z,use_quota=True,user_id='7bc899532981455c89127be84ed69566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f79709-c24b-44fd-84d5-0ac00d3e45ee),volume_type_id=b5f79709-c24b-44fd-84d5-0ac00d3e45ee)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:26:17 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-bc79fa81-2bbe-4aca-bc09-a1daff963b74 tempest-GroupsV314Test-1574689884 None] Creating volume bf771731-d9d4-4c7a-9d3b-7c2346134ac3 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:26:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-bc79fa81-2bbe-4aca-bc09-a1daff963b74 tempest-GroupsV314Test-1574689884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:26:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-bc79fa81-2bbe-4aca-bc09-a1daff963b74 tempest-GroupsV314Test-1574689884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:26:17 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-bc79fa81-2bbe-4aca-bc09-a1daff963b74 tempest-GroupsV314Test-1574689884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:26:17 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-bc79fa81-2bbe-4aca-bc09-a1daff963b74 tempest-GroupsV314Test-1574689884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:26:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-bc79fa81-2bbe-4aca-bc09-a1daff963b74 tempest-GroupsV314Test-1574689884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:26:17 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-bc79fa81-2bbe-4aca-bc09-a1daff963b74 tempest-GroupsV314Test-1574689884 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:26:17 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-bc79fa81-2bbe-4aca-bc09-a1daff963b74 tempest-GroupsV314Test-1574689884 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:26:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-bc79fa81-2bbe-4aca-bc09-a1daff963b74 tempest-GroupsV314Test-1574689884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bf771731-d9d4-4c7a-9d3b-7c2346134ac3 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:26:17 devstack sudo[105299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bf771731-d9d4-4c7a-9d3b-7c2346134ac3 1073741824 Nov 04 12:26:17 devstack sudo[105299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:26:17 devstack sudo[105299]: pam_unix(sudo:session): session closed for user root Nov 04 12:26:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-bc79fa81-2bbe-4aca-bc09-a1daff963b74 tempest-GroupsV314Test-1574689884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bf771731-d9d4-4c7a-9d3b-7c2346134ac3 1073741824" returned: 0 in 0.425s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:26:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-bc79fa81-2bbe-4aca-bc09-a1daff963b74 tempest-GroupsV314Test-1574689884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bf771731-d9d4-4c7a-9d3b-7c2346134ac3 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:26:17 devstack sudo[105305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bf771731-d9d4-4c7a-9d3b-7c2346134ac3 Nov 04 12:26:17 devstack sudo[105305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:26:18 devstack sudo[105305]: pam_unix(sudo:session): session closed for user root Nov 04 12:26:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-bc79fa81-2bbe-4aca-bc09-a1daff963b74 tempest-GroupsV314Test-1574689884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bf771731-d9d4-4c7a-9d3b-7c2346134ac3" returned: 0 in 0.249s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:26:18 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-bc79fa81-2bbe-4aca-bc09-a1daff963b74 tempest-GroupsV314Test-1574689884 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:26:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-bc79fa81-2bbe-4aca-bc09-a1daff963b74 tempest-GroupsV314Test-1574689884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:26:18 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-bc79fa81-2bbe-4aca-bc09-a1daff963b74 tempest-GroupsV314Test-1574689884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01c67cb9-8fe9-46b5-858c-3bd8e7701b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf771731-d9d4-4c7a-9d3b-7c2346134ac3', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:26:18 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-bc79fa81-2bbe-4aca-bc09-a1daff963b74 tempest-GroupsV314Test-1574689884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd28b7c3-63fc-4e60-b9e5-cdac3cd58fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:26:18 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-bc79fa81-2bbe-4aca-bc09-a1daff963b74 tempest-GroupsV314Test-1574689884 None] Volume volume-bf771731-d9d4-4c7a-9d3b-7c2346134ac3 (bf771731-d9d4-4c7a-9d3b-7c2346134ac3): created successfully Nov 04 12:26:18 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-bc79fa81-2bbe-4aca-bc09-a1daff963b74 tempest-GroupsV314Test-1574689884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd28b7c3-63fc-4e60-b9e5-cdac3cd58fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:26:18 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-bc79fa81-2bbe-4aca-bc09-a1daff963b74 tempest-GroupsV314Test-1574689884 None] Flow 'volume_create_manager' (4ca28296-44e6-4f85-98b1-7a188be495de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:26:18 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-bc79fa81-2bbe-4aca-bc09-a1daff963b74 tempest-GroupsV314Test-1574689884 None] Created volume successfully. Nov 04 12:26:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-340c8544-27b0-453d-8e26-d1969800348d tempest-GroupsV314Test-1574689884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:26:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-340c8544-27b0-453d-8e26-d1969800348d tempest-GroupsV314Test-1574689884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:26:18 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-340c8544-27b0-453d-8e26-d1969800348d tempest-GroupsV314Test-1574689884 None] Cloning volume bf771731-d9d4-4c7a-9d3b-7c2346134ac3 to volume dca3386f-e7f3-4aee-a10f-cf979324fd88 Nov 04 12:26:18 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-340c8544-27b0-453d-8e26-d1969800348d tempest-GroupsV314Test-1574689884 None] Creating offline snapshot ee6075cf-a41a-463f-ac40-5e9f3199ca8c of volume bf771731-d9d4-4c7a-9d3b-7c2346134ac3 {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 12:26:18 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a9ec8a0-c607-41ff-a621-352e4e9b4251]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:26:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-340c8544-27b0-453d-8e26-d1969800348d tempest-GroupsV314Test-1574689884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bf771731-d9d4-4c7a-9d3b-7c2346134ac3 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:26:19 devstack sudo[105310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bf771731-d9d4-4c7a-9d3b-7c2346134ac3 Nov 04 12:26:19 devstack sudo[105310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:26:19 devstack sudo[105310]: pam_unix(sudo:session): session closed for user root Nov 04 12:26:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-340c8544-27b0-453d-8e26-d1969800348d tempest-GroupsV314Test-1574689884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bf771731-d9d4-4c7a-9d3b-7c2346134ac3" returned: 0 in 0.383s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:26:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-340c8544-27b0-453d-8e26-d1969800348d tempest-GroupsV314Test-1574689884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bf771731-d9d4-4c7a-9d3b-7c2346134ac3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bf771731-d9d4-4c7a-9d3b-7c2346134ac3.ee6075cf-a41a-463f-ac40-5e9f3199ca8c 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:26:19 devstack sudo[105315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bf771731-d9d4-4c7a-9d3b-7c2346134ac3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bf771731-d9d4-4c7a-9d3b-7c2346134ac3.ee6075cf-a41a-463f-ac40-5e9f3199ca8c 1G Nov 04 12:26:19 devstack sudo[105315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:26:19 devstack sudo[105315]: pam_unix(sudo:session): session closed for user root Nov 04 12:26:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-340c8544-27b0-453d-8e26-d1969800348d tempest-GroupsV314Test-1574689884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bf771731-d9d4-4c7a-9d3b-7c2346134ac3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bf771731-d9d4-4c7a-9d3b-7c2346134ac3.ee6075cf-a41a-463f-ac40-5e9f3199ca8c 1G" returned: 0 in 0.371s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:26:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-340c8544-27b0-453d-8e26-d1969800348d tempest-GroupsV314Test-1574689884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf771731-d9d4-4c7a-9d3b-7c2346134ac3 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bf771731-d9d4-4c7a-9d3b-7c2346134ac3.ee6075cf-a41a-463f-ac40-5e9f3199ca8c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:26:19 devstack sudo[105321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf771731-d9d4-4c7a-9d3b-7c2346134ac3 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bf771731-d9d4-4c7a-9d3b-7c2346134ac3.ee6075cf-a41a-463f-ac40-5e9f3199ca8c Nov 04 12:26:19 devstack sudo[105321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:26:20 devstack sudo[105321]: pam_unix(sudo:session): session closed for user root Nov 04 12:26:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-340c8544-27b0-453d-8e26-d1969800348d tempest-GroupsV314Test-1574689884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf771731-d9d4-4c7a-9d3b-7c2346134ac3 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bf771731-d9d4-4c7a-9d3b-7c2346134ac3.ee6075cf-a41a-463f-ac40-5e9f3199ca8c" returned: 0 in 0.272s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:26:20 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-340c8544-27b0-453d-8e26-d1969800348d tempest-GroupsV314Test-1574689884 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bf771731-d9d4-4c7a-9d3b-7c2346134ac3.ee6075cf-a41a-463f-ac40-5e9f3199ca8c is being set with open permissions: ugo+rw: NotImplementedError Nov 04 12:26:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-340c8544-27b0-453d-8e26-d1969800348d tempest-GroupsV314Test-1574689884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bf771731-d9d4-4c7a-9d3b-7c2346134ac3.ee6075cf-a41a-463f-ac40-5e9f3199ca8c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:26:20 devstack sudo[105326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bf771731-d9d4-4c7a-9d3b-7c2346134ac3.ee6075cf-a41a-463f-ac40-5e9f3199ca8c Nov 04 12:26:20 devstack sudo[105326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:26:20 devstack sudo[105326]: pam_unix(sudo:session): session closed for user root Nov 04 12:26:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-340c8544-27b0-453d-8e26-d1969800348d tempest-GroupsV314Test-1574689884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bf771731-d9d4-4c7a-9d3b-7c2346134ac3.ee6075cf-a41a-463f-ac40-5e9f3199ca8c" returned: 0 in 0.247s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:26:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-340c8544-27b0-453d-8e26-d1969800348d tempest-GroupsV314Test-1574689884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bf771731-d9d4-4c7a-9d3b-7c2346134ac3.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:26:20 devstack sudo[105331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bf771731-d9d4-4c7a-9d3b-7c2346134ac3.info Nov 04 12:26:20 devstack sudo[105331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:26:20 devstack sudo[105331]: pam_unix(sudo:session): session closed for user root Nov 04 12:26:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-340c8544-27b0-453d-8e26-d1969800348d tempest-GroupsV314Test-1574689884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bf771731-d9d4-4c7a-9d3b-7c2346134ac3.info" returned: 0 in 0.258s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:26:20 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-340c8544-27b0-453d-8e26-d1969800348d tempest-GroupsV314Test-1574689884 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bf771731-d9d4-4c7a-9d3b-7c2346134ac3.info is being set with open permissions: ugo+rw: NotImplementedError Nov 04 12:26:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-340c8544-27b0-453d-8e26-d1969800348d tempest-GroupsV314Test-1574689884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bf771731-d9d4-4c7a-9d3b-7c2346134ac3.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:26:20 devstack sudo[105336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bf771731-d9d4-4c7a-9d3b-7c2346134ac3.info Nov 04 12:26:20 devstack sudo[105336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:26:20 devstack sudo[105336]: pam_unix(sudo:session): session closed for user root Nov 04 12:26:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-340c8544-27b0-453d-8e26-d1969800348d tempest-GroupsV314Test-1574689884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bf771731-d9d4-4c7a-9d3b-7c2346134ac3.info" returned: 0 in 0.242s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:26:20 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-340c8544-27b0-453d-8e26-d1969800348d tempest-GroupsV314Test-1574689884 None] Acquiring lock "cinder-quobyte-dca3386f-e7f3-4aee-a10f-cf979324fd88" by "_copy_volume_from_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:26:20 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-340c8544-27b0-453d-8e26-d1969800348d tempest-GroupsV314Test-1574689884 None] Lock "cinder-quobyte-dca3386f-e7f3-4aee-a10f-cf979324fd88" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:26:20 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-340c8544-27b0-453d-8e26-d1969800348d tempest-GroupsV314Test-1574689884 None] snapshot: ee6075cf-a41a-463f-ac40-5e9f3199ca8c, volume: dca3386f-e7f3-4aee-a10f-cf979324fd88, {{(pid=87095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 12:26:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-340c8544-27b0-453d-8e26-d1969800348d tempest-GroupsV314Test-1574689884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:26:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-340c8544-27b0-453d-8e26-d1969800348d tempest-GroupsV314Test-1574689884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:26:20 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-340c8544-27b0-453d-8e26-d1969800348d tempest-GroupsV314Test-1574689884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:26:20 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-340c8544-27b0-453d-8e26-d1969800348d tempest-GroupsV314Test-1574689884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:26:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-340c8544-27b0-453d-8e26-d1969800348d tempest-GroupsV314Test-1574689884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:26:20 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[24686ecc-e5fb-4614-8de4-b92d559cfe69]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:26:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-340c8544-27b0-453d-8e26-d1969800348d tempest-GroupsV314Test-1574689884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bf771731-d9d4-4c7a-9d3b-7c2346134ac3.ee6075cf-a41a-463f-ac40-5e9f3199ca8c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:26:21 devstack sudo[105339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bf771731-d9d4-4c7a-9d3b-7c2346134ac3.ee6075cf-a41a-463f-ac40-5e9f3199ca8c Nov 04 12:26:21 devstack sudo[105339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:26:21 devstack sudo[105339]: pam_unix(sudo:session): session closed for user root Nov 04 12:26:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-340c8544-27b0-453d-8e26-d1969800348d tempest-GroupsV314Test-1574689884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bf771731-d9d4-4c7a-9d3b-7c2346134ac3.ee6075cf-a41a-463f-ac40-5e9f3199ca8c" returned: 0 in 0.373s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:26:21 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-340c8544-27b0-453d-8e26-d1969800348d tempest-GroupsV314Test-1574689884 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf771731-d9d4-4c7a-9d3b-7c2346134ac3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 12:26:21 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a8527c-a554-4c11-ada4-48fc03205d54]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:26:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-340c8544-27b0-453d-8e26-d1969800348d tempest-GroupsV314Test-1574689884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bf771731-d9d4-4c7a-9d3b-7c2346134ac3 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:26:21 devstack sudo[105347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bf771731-d9d4-4c7a-9d3b-7c2346134ac3 Nov 04 12:26:21 devstack sudo[105347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:26:21 devstack sudo[105347]: pam_unix(sudo:session): session closed for user root Nov 04 12:26:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-340c8544-27b0-453d-8e26-d1969800348d tempest-GroupsV314Test-1574689884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bf771731-d9d4-4c7a-9d3b-7c2346134ac3" returned: 0 in 0.490s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:26:21 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-340c8544-27b0-453d-8e26-d1969800348d tempest-GroupsV314Test-1574689884 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bf771731-d9d4-4c7a-9d3b-7c2346134ac3 {{(pid=87095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 12:26:21 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-340c8544-27b0-453d-8e26-d1969800348d tempest-GroupsV314Test-1574689884 None] Creating direct copy from snapshot {{(pid=87095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 12:26:21 devstack cinder-volume[87095]: DEBUG cinder.utils [None req-340c8544-27b0-453d-8e26-d1969800348d tempest-GroupsV314Test-1574689884 None] Path /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-dca3386f-e7f3-4aee-a10f-cf979324fd88 not found in is_blk_device check {{(pid=87095) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 04 12:26:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-340c8544-27b0-453d-8e26-d1969800348d tempest-GroupsV314Test-1574689884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bf771731-d9d4-4c7a-9d3b-7c2346134ac3 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-dca3386f-e7f3-4aee-a10f-cf979324fd88 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:26:21 devstack sudo[105354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bf771731-d9d4-4c7a-9d3b-7c2346134ac3 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-dca3386f-e7f3-4aee-a10f-cf979324fd88 Nov 04 12:26:21 devstack sudo[105354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:26:23 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-be77c992-59ad-4037-9f23-c4b08de4a1bb req-689d44c5-8c01-4b55-9fb0-62cc6e6929df tempest-TestShelveInstance-181440490 None] Terminate volume connection completed successfully. Nov 04 12:26:23 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-be77c992-59ad-4037-9f23-c4b08de4a1bb req-689d44c5-8c01-4b55-9fb0-62cc6e6929df tempest-TestShelveInstance-181440490 None] Deleting attachment 7d8609d9-2d05-4506-bc6b-f16c8c5e6e58. {{(pid=87095) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 12:26:23 devstack cinder-volume[87095]: DEBUG cinder.coordination [req-be77c992-59ad-4037-9f23-c4b08de4a1bb req-94bafb76-1ded-46de-8fb0-859b767405cb tempest-TestShelveInstance-181440490 None] Acquiring lock "cinder-3657e41b-da17-451a-8749-edb5fed7bcd6-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:26:23 devstack cinder-volume[87095]: DEBUG cinder.coordination [req-be77c992-59ad-4037-9f23-c4b08de4a1bb req-94bafb76-1ded-46de-8fb0-859b767405cb tempest-TestShelveInstance-181440490 None] Lock "cinder-3657e41b-da17-451a-8749-edb5fed7bcd6-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:26:23 devstack cinder-volume[87095]: DEBUG cinder.coordination [req-be77c992-59ad-4037-9f23-c4b08de4a1bb req-94bafb76-1ded-46de-8fb0-859b767405cb tempest-TestShelveInstance-181440490 None] Acquiring lock "cinder-quobyte-3657e41b-da17-451a-8749-edb5fed7bcd6" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:26:23 devstack cinder-volume[87095]: DEBUG cinder.coordination [req-be77c992-59ad-4037-9f23-c4b08de4a1bb req-94bafb76-1ded-46de-8fb0-859b767405cb tempest-TestShelveInstance-181440490 None] Lock "cinder-quobyte-3657e41b-da17-451a-8749-edb5fed7bcd6" acquired by "delete_volume" :: waited 0.018s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:26:23 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[69edb499-200b-4a28-bf17-6a022cd892ab]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:26:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-be77c992-59ad-4037-9f23-c4b08de4a1bb req-94bafb76-1ded-46de-8fb0-859b767405cb tempest-TestShelveInstance-181440490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-3657e41b-da17-451a-8749-edb5fed7bcd6 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:26:24 devstack sudo[105388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-3657e41b-da17-451a-8749-edb5fed7bcd6 Nov 04 12:26:24 devstack sudo[105388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:26:24 devstack sudo[105388]: pam_unix(sudo:session): session closed for user root Nov 04 12:26:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-be77c992-59ad-4037-9f23-c4b08de4a1bb req-94bafb76-1ded-46de-8fb0-859b767405cb tempest-TestShelveInstance-181440490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-3657e41b-da17-451a-8749-edb5fed7bcd6" returned: 0 in 0.775s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:26:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-be77c992-59ad-4037-9f23-c4b08de4a1bb req-94bafb76-1ded-46de-8fb0-859b767405cb tempest-TestShelveInstance-181440490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-3657e41b-da17-451a-8749-edb5fed7bcd6 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:26:24 devstack sudo[105393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-3657e41b-da17-451a-8749-edb5fed7bcd6 Nov 04 12:26:24 devstack sudo[105393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:26:25 devstack sudo[105393]: pam_unix(sudo:session): session closed for user root Nov 04 12:26:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-be77c992-59ad-4037-9f23-c4b08de4a1bb req-94bafb76-1ded-46de-8fb0-859b767405cb tempest-TestShelveInstance-181440490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-3657e41b-da17-451a-8749-edb5fed7bcd6" returned: 0 in 0.328s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:26:25 devstack cinder-volume[87095]: DEBUG cinder.coordination [req-be77c992-59ad-4037-9f23-c4b08de4a1bb req-94bafb76-1ded-46de-8fb0-859b767405cb tempest-TestShelveInstance-181440490 None] Lock "cinder-quobyte-3657e41b-da17-451a-8749-edb5fed7bcd6" released by "delete_volume" :: held 1.209s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:26:25 devstack cinder-volume[87095]: DEBUG cinder.quota [req-be77c992-59ad-4037-9f23-c4b08de4a1bb req-94bafb76-1ded-46de-8fb0-859b767405cb tempest-TestShelveInstance-181440490 None] Created reservations ['04d5642d-e6e7-4337-a379-2ae3cfec5075', 'e6540ded-3fdf-47be-b227-c0c4fece1f1d', 'b3c1ae38-1578-4577-857d-20840c075439', '2a0bea13-704a-4931-a203-fb57f68b1d16'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:26:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-be77c992-59ad-4037-9f23-c4b08de4a1bb req-94bafb76-1ded-46de-8fb0-859b767405cb tempest-TestShelveInstance-181440490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:26:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-be77c992-59ad-4037-9f23-c4b08de4a1bb req-94bafb76-1ded-46de-8fb0-859b767405cb tempest-TestShelveInstance-181440490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:26:25 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [req-be77c992-59ad-4037-9f23-c4b08de4a1bb req-94bafb76-1ded-46de-8fb0-859b767405cb tempest-TestShelveInstance-181440490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:26:25 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [req-be77c992-59ad-4037-9f23-c4b08de4a1bb req-94bafb76-1ded-46de-8fb0-859b767405cb tempest-TestShelveInstance-181440490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:26:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-be77c992-59ad-4037-9f23-c4b08de4a1bb req-94bafb76-1ded-46de-8fb0-859b767405cb tempest-TestShelveInstance-181440490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:26:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-be77c992-59ad-4037-9f23-c4b08de4a1bb req-94bafb76-1ded-46de-8fb0-859b767405cb tempest-TestShelveInstance-181440490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:26:25 devstack sudo[105396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:26:25 devstack sudo[105396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:26:25 devstack sudo[105396]: pam_unix(sudo:session): session closed for user root Nov 04 12:26:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-be77c992-59ad-4037-9f23-c4b08de4a1bb req-94bafb76-1ded-46de-8fb0-859b767405cb tempest-TestShelveInstance-181440490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.397s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:26:25 devstack cinder-volume[87095]: DEBUG cinder.manager [req-be77c992-59ad-4037-9f23-c4b08de4a1bb req-94bafb76-1ded-46de-8fb0-859b767405cb tempest-TestShelveInstance-181440490 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:26:25 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-be77c992-59ad-4037-9f23-c4b08de4a1bb req-94bafb76-1ded-46de-8fb0-859b767405cb tempest-TestShelveInstance-181440490 None] Deleted volume successfully. Nov 04 12:26:25 devstack cinder-volume[87095]: DEBUG cinder.coordination [req-be77c992-59ad-4037-9f23-c4b08de4a1bb req-94bafb76-1ded-46de-8fb0-859b767405cb tempest-TestShelveInstance-181440490 None] Lock "cinder-3657e41b-da17-451a-8749-edb5fed7bcd6-delete_volume" released by "delete_volume" :: held 2.061s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:26:29 devstack sudo[105354]: pam_unix(sudo:session): session closed for user root Nov 04 12:26:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-340c8544-27b0-453d-8e26-d1969800348d tempest-GroupsV314Test-1574689884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bf771731-d9d4-4c7a-9d3b-7c2346134ac3 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-dca3386f-e7f3-4aee-a10f-cf979324fd88" returned: 0 in 7.602s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:26:29 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-340c8544-27b0-453d-8e26-d1969800348d tempest-GroupsV314Test-1574689884 None] Image conversion details: src /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bf771731-d9d4-4c7a-9d3b-7c2346134ac3, size 1024.00 MB, duration 7.60 sec, destination /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-dca3386f-e7f3-4aee-a10f-cf979324fd88 {{(pid=87095) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 12:26:29 devstack cinder-volume[87095]: INFO cinder.image.image_utils [None req-340c8544-27b0-453d-8e26-d1969800348d tempest-GroupsV314Test-1574689884 None] Converted 1024.00 MB image at 134.69 MB/s Nov 04 12:26:29 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-340c8544-27b0-453d-8e26-d1969800348d tempest-GroupsV314Test-1574689884 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-dca3386f-e7f3-4aee-a10f-cf979324fd88 is being set with open permissions: ugo+rw: NotImplementedError Nov 04 12:26:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-340c8544-27b0-453d-8e26-d1969800348d tempest-GroupsV314Test-1574689884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-dca3386f-e7f3-4aee-a10f-cf979324fd88 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:26:29 devstack sudo[105407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-dca3386f-e7f3-4aee-a10f-cf979324fd88 Nov 04 12:26:29 devstack sudo[105407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:26:29 devstack sudo[105407]: pam_unix(sudo:session): session closed for user root Nov 04 12:26:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-340c8544-27b0-453d-8e26-d1969800348d tempest-GroupsV314Test-1574689884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-dca3386f-e7f3-4aee-a10f-cf979324fd88" returned: 0 in 0.254s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:26:29 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-340c8544-27b0-453d-8e26-d1969800348d tempest-GroupsV314Test-1574689884 None] Lock "cinder-quobyte-dca3386f-e7f3-4aee-a10f-cf979324fd88" released by "_copy_volume_from_snapshot" :: held 8.799s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:26:29 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-340c8544-27b0-453d-8e26-d1969800348d tempest-GroupsV314Test-1574689884 None] Acquiring lock "cinder-quobyte-ee6075cf-a41a-463f-ac40-5e9f3199ca8c" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:26:29 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-340c8544-27b0-453d-8e26-d1969800348d tempest-GroupsV314Test-1574689884 None] Lock "cinder-quobyte-ee6075cf-a41a-463f-ac40-5e9f3199ca8c" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:26:29 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-340c8544-27b0-453d-8e26-d1969800348d tempest-GroupsV314Test-1574689884 None] Deleting offline snapshot ee6075cf-a41a-463f-ac40-5e9f3199ca8c of volume bf771731-d9d4-4c7a-9d3b-7c2346134ac3 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 12:26:29 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-340c8544-27b0-453d-8e26-d1969800348d tempest-GroupsV314Test-1574689884 None] snapshot_file for this snap is: volume-bf771731-d9d4-4c7a-9d3b-7c2346134ac3.ee6075cf-a41a-463f-ac40-5e9f3199ca8c {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 12:26:29 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[163d1509-5615-470f-b856-60ae18fb8037]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:26:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-340c8544-27b0-453d-8e26-d1969800348d tempest-GroupsV314Test-1574689884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bf771731-d9d4-4c7a-9d3b-7c2346134ac3.ee6075cf-a41a-463f-ac40-5e9f3199ca8c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:26:29 devstack sudo[105444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bf771731-d9d4-4c7a-9d3b-7c2346134ac3.ee6075cf-a41a-463f-ac40-5e9f3199ca8c Nov 04 12:26:29 devstack sudo[105444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:26:30 devstack sudo[105444]: pam_unix(sudo:session): session closed for user root Nov 04 12:26:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-340c8544-27b0-453d-8e26-d1969800348d tempest-GroupsV314Test-1574689884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bf771731-d9d4-4c7a-9d3b-7c2346134ac3.ee6075cf-a41a-463f-ac40-5e9f3199ca8c" returned: 0 in 0.371s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:26:30 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-340c8544-27b0-453d-8e26-d1969800348d tempest-GroupsV314Test-1574689884 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf771731-d9d4-4c7a-9d3b-7c2346134ac3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 12:26:30 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c02617d-9681-4d77-99da-d1aa143594cd]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:26:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-340c8544-27b0-453d-8e26-d1969800348d tempest-GroupsV314Test-1574689884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bf771731-d9d4-4c7a-9d3b-7c2346134ac3 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:26:30 devstack sudo[105452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bf771731-d9d4-4c7a-9d3b-7c2346134ac3 Nov 04 12:26:30 devstack sudo[105452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:26:30 devstack sudo[105452]: pam_unix(sudo:session): session closed for user root Nov 04 12:26:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-340c8544-27b0-453d-8e26-d1969800348d tempest-GroupsV314Test-1574689884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bf771731-d9d4-4c7a-9d3b-7c2346134ac3" returned: 0 in 0.564s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:26:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-340c8544-27b0-453d-8e26-d1969800348d tempest-GroupsV314Test-1574689884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bf771731-d9d4-4c7a-9d3b-7c2346134ac3.ee6075cf-a41a-463f-ac40-5e9f3199ca8c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:26:30 devstack sudo[105457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bf771731-d9d4-4c7a-9d3b-7c2346134ac3.ee6075cf-a41a-463f-ac40-5e9f3199ca8c Nov 04 12:26:30 devstack sudo[105457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:26:31 devstack sudo[105457]: pam_unix(sudo:session): session closed for user root Nov 04 12:26:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-340c8544-27b0-453d-8e26-d1969800348d tempest-GroupsV314Test-1574689884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bf771731-d9d4-4c7a-9d3b-7c2346134ac3.ee6075cf-a41a-463f-ac40-5e9f3199ca8c" returned: 0 in 0.321s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:26:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-340c8544-27b0-453d-8e26-d1969800348d tempest-GroupsV314Test-1574689884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bf771731-d9d4-4c7a-9d3b-7c2346134ac3.ee6075cf-a41a-463f-ac40-5e9f3199ca8c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:26:31 devstack sudo[105462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bf771731-d9d4-4c7a-9d3b-7c2346134ac3.ee6075cf-a41a-463f-ac40-5e9f3199ca8c Nov 04 12:26:31 devstack sudo[105462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:26:31 devstack sudo[105462]: pam_unix(sudo:session): session closed for user root Nov 04 12:26:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-340c8544-27b0-453d-8e26-d1969800348d tempest-GroupsV314Test-1574689884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bf771731-d9d4-4c7a-9d3b-7c2346134ac3.ee6075cf-a41a-463f-ac40-5e9f3199ca8c" returned: 0 in 0.288s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:26:31 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-340c8544-27b0-453d-8e26-d1969800348d tempest-GroupsV314Test-1574689884 None] Lock "cinder-quobyte-ee6075cf-a41a-463f-ac40-5e9f3199ca8c" released by "_delete_snapshot" :: held 1.652s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:26:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-340c8544-27b0-453d-8e26-d1969800348d tempest-GroupsV314Test-1574689884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.427s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:26:31 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-340c8544-27b0-453d-8e26-d1969800348d tempest-GroupsV314Test-1574689884 None] Create group from source-group-898d5746-9f12-4a52-b113-f3d7a1de9f58 completed successfully. Nov 04 12:26:32 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-8a3e45cc-7870-4033-97b1-1927ceeca6f6 tempest-GroupsV314Test-1574689884 None] Acquiring lock "cinder-quobyte-dca3386f-e7f3-4aee-a10f-cf979324fd88" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:26:32 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-8a3e45cc-7870-4033-97b1-1927ceeca6f6 tempest-GroupsV314Test-1574689884 None] Lock "cinder-quobyte-dca3386f-e7f3-4aee-a10f-cf979324fd88" acquired by "delete_volume" :: waited 0.016s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:26:32 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb89de9a-8d5e-42ff-a765-2b25727779ab]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:26:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8a3e45cc-7870-4033-97b1-1927ceeca6f6 tempest-GroupsV314Test-1574689884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-dca3386f-e7f3-4aee-a10f-cf979324fd88 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:26:32 devstack sudo[105468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-dca3386f-e7f3-4aee-a10f-cf979324fd88 Nov 04 12:26:32 devstack sudo[105468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:26:32 devstack sudo[105468]: pam_unix(sudo:session): session closed for user root Nov 04 12:26:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8a3e45cc-7870-4033-97b1-1927ceeca6f6 tempest-GroupsV314Test-1574689884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-dca3386f-e7f3-4aee-a10f-cf979324fd88" returned: 0 in 0.376s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:26:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8a3e45cc-7870-4033-97b1-1927ceeca6f6 tempest-GroupsV314Test-1574689884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-dca3386f-e7f3-4aee-a10f-cf979324fd88 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:26:32 devstack sudo[105473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-dca3386f-e7f3-4aee-a10f-cf979324fd88 Nov 04 12:26:32 devstack sudo[105473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:26:32 devstack sudo[105473]: pam_unix(sudo:session): session closed for user root Nov 04 12:26:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8a3e45cc-7870-4033-97b1-1927ceeca6f6 tempest-GroupsV314Test-1574689884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-dca3386f-e7f3-4aee-a10f-cf979324fd88" returned: 0 in 0.281s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:26:32 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-8a3e45cc-7870-4033-97b1-1927ceeca6f6 tempest-GroupsV314Test-1574689884 None] Lock "cinder-quobyte-dca3386f-e7f3-4aee-a10f-cf979324fd88" released by "delete_volume" :: held 0.711s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:26:32 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-8a3e45cc-7870-4033-97b1-1927ceeca6f6 tempest-GroupsV314Test-1574689884 None] Created reservations ['1b006ab8-6203-4a8b-b62b-421b856ad369'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:26:33 devstack cinder-volume[87095]: WARNING cinder.quota [None req-8a3e45cc-7870-4033-97b1-1927ceeca6f6 tempest-GroupsV314Test-1574689884 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1051256021 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1051256021, it is now deprecated. Please use the default quota class for default quota. Nov 04 12:26:33 devstack cinder-volume[87095]: WARNING cinder.quota [None req-8a3e45cc-7870-4033-97b1-1927ceeca6f6 tempest-GroupsV314Test-1574689884 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1051256021 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1051256021, it is now deprecated. Please use the default quota class for default quota. Nov 04 12:26:33 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-8a3e45cc-7870-4033-97b1-1927ceeca6f6 tempest-GroupsV314Test-1574689884 None] Created reservations ['67d4cc15-223d-44a8-afc0-cb5e93e1d975', '97ed1bbd-7ce3-4187-923c-79f38a3d0785', 'd358b0e8-7833-4951-ac98-ef6da2fc22fd', '91886563-5fd9-4c2d-8a61-2ecb5e2b960f'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:26:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-8a3e45cc-7870-4033-97b1-1927ceeca6f6 tempest-GroupsV314Test-1574689884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:26:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-8a3e45cc-7870-4033-97b1-1927ceeca6f6 tempest-GroupsV314Test-1574689884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:26:33 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-8a3e45cc-7870-4033-97b1-1927ceeca6f6 tempest-GroupsV314Test-1574689884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:26:33 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-8a3e45cc-7870-4033-97b1-1927ceeca6f6 tempest-GroupsV314Test-1574689884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:26:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-8a3e45cc-7870-4033-97b1-1927ceeca6f6 tempest-GroupsV314Test-1574689884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:26:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8a3e45cc-7870-4033-97b1-1927ceeca6f6 tempest-GroupsV314Test-1574689884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:26:33 devstack sudo[105476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:26:33 devstack sudo[105476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:26:33 devstack sudo[105476]: pam_unix(sudo:session): session closed for user root Nov 04 12:26:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8a3e45cc-7870-4033-97b1-1927ceeca6f6 tempest-GroupsV314Test-1574689884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.246s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:26:33 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-8a3e45cc-7870-4033-97b1-1927ceeca6f6 tempest-GroupsV314Test-1574689884 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:26:33 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-8a3e45cc-7870-4033-97b1-1927ceeca6f6 tempest-GroupsV314Test-1574689884 None] Delete group completed successfully. Nov 04 12:26:33 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-fba02f9f-b54f-47a7-8498-1d34352e3b57 tempest-GroupsV314Test-1574689884 None] Acquiring lock "cinder-quobyte-bf771731-d9d4-4c7a-9d3b-7c2346134ac3" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:26:33 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-fba02f9f-b54f-47a7-8498-1d34352e3b57 tempest-GroupsV314Test-1574689884 None] Lock "cinder-quobyte-bf771731-d9d4-4c7a-9d3b-7c2346134ac3" acquired by "delete_volume" :: waited 0.022s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:26:33 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd3c445-6cbe-413a-b3b0-0f19431db26d]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:26:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fba02f9f-b54f-47a7-8498-1d34352e3b57 tempest-GroupsV314Test-1574689884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bf771731-d9d4-4c7a-9d3b-7c2346134ac3 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:26:33 devstack sudo[105481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bf771731-d9d4-4c7a-9d3b-7c2346134ac3 Nov 04 12:26:33 devstack sudo[105481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:26:34 devstack sudo[105481]: pam_unix(sudo:session): session closed for user root Nov 04 12:26:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fba02f9f-b54f-47a7-8498-1d34352e3b57 tempest-GroupsV314Test-1574689884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bf771731-d9d4-4c7a-9d3b-7c2346134ac3" returned: 0 in 0.383s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:26:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fba02f9f-b54f-47a7-8498-1d34352e3b57 tempest-GroupsV314Test-1574689884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bf771731-d9d4-4c7a-9d3b-7c2346134ac3 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:26:34 devstack sudo[105486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bf771731-d9d4-4c7a-9d3b-7c2346134ac3 Nov 04 12:26:34 devstack sudo[105486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:26:34 devstack sudo[105486]: pam_unix(sudo:session): session closed for user root Nov 04 12:26:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fba02f9f-b54f-47a7-8498-1d34352e3b57 tempest-GroupsV314Test-1574689884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-bf771731-d9d4-4c7a-9d3b-7c2346134ac3" returned: 0 in 0.257s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:26:34 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-fba02f9f-b54f-47a7-8498-1d34352e3b57 tempest-GroupsV314Test-1574689884 None] Lock "cinder-quobyte-bf771731-d9d4-4c7a-9d3b-7c2346134ac3" released by "delete_volume" :: held 0.734s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:26:34 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-fba02f9f-b54f-47a7-8498-1d34352e3b57 tempest-GroupsV314Test-1574689884 None] Created reservations ['de46c14b-56de-4b7c-a6a9-f0a13fcfbd13'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:26:34 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-fba02f9f-b54f-47a7-8498-1d34352e3b57 tempest-GroupsV314Test-1574689884 None] Created reservations ['c730533c-7e4e-4b81-b373-3f78078b26dc', '533f7b53-1ee4-4c7c-b13a-1d53d7fa7538', '2aa1f06a-1925-43d0-9ebb-d2ff4cac4ebc', '653703a7-d57c-4f4f-be69-fa88ed09268d'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:26:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-fba02f9f-b54f-47a7-8498-1d34352e3b57 tempest-GroupsV314Test-1574689884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:26:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-fba02f9f-b54f-47a7-8498-1d34352e3b57 tempest-GroupsV314Test-1574689884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:26:34 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-fba02f9f-b54f-47a7-8498-1d34352e3b57 tempest-GroupsV314Test-1574689884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:26:34 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-fba02f9f-b54f-47a7-8498-1d34352e3b57 tempest-GroupsV314Test-1574689884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:26:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-fba02f9f-b54f-47a7-8498-1d34352e3b57 tempest-GroupsV314Test-1574689884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:26:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fba02f9f-b54f-47a7-8498-1d34352e3b57 tempest-GroupsV314Test-1574689884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:26:34 devstack sudo[105489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:26:34 devstack sudo[105489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:26:34 devstack sudo[105489]: pam_unix(sudo:session): session closed for user root Nov 04 12:26:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fba02f9f-b54f-47a7-8498-1d34352e3b57 tempest-GroupsV314Test-1574689884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.272s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:26:34 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-fba02f9f-b54f-47a7-8498-1d34352e3b57 tempest-GroupsV314Test-1574689884 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:26:34 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-fba02f9f-b54f-47a7-8498-1d34352e3b57 tempest-GroupsV314Test-1574689884 None] Delete group completed successfully. Nov 04 12:26:44 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=33,cinder:UPDATE=38,cinder:INSERT=10 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 12:26:44 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=33,cinder:UPDATE=36,cinder:INSERT=7,cinder:DELETE=2 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 12:26:47 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c9d4d94-19b0-4ae9-87f8-659903233f2d tempest-VolumeQuotasAdminTestJSON-830706093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:26:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6c9d4d94-19b0-4ae9-87f8-659903233f2d tempest-VolumeQuotasAdminTestJSON-830706093 None] Flow 'volume_create_manager' (72e7b18d-4ef2-43cf-b27d-e7acc5e198c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:26:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6c9d4d94-19b0-4ae9-87f8-659903233f2d tempest-VolumeQuotasAdminTestJSON-830706093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (392617be-0247-4a6c-838d-9c3fb83e70ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:26:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6c9d4d94-19b0-4ae9-87f8-659903233f2d tempest-VolumeQuotasAdminTestJSON-830706093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (392617be-0247-4a6c-838d-9c3fb83e70ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:26:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1250196091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0401d87-eca9-4df7-b2d4-5d4e8e529445,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b150b312c3642c0b1ac5c90b685e78d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:26:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:26:47Z,use_quota=True,user_id='a107863cc8f748c7822fd682880e2cc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:26:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6c9d4d94-19b0-4ae9-87f8-659903233f2d tempest-VolumeQuotasAdminTestJSON-830706093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a62bf7a3-d3f6-49dc-b214-0ab2c74d2c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:26:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6c9d4d94-19b0-4ae9-87f8-659903233f2d tempest-VolumeQuotasAdminTestJSON-830706093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a62bf7a3-d3f6-49dc-b214-0ab2c74d2c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:26:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6c9d4d94-19b0-4ae9-87f8-659903233f2d tempest-VolumeQuotasAdminTestJSON-830706093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7348fe55-ae99-4c90-b580-e257b45c0002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:26:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6c9d4d94-19b0-4ae9-87f8-659903233f2d tempest-VolumeQuotasAdminTestJSON-830706093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7348fe55-ae99-4c90-b580-e257b45c0002) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0401d87-eca9-4df7-b2d4-5d4e8e529445', 'volume_name': 'volume-a0401d87-eca9-4df7-b2d4-5d4e8e529445', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:26:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6c9d4d94-19b0-4ae9-87f8-659903233f2d tempest-VolumeQuotasAdminTestJSON-830706093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a674fdfa-233b-4cc3-91e8-6409abe194b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:26:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6c9d4d94-19b0-4ae9-87f8-659903233f2d tempest-VolumeQuotasAdminTestJSON-830706093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a674fdfa-233b-4cc3-91e8-6409abe194b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:26:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6c9d4d94-19b0-4ae9-87f8-659903233f2d tempest-VolumeQuotasAdminTestJSON-830706093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cdef8cc-e2fb-4eb4-a972-c7f8e79ae858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:26:47 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-6c9d4d94-19b0-4ae9-87f8-659903233f2d tempest-VolumeQuotasAdminTestJSON-830706093 None] Volume a0401d87-eca9-4df7-b2d4-5d4e8e529445: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0401d87-eca9-4df7-b2d4-5d4e8e529445', 'volume_size': 1} Nov 04 12:26:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6c9d4d94-19b0-4ae9-87f8-659903233f2d tempest-VolumeQuotasAdminTestJSON-830706093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:26:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6c9d4d94-19b0-4ae9-87f8-659903233f2d tempest-VolumeQuotasAdminTestJSON-830706093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:26:47 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6c9d4d94-19b0-4ae9-87f8-659903233f2d tempest-VolumeQuotasAdminTestJSON-830706093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:26:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1250196091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0401d87-eca9-4df7-b2d4-5d4e8e529445,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b150b312c3642c0b1ac5c90b685e78d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:26:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:26:47Z,use_quota=True,user_id='a107863cc8f748c7822fd682880e2cc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:26:47 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-6c9d4d94-19b0-4ae9-87f8-659903233f2d tempest-VolumeQuotasAdminTestJSON-830706093 None] Creating volume a0401d87-eca9-4df7-b2d4-5d4e8e529445 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:26:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6c9d4d94-19b0-4ae9-87f8-659903233f2d tempest-VolumeQuotasAdminTestJSON-830706093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:26:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6c9d4d94-19b0-4ae9-87f8-659903233f2d tempest-VolumeQuotasAdminTestJSON-830706093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:26:47 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6c9d4d94-19b0-4ae9-87f8-659903233f2d tempest-VolumeQuotasAdminTestJSON-830706093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:26:47 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6c9d4d94-19b0-4ae9-87f8-659903233f2d tempest-VolumeQuotasAdminTestJSON-830706093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:26:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6c9d4d94-19b0-4ae9-87f8-659903233f2d tempest-VolumeQuotasAdminTestJSON-830706093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:26:47 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6c9d4d94-19b0-4ae9-87f8-659903233f2d tempest-VolumeQuotasAdminTestJSON-830706093 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:26:47 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-6c9d4d94-19b0-4ae9-87f8-659903233f2d tempest-VolumeQuotasAdminTestJSON-830706093 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:26:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6c9d4d94-19b0-4ae9-87f8-659903233f2d tempest-VolumeQuotasAdminTestJSON-830706093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a0401d87-eca9-4df7-b2d4-5d4e8e529445 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:26:47 devstack sudo[105494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a0401d87-eca9-4df7-b2d4-5d4e8e529445 1073741824 Nov 04 12:26:47 devstack sudo[105494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:26:47 devstack sudo[105494]: pam_unix(sudo:session): session closed for user root Nov 04 12:26:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6c9d4d94-19b0-4ae9-87f8-659903233f2d tempest-VolumeQuotasAdminTestJSON-830706093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a0401d87-eca9-4df7-b2d4-5d4e8e529445 1073741824" returned: 0 in 0.408s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:26:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6c9d4d94-19b0-4ae9-87f8-659903233f2d tempest-VolumeQuotasAdminTestJSON-830706093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a0401d87-eca9-4df7-b2d4-5d4e8e529445 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:26:47 devstack sudo[105500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a0401d87-eca9-4df7-b2d4-5d4e8e529445 Nov 04 12:26:47 devstack sudo[105500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:26:47 devstack sudo[105500]: pam_unix(sudo:session): session closed for user root Nov 04 12:26:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6c9d4d94-19b0-4ae9-87f8-659903233f2d tempest-VolumeQuotasAdminTestJSON-830706093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a0401d87-eca9-4df7-b2d4-5d4e8e529445" returned: 0 in 0.242s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:26:47 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6c9d4d94-19b0-4ae9-87f8-659903233f2d tempest-VolumeQuotasAdminTestJSON-830706093 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:26:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6c9d4d94-19b0-4ae9-87f8-659903233f2d tempest-VolumeQuotasAdminTestJSON-830706093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:26:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6c9d4d94-19b0-4ae9-87f8-659903233f2d tempest-VolumeQuotasAdminTestJSON-830706093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cdef8cc-e2fb-4eb4-a972-c7f8e79ae858) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0401d87-eca9-4df7-b2d4-5d4e8e529445', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:26:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6c9d4d94-19b0-4ae9-87f8-659903233f2d tempest-VolumeQuotasAdminTestJSON-830706093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59586046-540d-4870-a2e6-ccc2ac1904d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:26:47 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-6c9d4d94-19b0-4ae9-87f8-659903233f2d tempest-VolumeQuotasAdminTestJSON-830706093 None] Volume volume-a0401d87-eca9-4df7-b2d4-5d4e8e529445 (a0401d87-eca9-4df7-b2d4-5d4e8e529445): created successfully Nov 04 12:26:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6c9d4d94-19b0-4ae9-87f8-659903233f2d tempest-VolumeQuotasAdminTestJSON-830706093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59586046-540d-4870-a2e6-ccc2ac1904d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:26:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6c9d4d94-19b0-4ae9-87f8-659903233f2d tempest-VolumeQuotasAdminTestJSON-830706093 None] Flow 'volume_create_manager' (72e7b18d-4ef2-43cf-b27d-e7acc5e198c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:26:47 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-6c9d4d94-19b0-4ae9-87f8-659903233f2d tempest-VolumeQuotasAdminTestJSON-830706093 None] Created volume successfully. Nov 04 12:26:48 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c3d04846-95fb-4f1e-adf9-794eb7b1fec4 tempest-VolumeQuotasAdminTestJSON-830706093 None] Acquiring lock "cinder-a0401d87-eca9-4df7-b2d4-5d4e8e529445-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:26:48 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c3d04846-95fb-4f1e-adf9-794eb7b1fec4 tempest-VolumeQuotasAdminTestJSON-830706093 None] Lock "cinder-a0401d87-eca9-4df7-b2d4-5d4e8e529445-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:26:48 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c3d04846-95fb-4f1e-adf9-794eb7b1fec4 tempest-VolumeQuotasAdminTestJSON-830706093 None] Acquiring lock "cinder-quobyte-a0401d87-eca9-4df7-b2d4-5d4e8e529445" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:26:48 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c3d04846-95fb-4f1e-adf9-794eb7b1fec4 tempest-VolumeQuotasAdminTestJSON-830706093 None] Lock "cinder-quobyte-a0401d87-eca9-4df7-b2d4-5d4e8e529445" acquired by "delete_volume" :: waited 0.017s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:26:48 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea01965-b849-4022-8d2b-899d9732997b]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:26:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c3d04846-95fb-4f1e-adf9-794eb7b1fec4 tempest-VolumeQuotasAdminTestJSON-830706093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a0401d87-eca9-4df7-b2d4-5d4e8e529445 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:26:48 devstack sudo[105504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a0401d87-eca9-4df7-b2d4-5d4e8e529445 Nov 04 12:26:48 devstack sudo[105504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:26:48 devstack sudo[105504]: pam_unix(sudo:session): session closed for user root Nov 04 12:26:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c3d04846-95fb-4f1e-adf9-794eb7b1fec4 tempest-VolumeQuotasAdminTestJSON-830706093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a0401d87-eca9-4df7-b2d4-5d4e8e529445" returned: 0 in 0.364s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:26:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c3d04846-95fb-4f1e-adf9-794eb7b1fec4 tempest-VolumeQuotasAdminTestJSON-830706093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a0401d87-eca9-4df7-b2d4-5d4e8e529445 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:26:48 devstack sudo[105509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a0401d87-eca9-4df7-b2d4-5d4e8e529445 Nov 04 12:26:48 devstack sudo[105509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:26:48 devstack sudo[105509]: pam_unix(sudo:session): session closed for user root Nov 04 12:26:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c3d04846-95fb-4f1e-adf9-794eb7b1fec4 tempest-VolumeQuotasAdminTestJSON-830706093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a0401d87-eca9-4df7-b2d4-5d4e8e529445" returned: 0 in 0.246s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:26:48 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c3d04846-95fb-4f1e-adf9-794eb7b1fec4 tempest-VolumeQuotasAdminTestJSON-830706093 None] Lock "cinder-quobyte-a0401d87-eca9-4df7-b2d4-5d4e8e529445" released by "delete_volume" :: held 0.650s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:26:48 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-c3d04846-95fb-4f1e-adf9-794eb7b1fec4 tempest-VolumeQuotasAdminTestJSON-830706093 None] Created reservations ['054287df-1dd6-414c-b3b0-5a6cd438510b', '6a09474f-13ca-4e3a-a37e-371c5ff3be0c', '69a920a0-2456-42bd-a90e-ec22b7036f92', 'e1ac557e-20f7-49fa-983e-54f294cc64bb'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:26:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c3d04846-95fb-4f1e-adf9-794eb7b1fec4 tempest-VolumeQuotasAdminTestJSON-830706093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:26:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c3d04846-95fb-4f1e-adf9-794eb7b1fec4 tempest-VolumeQuotasAdminTestJSON-830706093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:26:49 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c3d04846-95fb-4f1e-adf9-794eb7b1fec4 tempest-VolumeQuotasAdminTestJSON-830706093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:26:49 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c3d04846-95fb-4f1e-adf9-794eb7b1fec4 tempest-VolumeQuotasAdminTestJSON-830706093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:26:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c3d04846-95fb-4f1e-adf9-794eb7b1fec4 tempest-VolumeQuotasAdminTestJSON-830706093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:26:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c3d04846-95fb-4f1e-adf9-794eb7b1fec4 tempest-VolumeQuotasAdminTestJSON-830706093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:26:49 devstack sudo[105512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:26:49 devstack sudo[105512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:26:49 devstack sudo[105512]: pam_unix(sudo:session): session closed for user root Nov 04 12:26:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c3d04846-95fb-4f1e-adf9-794eb7b1fec4 tempest-VolumeQuotasAdminTestJSON-830706093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.269s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:26:49 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-c3d04846-95fb-4f1e-adf9-794eb7b1fec4 tempest-VolumeQuotasAdminTestJSON-830706093 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:26:49 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-c3d04846-95fb-4f1e-adf9-794eb7b1fec4 tempest-VolumeQuotasAdminTestJSON-830706093 None] Deleted volume successfully. Nov 04 12:26:49 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c3d04846-95fb-4f1e-adf9-794eb7b1fec4 tempest-VolumeQuotasAdminTestJSON-830706093 None] Lock "cinder-a0401d87-eca9-4df7-b2d4-5d4e8e529445-delete_volume" released by "delete_volume" :: held 1.112s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:26:49 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-c490da7e-5b0c-4fae-943b-c22e34cd76c0 tempest-VolumeQuotasAdminTestJSON-830706093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:26:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c490da7e-5b0c-4fae-943b-c22e34cd76c0 tempest-VolumeQuotasAdminTestJSON-830706093 None] Flow 'volume_create_manager' (7efdd867-d744-4f4f-b241-ba72075b2e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:26:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c490da7e-5b0c-4fae-943b-c22e34cd76c0 tempest-VolumeQuotasAdminTestJSON-830706093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a690ab73-26b8-4703-a4af-3bf894685083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:26:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c490da7e-5b0c-4fae-943b-c22e34cd76c0 tempest-VolumeQuotasAdminTestJSON-830706093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a690ab73-26b8-4703-a4af-3bf894685083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:26:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-657848847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb89c510-a0fa-4615-97ff-0b2356ef3eff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b150b312c3642c0b1ac5c90b685e78d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:26:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:26:50Z,use_quota=True,user_id='a107863cc8f748c7822fd682880e2cc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:26:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c490da7e-5b0c-4fae-943b-c22e34cd76c0 tempest-VolumeQuotasAdminTestJSON-830706093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (230d51a7-3ccd-4908-bb04-ec33b0e03d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:26:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c490da7e-5b0c-4fae-943b-c22e34cd76c0 tempest-VolumeQuotasAdminTestJSON-830706093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (230d51a7-3ccd-4908-bb04-ec33b0e03d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:26:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c490da7e-5b0c-4fae-943b-c22e34cd76c0 tempest-VolumeQuotasAdminTestJSON-830706093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d663787a-0700-4d68-9f84-b80560504542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:26:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c490da7e-5b0c-4fae-943b-c22e34cd76c0 tempest-VolumeQuotasAdminTestJSON-830706093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d663787a-0700-4d68-9f84-b80560504542) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb89c510-a0fa-4615-97ff-0b2356ef3eff', 'volume_name': 'volume-fb89c510-a0fa-4615-97ff-0b2356ef3eff', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:26:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c490da7e-5b0c-4fae-943b-c22e34cd76c0 tempest-VolumeQuotasAdminTestJSON-830706093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e03b3232-12d3-4e5c-acfa-ec9edaa7d88a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:26:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c490da7e-5b0c-4fae-943b-c22e34cd76c0 tempest-VolumeQuotasAdminTestJSON-830706093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e03b3232-12d3-4e5c-acfa-ec9edaa7d88a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:26:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c490da7e-5b0c-4fae-943b-c22e34cd76c0 tempest-VolumeQuotasAdminTestJSON-830706093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (141f7791-1f60-48fa-b14c-43100afed475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:26:49 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-c490da7e-5b0c-4fae-943b-c22e34cd76c0 tempest-VolumeQuotasAdminTestJSON-830706093 None] Volume fb89c510-a0fa-4615-97ff-0b2356ef3eff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb89c510-a0fa-4615-97ff-0b2356ef3eff', 'volume_size': 1} Nov 04 12:26:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c490da7e-5b0c-4fae-943b-c22e34cd76c0 tempest-VolumeQuotasAdminTestJSON-830706093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:26:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c490da7e-5b0c-4fae-943b-c22e34cd76c0 tempest-VolumeQuotasAdminTestJSON-830706093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:26:49 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c490da7e-5b0c-4fae-943b-c22e34cd76c0 tempest-VolumeQuotasAdminTestJSON-830706093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:26:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-657848847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb89c510-a0fa-4615-97ff-0b2356ef3eff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b150b312c3642c0b1ac5c90b685e78d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:26:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:26:50Z,use_quota=True,user_id='a107863cc8f748c7822fd682880e2cc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:26:49 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-c490da7e-5b0c-4fae-943b-c22e34cd76c0 tempest-VolumeQuotasAdminTestJSON-830706093 None] Creating volume fb89c510-a0fa-4615-97ff-0b2356ef3eff {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:26:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c490da7e-5b0c-4fae-943b-c22e34cd76c0 tempest-VolumeQuotasAdminTestJSON-830706093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:26:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c490da7e-5b0c-4fae-943b-c22e34cd76c0 tempest-VolumeQuotasAdminTestJSON-830706093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:26:49 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c490da7e-5b0c-4fae-943b-c22e34cd76c0 tempest-VolumeQuotasAdminTestJSON-830706093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:26:49 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c490da7e-5b0c-4fae-943b-c22e34cd76c0 tempest-VolumeQuotasAdminTestJSON-830706093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:26:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c490da7e-5b0c-4fae-943b-c22e34cd76c0 tempest-VolumeQuotasAdminTestJSON-830706093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:26:49 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c490da7e-5b0c-4fae-943b-c22e34cd76c0 tempest-VolumeQuotasAdminTestJSON-830706093 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:26:49 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-c490da7e-5b0c-4fae-943b-c22e34cd76c0 tempest-VolumeQuotasAdminTestJSON-830706093 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:26:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c490da7e-5b0c-4fae-943b-c22e34cd76c0 tempest-VolumeQuotasAdminTestJSON-830706093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fb89c510-a0fa-4615-97ff-0b2356ef3eff 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:26:49 devstack sudo[105515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fb89c510-a0fa-4615-97ff-0b2356ef3eff 1073741824 Nov 04 12:26:49 devstack sudo[105515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:26:50 devstack sudo[105515]: pam_unix(sudo:session): session closed for user root Nov 04 12:26:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c490da7e-5b0c-4fae-943b-c22e34cd76c0 tempest-VolumeQuotasAdminTestJSON-830706093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fb89c510-a0fa-4615-97ff-0b2356ef3eff 1073741824" returned: 0 in 0.405s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:26:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c490da7e-5b0c-4fae-943b-c22e34cd76c0 tempest-VolumeQuotasAdminTestJSON-830706093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fb89c510-a0fa-4615-97ff-0b2356ef3eff {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:26:50 devstack sudo[105521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fb89c510-a0fa-4615-97ff-0b2356ef3eff Nov 04 12:26:50 devstack sudo[105521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:26:50 devstack sudo[105521]: pam_unix(sudo:session): session closed for user root Nov 04 12:26:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c490da7e-5b0c-4fae-943b-c22e34cd76c0 tempest-VolumeQuotasAdminTestJSON-830706093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fb89c510-a0fa-4615-97ff-0b2356ef3eff" returned: 0 in 0.236s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:26:50 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c490da7e-5b0c-4fae-943b-c22e34cd76c0 tempest-VolumeQuotasAdminTestJSON-830706093 None] <== create_volume: return (680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:26:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c490da7e-5b0c-4fae-943b-c22e34cd76c0 tempest-VolumeQuotasAdminTestJSON-830706093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.683s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:26:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c490da7e-5b0c-4fae-943b-c22e34cd76c0 tempest-VolumeQuotasAdminTestJSON-830706093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (141f7791-1f60-48fa-b14c-43100afed475) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb89c510-a0fa-4615-97ff-0b2356ef3eff', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:26:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c490da7e-5b0c-4fae-943b-c22e34cd76c0 tempest-VolumeQuotasAdminTestJSON-830706093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f4f441a-2836-4b09-a049-ccb3f4cc86f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:26:50 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-c490da7e-5b0c-4fae-943b-c22e34cd76c0 tempest-VolumeQuotasAdminTestJSON-830706093 None] Volume volume-fb89c510-a0fa-4615-97ff-0b2356ef3eff (fb89c510-a0fa-4615-97ff-0b2356ef3eff): created successfully Nov 04 12:26:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c490da7e-5b0c-4fae-943b-c22e34cd76c0 tempest-VolumeQuotasAdminTestJSON-830706093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f4f441a-2836-4b09-a049-ccb3f4cc86f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:26:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c490da7e-5b0c-4fae-943b-c22e34cd76c0 tempest-VolumeQuotasAdminTestJSON-830706093 None] Flow 'volume_create_manager' (7efdd867-d744-4f4f-b241-ba72075b2e10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:26:50 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-c490da7e-5b0c-4fae-943b-c22e34cd76c0 tempest-VolumeQuotasAdminTestJSON-830706093 None] Created volume successfully. Nov 04 12:26:51 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-765aecf2-77cc-456e-9d50-51ddc66fb1a3 tempest-VolumeQuotasAdminTestJSON-1475234088 None] Transfer volume completed successfully. Nov 04 12:26:51 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e0c74007-ed0c-45f4-972d-d2e2727f05db tempest-VolumeQuotasAdminTestJSON-495702680 None] Acquiring lock "cinder-fb89c510-a0fa-4615-97ff-0b2356ef3eff-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:26:51 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e0c74007-ed0c-45f4-972d-d2e2727f05db tempest-VolumeQuotasAdminTestJSON-495702680 None] Lock "cinder-fb89c510-a0fa-4615-97ff-0b2356ef3eff-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:26:51 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e0c74007-ed0c-45f4-972d-d2e2727f05db tempest-VolumeQuotasAdminTestJSON-495702680 None] Acquiring lock "cinder-quobyte-fb89c510-a0fa-4615-97ff-0b2356ef3eff" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:26:51 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e0c74007-ed0c-45f4-972d-d2e2727f05db tempest-VolumeQuotasAdminTestJSON-495702680 None] Lock "cinder-quobyte-fb89c510-a0fa-4615-97ff-0b2356ef3eff" acquired by "delete_volume" :: waited 0.015s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:26:51 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3ed538-dff6-406c-b059-f331eb7c5c34]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:26:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e0c74007-ed0c-45f4-972d-d2e2727f05db tempest-VolumeQuotasAdminTestJSON-495702680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fb89c510-a0fa-4615-97ff-0b2356ef3eff {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:26:52 devstack sudo[105524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fb89c510-a0fa-4615-97ff-0b2356ef3eff Nov 04 12:26:52 devstack sudo[105524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:26:52 devstack sudo[105524]: pam_unix(sudo:session): session closed for user root Nov 04 12:26:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e0c74007-ed0c-45f4-972d-d2e2727f05db tempest-VolumeQuotasAdminTestJSON-495702680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fb89c510-a0fa-4615-97ff-0b2356ef3eff" returned: 0 in 0.352s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:26:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e0c74007-ed0c-45f4-972d-d2e2727f05db tempest-VolumeQuotasAdminTestJSON-495702680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fb89c510-a0fa-4615-97ff-0b2356ef3eff {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:26:52 devstack sudo[105529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fb89c510-a0fa-4615-97ff-0b2356ef3eff Nov 04 12:26:52 devstack sudo[105529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:26:52 devstack sudo[105529]: pam_unix(sudo:session): session closed for user root Nov 04 12:26:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e0c74007-ed0c-45f4-972d-d2e2727f05db tempest-VolumeQuotasAdminTestJSON-495702680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fb89c510-a0fa-4615-97ff-0b2356ef3eff" returned: 0 in 0.242s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:26:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e0c74007-ed0c-45f4-972d-d2e2727f05db tempest-VolumeQuotasAdminTestJSON-495702680 None] Lock "cinder-quobyte-fb89c510-a0fa-4615-97ff-0b2356ef3eff" released by "delete_volume" :: held 0.634s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:26:52 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-e0c74007-ed0c-45f4-972d-d2e2727f05db tempest-VolumeQuotasAdminTestJSON-495702680 None] Created reservations ['5a62cfee-6c59-4e83-a9ea-7dc65610d1ef', '5e8f9c55-b270-49fb-a917-271c0ffca619', '94e3c861-6ed0-4d6e-a470-362a6bbd9082', '6545f278-9723-4201-9142-a1fb105d438d'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:26:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e0c74007-ed0c-45f4-972d-d2e2727f05db tempest-VolumeQuotasAdminTestJSON-495702680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:26:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e0c74007-ed0c-45f4-972d-d2e2727f05db tempest-VolumeQuotasAdminTestJSON-495702680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:26:52 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e0c74007-ed0c-45f4-972d-d2e2727f05db tempest-VolumeQuotasAdminTestJSON-495702680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:26:52 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e0c74007-ed0c-45f4-972d-d2e2727f05db tempest-VolumeQuotasAdminTestJSON-495702680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:26:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e0c74007-ed0c-45f4-972d-d2e2727f05db tempest-VolumeQuotasAdminTestJSON-495702680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:26:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e0c74007-ed0c-45f4-972d-d2e2727f05db tempest-VolumeQuotasAdminTestJSON-495702680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:26:52 devstack sudo[105532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:26:52 devstack sudo[105532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:26:52 devstack sudo[105532]: pam_unix(sudo:session): session closed for user root Nov 04 12:26:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e0c74007-ed0c-45f4-972d-d2e2727f05db tempest-VolumeQuotasAdminTestJSON-495702680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.233s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:26:52 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-e0c74007-ed0c-45f4-972d-d2e2727f05db tempest-VolumeQuotasAdminTestJSON-495702680 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:26:52 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-e0c74007-ed0c-45f4-972d-d2e2727f05db tempest-VolumeQuotasAdminTestJSON-495702680 None] Deleted volume successfully. Nov 04 12:26:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e0c74007-ed0c-45f4-972d-d2e2727f05db tempest-VolumeQuotasAdminTestJSON-495702680 None] Lock "cinder-fb89c510-a0fa-4615-97ff-0b2356ef3eff-delete_volume" released by "delete_volume" :: held 1.060s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:26:59 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-179ce162-e57c-4218-8197-614e6666709c tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:26:59 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-179ce162-e57c-4218-8197-614e6666709c tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] Flow 'volume_create_manager' (ec2c1f5d-5ee2-4938-8d02-19a743b36c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:26:59 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-179ce162-e57c-4218-8197-614e6666709c tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23a997c7-6cd3-4c5d-813e-75f117155558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:26:59 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-179ce162-e57c-4218-8197-614e6666709c tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23a997c7-6cd3-4c5d-813e-75f117155558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:26:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1044330528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b42b1bfa-72b7-43c6-8f47-4b37be62f457,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d214d8356fa4752b9970685e28cf6da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:27:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:27:00Z,use_quota=True,user_id='41c40e2cb4a349deaf7c28a0861577a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:26:59 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-179ce162-e57c-4218-8197-614e6666709c tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4502c40-088a-4a0e-bf4d-227bcc537669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:26:59 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-179ce162-e57c-4218-8197-614e6666709c tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4502c40-088a-4a0e-bf4d-227bcc537669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:26:59 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-179ce162-e57c-4218-8197-614e6666709c tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45c5e1d4-47c4-4336-8bb9-fdb3d54938ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:26:59 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-179ce162-e57c-4218-8197-614e6666709c tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45c5e1d4-47c4-4336-8bb9-fdb3d54938ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b42b1bfa-72b7-43c6-8f47-4b37be62f457', 'volume_name': 'volume-b42b1bfa-72b7-43c6-8f47-4b37be62f457', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:26:59 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-179ce162-e57c-4218-8197-614e6666709c tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dda2b84-2f7d-4eac-9813-4448f2de7a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:26:59 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-179ce162-e57c-4218-8197-614e6666709c tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dda2b84-2f7d-4eac-9813-4448f2de7a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:26:59 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-179ce162-e57c-4218-8197-614e6666709c tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84eb11c7-64db-49b3-8b34-fc00972991cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:26:59 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-179ce162-e57c-4218-8197-614e6666709c tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] Volume b42b1bfa-72b7-43c6-8f47-4b37be62f457: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b42b1bfa-72b7-43c6-8f47-4b37be62f457', 'volume_size': 1} Nov 04 12:26:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-179ce162-e57c-4218-8197-614e6666709c tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:26:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-179ce162-e57c-4218-8197-614e6666709c tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:26:59 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-179ce162-e57c-4218-8197-614e6666709c tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:26:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1044330528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b42b1bfa-72b7-43c6-8f47-4b37be62f457,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d214d8356fa4752b9970685e28cf6da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:27:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:27:00Z,use_quota=True,user_id='41c40e2cb4a349deaf7c28a0861577a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:26:59 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-179ce162-e57c-4218-8197-614e6666709c tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] Creating volume b42b1bfa-72b7-43c6-8f47-4b37be62f457 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:26:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-179ce162-e57c-4218-8197-614e6666709c tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:26:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-179ce162-e57c-4218-8197-614e6666709c tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:26:59 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-179ce162-e57c-4218-8197-614e6666709c tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:26:59 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-179ce162-e57c-4218-8197-614e6666709c tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:26:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-179ce162-e57c-4218-8197-614e6666709c tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:26:59 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-179ce162-e57c-4218-8197-614e6666709c tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:26:59 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-179ce162-e57c-4218-8197-614e6666709c tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:26:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-179ce162-e57c-4218-8197-614e6666709c tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b42b1bfa-72b7-43c6-8f47-4b37be62f457 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:26:59 devstack sudo[105536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b42b1bfa-72b7-43c6-8f47-4b37be62f457 1073741824 Nov 04 12:26:59 devstack sudo[105536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:27:00 devstack sudo[105536]: pam_unix(sudo:session): session closed for user root Nov 04 12:27:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-179ce162-e57c-4218-8197-614e6666709c tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b42b1bfa-72b7-43c6-8f47-4b37be62f457 1073741824" returned: 0 in 0.408s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:27:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-179ce162-e57c-4218-8197-614e6666709c tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b42b1bfa-72b7-43c6-8f47-4b37be62f457 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:27:00 devstack sudo[105541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b42b1bfa-72b7-43c6-8f47-4b37be62f457 Nov 04 12:27:00 devstack sudo[105541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:27:00 devstack sudo[105541]: pam_unix(sudo:session): session closed for user root Nov 04 12:27:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-179ce162-e57c-4218-8197-614e6666709c tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b42b1bfa-72b7-43c6-8f47-4b37be62f457" returned: 0 in 0.234s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:27:00 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-179ce162-e57c-4218-8197-614e6666709c tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] <== create_volume: return (681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:27:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-179ce162-e57c-4218-8197-614e6666709c tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:27:00 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-179ce162-e57c-4218-8197-614e6666709c tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84eb11c7-64db-49b3-8b34-fc00972991cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b42b1bfa-72b7-43c6-8f47-4b37be62f457', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:27:00 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-179ce162-e57c-4218-8197-614e6666709c tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5615ea3b-e84f-4dbc-b6c6-b095e0853600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:27:00 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-179ce162-e57c-4218-8197-614e6666709c tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] Volume volume-b42b1bfa-72b7-43c6-8f47-4b37be62f457 (b42b1bfa-72b7-43c6-8f47-4b37be62f457): created successfully Nov 04 12:27:00 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-179ce162-e57c-4218-8197-614e6666709c tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5615ea3b-e84f-4dbc-b6c6-b095e0853600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:27:00 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-179ce162-e57c-4218-8197-614e6666709c tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] Flow 'volume_create_manager' (ec2c1f5d-5ee2-4938-8d02-19a743b36c86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:27:00 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-179ce162-e57c-4218-8197-614e6666709c tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] Created volume successfully. Nov 04 12:27:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0d47ae74-90bf-4cab-82a7-2f17042503a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:27:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0d47ae74-90bf-4cab-82a7-2f17042503a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:27:00 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-0d47ae74-90bf-4cab-82a7-2f17042503a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] Creating offline snapshot 3e175cb2-8543-4778-a7d3-ca565b33f01f of volume b42b1bfa-72b7-43c6-8f47-4b37be62f457 {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 12:27:00 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1886475-1762-4dcf-8389-be79e99bd221]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:27:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0d47ae74-90bf-4cab-82a7-2f17042503a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b42b1bfa-72b7-43c6-8f47-4b37be62f457 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:27:01 devstack sudo[105544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b42b1bfa-72b7-43c6-8f47-4b37be62f457 Nov 04 12:27:01 devstack sudo[105544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:27:01 devstack sudo[105544]: pam_unix(sudo:session): session closed for user root Nov 04 12:27:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0d47ae74-90bf-4cab-82a7-2f17042503a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b42b1bfa-72b7-43c6-8f47-4b37be62f457" returned: 0 in 0.347s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:27:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0d47ae74-90bf-4cab-82a7-2f17042503a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b42b1bfa-72b7-43c6-8f47-4b37be62f457,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b42b1bfa-72b7-43c6-8f47-4b37be62f457.3e175cb2-8543-4778-a7d3-ca565b33f01f 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:27:01 devstack sudo[105549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b42b1bfa-72b7-43c6-8f47-4b37be62f457,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b42b1bfa-72b7-43c6-8f47-4b37be62f457.3e175cb2-8543-4778-a7d3-ca565b33f01f 1G Nov 04 12:27:01 devstack sudo[105549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:27:01 devstack sudo[105549]: pam_unix(sudo:session): session closed for user root Nov 04 12:27:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0d47ae74-90bf-4cab-82a7-2f17042503a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b42b1bfa-72b7-43c6-8f47-4b37be62f457,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b42b1bfa-72b7-43c6-8f47-4b37be62f457.3e175cb2-8543-4778-a7d3-ca565b33f01f 1G" returned: 0 in 0.402s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:27:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0d47ae74-90bf-4cab-82a7-2f17042503a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b42b1bfa-72b7-43c6-8f47-4b37be62f457 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b42b1bfa-72b7-43c6-8f47-4b37be62f457.3e175cb2-8543-4778-a7d3-ca565b33f01f {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:27:01 devstack sudo[105554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b42b1bfa-72b7-43c6-8f47-4b37be62f457 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b42b1bfa-72b7-43c6-8f47-4b37be62f457.3e175cb2-8543-4778-a7d3-ca565b33f01f Nov 04 12:27:01 devstack sudo[105554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:27:01 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 12:27:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:27:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:27:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:27:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:27:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:27:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:27:01 devstack sudo[105556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:27:01 devstack sudo[105556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:27:02 devstack sudo[105554]: pam_unix(sudo:session): session closed for user root Nov 04 12:27:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0d47ae74-90bf-4cab-82a7-2f17042503a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b42b1bfa-72b7-43c6-8f47-4b37be62f457 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b42b1bfa-72b7-43c6-8f47-4b37be62f457.3e175cb2-8543-4778-a7d3-ca565b33f01f" returned: 0 in 0.305s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:27:02 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-0d47ae74-90bf-4cab-82a7-2f17042503a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b42b1bfa-72b7-43c6-8f47-4b37be62f457.3e175cb2-8543-4778-a7d3-ca565b33f01f is being set with open permissions: ugo+rw Nov 04 12:27:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0d47ae74-90bf-4cab-82a7-2f17042503a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b42b1bfa-72b7-43c6-8f47-4b37be62f457.3e175cb2-8543-4778-a7d3-ca565b33f01f {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:27:02 devstack sudo[105562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b42b1bfa-72b7-43c6-8f47-4b37be62f457.3e175cb2-8543-4778-a7d3-ca565b33f01f Nov 04 12:27:02 devstack sudo[105562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:27:02 devstack sudo[105556]: pam_unix(sudo:session): session closed for user root Nov 04 12:27:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.253s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:27:02 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:27:02 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Running periodic task VolumeManager._thread_info {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 12:27:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] thread count: 28 {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 12:27:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] thread info: [<_MainThread(MainThread, started 140610387472512)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 12:27:02 devstack sudo[105562]: pam_unix(sudo:session): session closed for user root Nov 04 12:27:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0d47ae74-90bf-4cab-82a7-2f17042503a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b42b1bfa-72b7-43c6-8f47-4b37be62f457.3e175cb2-8543-4778-a7d3-ca565b33f01f" returned: 0 in 0.261s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:27:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0d47ae74-90bf-4cab-82a7-2f17042503a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b42b1bfa-72b7-43c6-8f47-4b37be62f457.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:27:02 devstack sudo[105565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b42b1bfa-72b7-43c6-8f47-4b37be62f457.info Nov 04 12:27:02 devstack sudo[105565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:27:02 devstack sudo[105565]: pam_unix(sudo:session): session closed for user root Nov 04 12:27:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0d47ae74-90bf-4cab-82a7-2f17042503a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b42b1bfa-72b7-43c6-8f47-4b37be62f457.info" returned: 0 in 0.253s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:27:02 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-0d47ae74-90bf-4cab-82a7-2f17042503a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b42b1bfa-72b7-43c6-8f47-4b37be62f457.info is being set with open permissions: ugo+rw Nov 04 12:27:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0d47ae74-90bf-4cab-82a7-2f17042503a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b42b1bfa-72b7-43c6-8f47-4b37be62f457.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:27:02 devstack sudo[105568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b42b1bfa-72b7-43c6-8f47-4b37be62f457.info Nov 04 12:27:02 devstack sudo[105568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:27:02 devstack sudo[105568]: pam_unix(sudo:session): session closed for user root Nov 04 12:27:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0d47ae74-90bf-4cab-82a7-2f17042503a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b42b1bfa-72b7-43c6-8f47-4b37be62f457.info" returned: 0 in 0.232s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:27:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0d47ae74-90bf-4cab-82a7-2f17042503a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.898s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:27:02 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-0d47ae74-90bf-4cab-82a7-2f17042503a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] Create snapshot completed successfully Nov 04 12:27:03 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9027df36-2cc6-4c18-a5fd-174dcda83296 tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] Acquiring lock "cinder-3e175cb2-8543-4778-a7d3-ca565b33f01f-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:27:03 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9027df36-2cc6-4c18-a5fd-174dcda83296 tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] Lock "cinder-3e175cb2-8543-4778-a7d3-ca565b33f01f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:27:03 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9027df36-2cc6-4c18-a5fd-174dcda83296 tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] Acquiring lock "cinder-quobyte-b42b1bfa-72b7-43c6-8f47-4b37be62f457" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:27:03 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9027df36-2cc6-4c18-a5fd-174dcda83296 tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] Lock "cinder-quobyte-b42b1bfa-72b7-43c6-8f47-4b37be62f457" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:27:03 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9027df36-2cc6-4c18-a5fd-174dcda83296 tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] Acquiring lock "cinder-quobyte-3e175cb2-8543-4778-a7d3-ca565b33f01f" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:27:03 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9027df36-2cc6-4c18-a5fd-174dcda83296 tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] Lock "cinder-quobyte-3e175cb2-8543-4778-a7d3-ca565b33f01f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:27:03 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-9027df36-2cc6-4c18-a5fd-174dcda83296 tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] Deleting offline snapshot 3e175cb2-8543-4778-a7d3-ca565b33f01f of volume b42b1bfa-72b7-43c6-8f47-4b37be62f457 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 12:27:03 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-9027df36-2cc6-4c18-a5fd-174dcda83296 tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] snapshot_file for this snap is: volume-b42b1bfa-72b7-43c6-8f47-4b37be62f457.3e175cb2-8543-4778-a7d3-ca565b33f01f {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 12:27:03 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f0caa8-447e-4a25-83e8-8310abc2aead]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:27:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9027df36-2cc6-4c18-a5fd-174dcda83296 tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b42b1bfa-72b7-43c6-8f47-4b37be62f457.3e175cb2-8543-4778-a7d3-ca565b33f01f {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:27:03 devstack sudo[105572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b42b1bfa-72b7-43c6-8f47-4b37be62f457.3e175cb2-8543-4778-a7d3-ca565b33f01f Nov 04 12:27:03 devstack sudo[105572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:27:03 devstack sudo[105572]: pam_unix(sudo:session): session closed for user root Nov 04 12:27:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9027df36-2cc6-4c18-a5fd-174dcda83296 tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b42b1bfa-72b7-43c6-8f47-4b37be62f457.3e175cb2-8543-4778-a7d3-ca565b33f01f" returned: 0 in 0.346s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:27:03 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-9027df36-2cc6-4c18-a5fd-174dcda83296 tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b42b1bfa-72b7-43c6-8f47-4b37be62f457(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 12:27:03 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad395c5-b9f0-40e0-8030-ca7991841668]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:27:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9027df36-2cc6-4c18-a5fd-174dcda83296 tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b42b1bfa-72b7-43c6-8f47-4b37be62f457 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:27:03 devstack sudo[105578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b42b1bfa-72b7-43c6-8f47-4b37be62f457 Nov 04 12:27:03 devstack sudo[105578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:27:04 devstack sudo[105578]: pam_unix(sudo:session): session closed for user root Nov 04 12:27:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9027df36-2cc6-4c18-a5fd-174dcda83296 tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b42b1bfa-72b7-43c6-8f47-4b37be62f457" returned: 0 in 0.357s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:27:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9027df36-2cc6-4c18-a5fd-174dcda83296 tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b42b1bfa-72b7-43c6-8f47-4b37be62f457.3e175cb2-8543-4778-a7d3-ca565b33f01f {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:27:04 devstack sudo[105583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b42b1bfa-72b7-43c6-8f47-4b37be62f457.3e175cb2-8543-4778-a7d3-ca565b33f01f Nov 04 12:27:04 devstack sudo[105583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:27:04 devstack sudo[105583]: pam_unix(sudo:session): session closed for user root Nov 04 12:27:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9027df36-2cc6-4c18-a5fd-174dcda83296 tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b42b1bfa-72b7-43c6-8f47-4b37be62f457.3e175cb2-8543-4778-a7d3-ca565b33f01f" returned: 0 in 0.316s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:27:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9027df36-2cc6-4c18-a5fd-174dcda83296 tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b42b1bfa-72b7-43c6-8f47-4b37be62f457.3e175cb2-8543-4778-a7d3-ca565b33f01f {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:27:04 devstack sudo[105589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b42b1bfa-72b7-43c6-8f47-4b37be62f457.3e175cb2-8543-4778-a7d3-ca565b33f01f Nov 04 12:27:04 devstack sudo[105589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:27:04 devstack sudo[105589]: pam_unix(sudo:session): session closed for user root Nov 04 12:27:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9027df36-2cc6-4c18-a5fd-174dcda83296 tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b42b1bfa-72b7-43c6-8f47-4b37be62f457.3e175cb2-8543-4778-a7d3-ca565b33f01f" returned: 0 in 0.244s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:27:04 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9027df36-2cc6-4c18-a5fd-174dcda83296 tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] Lock "cinder-quobyte-3e175cb2-8543-4778-a7d3-ca565b33f01f" released by "_delete_snapshot" :: held 1.365s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:27:04 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9027df36-2cc6-4c18-a5fd-174dcda83296 tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] Lock "cinder-quobyte-b42b1bfa-72b7-43c6-8f47-4b37be62f457" released by "delete_snapshot" :: held 1.388s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:27:04 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-9027df36-2cc6-4c18-a5fd-174dcda83296 tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] Created reservations ['ee3d4de3-a593-44a9-8301-24afc7a0c2fa', '84298f57-339c-405b-a406-6c337c599bc1', '0b4848a3-db2f-4c3b-a8e0-a6a43c51f389', 'e05e5fbb-dda4-4967-b70a-0caa1c2bbd05'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:27:04 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-9027df36-2cc6-4c18-a5fd-174dcda83296 tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] Delete snapshot completed successfully. Nov 04 12:27:04 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9027df36-2cc6-4c18-a5fd-174dcda83296 tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] Lock "cinder-3e175cb2-8543-4778-a7d3-ca565b33f01f-delete_snapshot" released by "delete_snapshot" :: held 1.510s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:27:05 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-08a8f081-0750-4d6f-b848-5084c520f4a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] Acquiring lock "cinder-b42b1bfa-72b7-43c6-8f47-4b37be62f457-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:27:05 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-08a8f081-0750-4d6f-b848-5084c520f4a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] Lock "cinder-b42b1bfa-72b7-43c6-8f47-4b37be62f457-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:27:05 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-08a8f081-0750-4d6f-b848-5084c520f4a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] Acquiring lock "cinder-quobyte-b42b1bfa-72b7-43c6-8f47-4b37be62f457" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:27:05 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-08a8f081-0750-4d6f-b848-5084c520f4a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] Lock "cinder-quobyte-b42b1bfa-72b7-43c6-8f47-4b37be62f457" acquired by "delete_volume" :: waited 0.018s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:27:05 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[48001052-1782-40be-b060-a7d2c3518a96]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:27:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-08a8f081-0750-4d6f-b848-5084c520f4a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b42b1bfa-72b7-43c6-8f47-4b37be62f457 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:27:05 devstack sudo[105592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b42b1bfa-72b7-43c6-8f47-4b37be62f457 Nov 04 12:27:05 devstack sudo[105592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:27:06 devstack sudo[105592]: pam_unix(sudo:session): session closed for user root Nov 04 12:27:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-08a8f081-0750-4d6f-b848-5084c520f4a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b42b1bfa-72b7-43c6-8f47-4b37be62f457" returned: 0 in 0.352s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:27:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-08a8f081-0750-4d6f-b848-5084c520f4a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b42b1bfa-72b7-43c6-8f47-4b37be62f457 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:27:06 devstack sudo[105597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b42b1bfa-72b7-43c6-8f47-4b37be62f457 Nov 04 12:27:06 devstack sudo[105597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:27:06 devstack sudo[105597]: pam_unix(sudo:session): session closed for user root Nov 04 12:27:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-08a8f081-0750-4d6f-b848-5084c520f4a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b42b1bfa-72b7-43c6-8f47-4b37be62f457" returned: 0 in 0.250s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:27:06 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-08a8f081-0750-4d6f-b848-5084c520f4a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] Lock "cinder-quobyte-b42b1bfa-72b7-43c6-8f47-4b37be62f457" released by "delete_volume" :: held 0.662s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:27:06 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-08a8f081-0750-4d6f-b848-5084c520f4a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] Created reservations ['ee7ee29b-f6f7-4955-aedf-180caccf65a6', '630d120b-f921-4a4f-a032-e943c27f713b', '4cc13e5c-aea5-430c-96e7-0e28bbbf9340', '52ce8033-9331-494d-a426-290720ed034a'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:27:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-08a8f081-0750-4d6f-b848-5084c520f4a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:27:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-08a8f081-0750-4d6f-b848-5084c520f4a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:27:06 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-08a8f081-0750-4d6f-b848-5084c520f4a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:27:06 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-08a8f081-0750-4d6f-b848-5084c520f4a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:27:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-08a8f081-0750-4d6f-b848-5084c520f4a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:27:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-08a8f081-0750-4d6f-b848-5084c520f4a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:27:06 devstack sudo[105600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:27:06 devstack sudo[105600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:27:06 devstack sudo[105600]: pam_unix(sudo:session): session closed for user root Nov 04 12:27:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-08a8f081-0750-4d6f-b848-5084c520f4a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.250s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:27:06 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-08a8f081-0750-4d6f-b848-5084c520f4a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:27:06 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-08a8f081-0750-4d6f-b848-5084c520f4a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] Deleted volume successfully. Nov 04 12:27:06 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-08a8f081-0750-4d6f-b848-5084c520f4a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-318046740 None] Lock "cinder-b42b1bfa-72b7-43c6-8f47-4b37be62f457-delete_volume" released by "delete_volume" :: held 1.099s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:27:12 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-de9d9003-71e8-40ef-b85d-5cc8b8d0aa38 tempest-VolumeTypesAccessTest-614816496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:27:12 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-de9d9003-71e8-40ef-b85d-5cc8b8d0aa38 tempest-VolumeTypesAccessTest-614816496 None] Flow 'volume_create_manager' (92048c9d-4980-4d04-935f-2f94345eab3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:27:12 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-de9d9003-71e8-40ef-b85d-5cc8b8d0aa38 tempest-VolumeTypesAccessTest-614816496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70fbcde4-7cda-434b-98f1-9ebbab2aa354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:27:12 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-de9d9003-71e8-40ef-b85d-5cc8b8d0aa38 tempest-VolumeTypesAccessTest-614816496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70fbcde4-7cda-434b-98f1-9ebbab2aa354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1103775172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=695dc622-a205-43c5-8941-95dcecbaf37c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34f2334ca7b54155876af40eb94048c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:27:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:27:13Z,use_quota=True,user_id='e6971dd72bd14bb7ac303133a0b8b92f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bcaa9506-607d-42d0-9337-50150cafbf80),volume_type_id=bcaa9506-607d-42d0-9337-50150cafbf80)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:27:12 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-de9d9003-71e8-40ef-b85d-5cc8b8d0aa38 tempest-VolumeTypesAccessTest-614816496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db05a6c0-3de1-43fd-9f15-1ea7c6963f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:27:12 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-de9d9003-71e8-40ef-b85d-5cc8b8d0aa38 tempest-VolumeTypesAccessTest-614816496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db05a6c0-3de1-43fd-9f15-1ea7c6963f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:27:12 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-de9d9003-71e8-40ef-b85d-5cc8b8d0aa38 tempest-VolumeTypesAccessTest-614816496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f8ebe50-1543-418f-b593-ef8ad57c309b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:27:12 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-de9d9003-71e8-40ef-b85d-5cc8b8d0aa38 tempest-VolumeTypesAccessTest-614816496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f8ebe50-1543-418f-b593-ef8ad57c309b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '695dc622-a205-43c5-8941-95dcecbaf37c', 'volume_name': 'volume-695dc622-a205-43c5-8941-95dcecbaf37c', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:27:12 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-de9d9003-71e8-40ef-b85d-5cc8b8d0aa38 tempest-VolumeTypesAccessTest-614816496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7830d825-031c-41d5-833e-94643d38f1d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:27:12 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-de9d9003-71e8-40ef-b85d-5cc8b8d0aa38 tempest-VolumeTypesAccessTest-614816496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7830d825-031c-41d5-833e-94643d38f1d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:27:12 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-de9d9003-71e8-40ef-b85d-5cc8b8d0aa38 tempest-VolumeTypesAccessTest-614816496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d052934-da87-40a2-a06f-cf4a3bbd2a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:27:12 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-de9d9003-71e8-40ef-b85d-5cc8b8d0aa38 tempest-VolumeTypesAccessTest-614816496 None] Volume 695dc622-a205-43c5-8941-95dcecbaf37c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-695dc622-a205-43c5-8941-95dcecbaf37c', 'volume_size': 1} Nov 04 12:27:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-de9d9003-71e8-40ef-b85d-5cc8b8d0aa38 tempest-VolumeTypesAccessTest-614816496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:27:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-de9d9003-71e8-40ef-b85d-5cc8b8d0aa38 tempest-VolumeTypesAccessTest-614816496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:27:12 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-de9d9003-71e8-40ef-b85d-5cc8b8d0aa38 tempest-VolumeTypesAccessTest-614816496 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1103775172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=695dc622-a205-43c5-8941-95dcecbaf37c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34f2334ca7b54155876af40eb94048c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:27:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:27:13Z,use_quota=True,user_id='e6971dd72bd14bb7ac303133a0b8b92f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bcaa9506-607d-42d0-9337-50150cafbf80),volume_type_id=bcaa9506-607d-42d0-9337-50150cafbf80)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:27:12 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-de9d9003-71e8-40ef-b85d-5cc8b8d0aa38 tempest-VolumeTypesAccessTest-614816496 None] Creating volume 695dc622-a205-43c5-8941-95dcecbaf37c {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:27:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-de9d9003-71e8-40ef-b85d-5cc8b8d0aa38 tempest-VolumeTypesAccessTest-614816496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:27:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-de9d9003-71e8-40ef-b85d-5cc8b8d0aa38 tempest-VolumeTypesAccessTest-614816496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:27:12 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-de9d9003-71e8-40ef-b85d-5cc8b8d0aa38 tempest-VolumeTypesAccessTest-614816496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:27:12 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-de9d9003-71e8-40ef-b85d-5cc8b8d0aa38 tempest-VolumeTypesAccessTest-614816496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:27:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-de9d9003-71e8-40ef-b85d-5cc8b8d0aa38 tempest-VolumeTypesAccessTest-614816496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:27:12 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-de9d9003-71e8-40ef-b85d-5cc8b8d0aa38 tempest-VolumeTypesAccessTest-614816496 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:27:12 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-de9d9003-71e8-40ef-b85d-5cc8b8d0aa38 tempest-VolumeTypesAccessTest-614816496 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:27:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-de9d9003-71e8-40ef-b85d-5cc8b8d0aa38 tempest-VolumeTypesAccessTest-614816496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-695dc622-a205-43c5-8941-95dcecbaf37c 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:27:12 devstack sudo[105603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-695dc622-a205-43c5-8941-95dcecbaf37c 1073741824 Nov 04 12:27:12 devstack sudo[105603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:27:13 devstack sudo[105603]: pam_unix(sudo:session): session closed for user root Nov 04 12:27:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-de9d9003-71e8-40ef-b85d-5cc8b8d0aa38 tempest-VolumeTypesAccessTest-614816496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-695dc622-a205-43c5-8941-95dcecbaf37c 1073741824" returned: 0 in 0.396s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:27:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-de9d9003-71e8-40ef-b85d-5cc8b8d0aa38 tempest-VolumeTypesAccessTest-614816496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-695dc622-a205-43c5-8941-95dcecbaf37c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:27:13 devstack sudo[105608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-695dc622-a205-43c5-8941-95dcecbaf37c Nov 04 12:27:13 devstack sudo[105608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:27:13 devstack sudo[105608]: pam_unix(sudo:session): session closed for user root Nov 04 12:27:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-de9d9003-71e8-40ef-b85d-5cc8b8d0aa38 tempest-VolumeTypesAccessTest-614816496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-695dc622-a205-43c5-8941-95dcecbaf37c" returned: 0 in 0.240s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:27:13 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-de9d9003-71e8-40ef-b85d-5cc8b8d0aa38 tempest-VolumeTypesAccessTest-614816496 None] <== create_volume: return (679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:27:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-de9d9003-71e8-40ef-b85d-5cc8b8d0aa38 tempest-VolumeTypesAccessTest-614816496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:27:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-de9d9003-71e8-40ef-b85d-5cc8b8d0aa38 tempest-VolumeTypesAccessTest-614816496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d052934-da87-40a2-a06f-cf4a3bbd2a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-695dc622-a205-43c5-8941-95dcecbaf37c', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:27:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-de9d9003-71e8-40ef-b85d-5cc8b8d0aa38 tempest-VolumeTypesAccessTest-614816496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b54eaaed-f09b-4a66-817a-f983f4575670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:27:13 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-de9d9003-71e8-40ef-b85d-5cc8b8d0aa38 tempest-VolumeTypesAccessTest-614816496 None] Volume volume-695dc622-a205-43c5-8941-95dcecbaf37c (695dc622-a205-43c5-8941-95dcecbaf37c): created successfully Nov 04 12:27:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-de9d9003-71e8-40ef-b85d-5cc8b8d0aa38 tempest-VolumeTypesAccessTest-614816496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b54eaaed-f09b-4a66-817a-f983f4575670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:27:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-de9d9003-71e8-40ef-b85d-5cc8b8d0aa38 tempest-VolumeTypesAccessTest-614816496 None] Flow 'volume_create_manager' (92048c9d-4980-4d04-935f-2f94345eab3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:27:13 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-de9d9003-71e8-40ef-b85d-5cc8b8d0aa38 tempest-VolumeTypesAccessTest-614816496 None] Created volume successfully. Nov 04 12:27:13 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3e663c77-c551-411c-9256-8612516f7fc6 tempest-VolumeTypesAccessTest-614816496 None] Acquiring lock "cinder-695dc622-a205-43c5-8941-95dcecbaf37c-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:27:13 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3e663c77-c551-411c-9256-8612516f7fc6 tempest-VolumeTypesAccessTest-614816496 None] Lock "cinder-695dc622-a205-43c5-8941-95dcecbaf37c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:27:13 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3e663c77-c551-411c-9256-8612516f7fc6 tempest-VolumeTypesAccessTest-614816496 None] Acquiring lock "cinder-quobyte-695dc622-a205-43c5-8941-95dcecbaf37c" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:27:13 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3e663c77-c551-411c-9256-8612516f7fc6 tempest-VolumeTypesAccessTest-614816496 None] Lock "cinder-quobyte-695dc622-a205-43c5-8941-95dcecbaf37c" acquired by "delete_volume" :: waited 0.017s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:27:13 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[60bc39cb-dfba-44a7-8b04-04c6421b9203]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:27:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3e663c77-c551-411c-9256-8612516f7fc6 tempest-VolumeTypesAccessTest-614816496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-695dc622-a205-43c5-8941-95dcecbaf37c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:27:13 devstack sudo[105612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-695dc622-a205-43c5-8941-95dcecbaf37c Nov 04 12:27:13 devstack sudo[105612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:27:14 devstack sudo[105612]: pam_unix(sudo:session): session closed for user root Nov 04 12:27:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3e663c77-c551-411c-9256-8612516f7fc6 tempest-VolumeTypesAccessTest-614816496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-695dc622-a205-43c5-8941-95dcecbaf37c" returned: 0 in 0.344s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:27:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3e663c77-c551-411c-9256-8612516f7fc6 tempest-VolumeTypesAccessTest-614816496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-695dc622-a205-43c5-8941-95dcecbaf37c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:27:14 devstack sudo[105617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-695dc622-a205-43c5-8941-95dcecbaf37c Nov 04 12:27:14 devstack sudo[105617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:27:14 devstack sudo[105617]: pam_unix(sudo:session): session closed for user root Nov 04 12:27:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3e663c77-c551-411c-9256-8612516f7fc6 tempest-VolumeTypesAccessTest-614816496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-695dc622-a205-43c5-8941-95dcecbaf37c" returned: 0 in 0.240s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:27:14 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3e663c77-c551-411c-9256-8612516f7fc6 tempest-VolumeTypesAccessTest-614816496 None] Lock "cinder-quobyte-695dc622-a205-43c5-8941-95dcecbaf37c" released by "delete_volume" :: held 0.624s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:27:14 devstack cinder-volume[87095]: WARNING cinder.quota [None req-3e663c77-c551-411c-9256-8612516f7fc6 tempest-VolumeTypesAccessTest-614816496 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1779937723 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1779937723, it is now deprecated. Please use the default quota class for default quota. Nov 04 12:27:14 devstack cinder-volume[87095]: WARNING cinder.quota [None req-3e663c77-c551-411c-9256-8612516f7fc6 tempest-VolumeTypesAccessTest-614816496 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1779937723 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1779937723, it is now deprecated. Please use the default quota class for default quota. Nov 04 12:27:14 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-3e663c77-c551-411c-9256-8612516f7fc6 tempest-VolumeTypesAccessTest-614816496 None] Created reservations ['817b3e11-a179-4a09-a2ee-6b809254bcd5', '288851ce-ad4e-43f8-8375-1472cd6ddbf0', '7a507404-9da2-432e-a2c5-886b1e9c20d1', '5629bbf2-8869-4b61-86d4-ecb7bd661091'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:27:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3e663c77-c551-411c-9256-8612516f7fc6 tempest-VolumeTypesAccessTest-614816496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:27:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3e663c77-c551-411c-9256-8612516f7fc6 tempest-VolumeTypesAccessTest-614816496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:27:14 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3e663c77-c551-411c-9256-8612516f7fc6 tempest-VolumeTypesAccessTest-614816496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:27:14 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3e663c77-c551-411c-9256-8612516f7fc6 tempest-VolumeTypesAccessTest-614816496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:27:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3e663c77-c551-411c-9256-8612516f7fc6 tempest-VolumeTypesAccessTest-614816496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:27:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3e663c77-c551-411c-9256-8612516f7fc6 tempest-VolumeTypesAccessTest-614816496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:27:14 devstack sudo[105620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:27:14 devstack sudo[105620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:27:14 devstack sudo[105620]: pam_unix(sudo:session): session closed for user root Nov 04 12:27:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3e663c77-c551-411c-9256-8612516f7fc6 tempest-VolumeTypesAccessTest-614816496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.237s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:27:14 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-3e663c77-c551-411c-9256-8612516f7fc6 tempest-VolumeTypesAccessTest-614816496 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:27:14 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-3e663c77-c551-411c-9256-8612516f7fc6 tempest-VolumeTypesAccessTest-614816496 None] Deleted volume successfully. Nov 04 12:27:14 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3e663c77-c551-411c-9256-8612516f7fc6 tempest-VolumeTypesAccessTest-614816496 None] Lock "cinder-695dc622-a205-43c5-8941-95dcecbaf37c-delete_volume" released by "delete_volume" :: held 1.053s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:27:24 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:UPDATE=53,cinder:SELECT=36,cinder:INSERT=13,cinder:DELETE=4 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 12:27:24 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=39,cinder:UPDATE=49,cinder:DELETE=5,cinder:INSERT=12 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 12:27:35 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=1 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 12:27:35 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:UPDATE=1 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 12:27:56 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-032d3b45-a0ba-42a3-aa87-ec6cd71d27bf tempest-VolumesActionsTest-727782508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:27:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-032d3b45-a0ba-42a3-aa87-ec6cd71d27bf tempest-VolumesActionsTest-727782508 None] Flow 'volume_create_manager' (99b094e3-923d-4dca-932e-20fba9d3b5cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:27:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-032d3b45-a0ba-42a3-aa87-ec6cd71d27bf tempest-VolumesActionsTest-727782508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3232ac49-d4fd-4bb3-a71a-82d6940a8de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:27:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-032d3b45-a0ba-42a3-aa87-ec6cd71d27bf tempest-VolumesActionsTest-727782508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3232ac49-d4fd-4bb3-a71a-82d6940a8de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:27:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1047722473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50cac487-27a3-4e30-b57e-f2738f7bcb33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a94c83563dc241f39a0ad7c290c7ffc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:27:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:27:56Z,use_quota=True,user_id='29a3156fdc7d48108b51ed9bb2f9474e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:27:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-032d3b45-a0ba-42a3-aa87-ec6cd71d27bf tempest-VolumesActionsTest-727782508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3118743-61af-413d-a4ad-0c2835988b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:27:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-032d3b45-a0ba-42a3-aa87-ec6cd71d27bf tempest-VolumesActionsTest-727782508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3118743-61af-413d-a4ad-0c2835988b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:27:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-032d3b45-a0ba-42a3-aa87-ec6cd71d27bf tempest-VolumesActionsTest-727782508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a61c3cc-1211-4bbe-9f98-3e1ab3b14ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:27:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-032d3b45-a0ba-42a3-aa87-ec6cd71d27bf tempest-VolumesActionsTest-727782508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a61c3cc-1211-4bbe-9f98-3e1ab3b14ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50cac487-27a3-4e30-b57e-f2738f7bcb33', 'volume_name': 'volume-50cac487-27a3-4e30-b57e-f2738f7bcb33', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:27:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-032d3b45-a0ba-42a3-aa87-ec6cd71d27bf tempest-VolumesActionsTest-727782508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cec4e1f-afe6-440e-8ab0-b3e76ab4c02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:27:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-032d3b45-a0ba-42a3-aa87-ec6cd71d27bf tempest-VolumesActionsTest-727782508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cec4e1f-afe6-440e-8ab0-b3e76ab4c02b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:27:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-032d3b45-a0ba-42a3-aa87-ec6cd71d27bf tempest-VolumesActionsTest-727782508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbc4d85c-d9a9-40fa-951b-86f5eedd554a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:27:56 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-032d3b45-a0ba-42a3-aa87-ec6cd71d27bf tempest-VolumesActionsTest-727782508 None] Volume 50cac487-27a3-4e30-b57e-f2738f7bcb33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50cac487-27a3-4e30-b57e-f2738f7bcb33', 'volume_size': 1} Nov 04 12:27:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-032d3b45-a0ba-42a3-aa87-ec6cd71d27bf tempest-VolumesActionsTest-727782508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:27:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-032d3b45-a0ba-42a3-aa87-ec6cd71d27bf tempest-VolumesActionsTest-727782508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:27:56 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-032d3b45-a0ba-42a3-aa87-ec6cd71d27bf tempest-VolumesActionsTest-727782508 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:27:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1047722473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50cac487-27a3-4e30-b57e-f2738f7bcb33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a94c83563dc241f39a0ad7c290c7ffc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:27:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:27:56Z,use_quota=True,user_id='29a3156fdc7d48108b51ed9bb2f9474e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:27:56 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-032d3b45-a0ba-42a3-aa87-ec6cd71d27bf tempest-VolumesActionsTest-727782508 None] Creating volume 50cac487-27a3-4e30-b57e-f2738f7bcb33 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:27:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-032d3b45-a0ba-42a3-aa87-ec6cd71d27bf tempest-VolumesActionsTest-727782508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:27:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-032d3b45-a0ba-42a3-aa87-ec6cd71d27bf tempest-VolumesActionsTest-727782508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:27:56 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-032d3b45-a0ba-42a3-aa87-ec6cd71d27bf tempest-VolumesActionsTest-727782508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:27:56 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-032d3b45-a0ba-42a3-aa87-ec6cd71d27bf tempest-VolumesActionsTest-727782508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:27:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-032d3b45-a0ba-42a3-aa87-ec6cd71d27bf tempest-VolumesActionsTest-727782508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:27:56 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-032d3b45-a0ba-42a3-aa87-ec6cd71d27bf tempest-VolumesActionsTest-727782508 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:27:56 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-032d3b45-a0ba-42a3-aa87-ec6cd71d27bf tempest-VolumesActionsTest-727782508 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:27:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-032d3b45-a0ba-42a3-aa87-ec6cd71d27bf tempest-VolumesActionsTest-727782508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-50cac487-27a3-4e30-b57e-f2738f7bcb33 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:27:56 devstack sudo[105761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-50cac487-27a3-4e30-b57e-f2738f7bcb33 1073741824 Nov 04 12:27:56 devstack sudo[105761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:27:56 devstack sudo[105761]: pam_unix(sudo:session): session closed for user root Nov 04 12:27:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-032d3b45-a0ba-42a3-aa87-ec6cd71d27bf tempest-VolumesActionsTest-727782508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-50cac487-27a3-4e30-b57e-f2738f7bcb33 1073741824" returned: 0 in 0.420s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:27:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-032d3b45-a0ba-42a3-aa87-ec6cd71d27bf tempest-VolumesActionsTest-727782508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-50cac487-27a3-4e30-b57e-f2738f7bcb33 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:27:57 devstack sudo[105766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-50cac487-27a3-4e30-b57e-f2738f7bcb33 Nov 04 12:27:57 devstack sudo[105766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:27:57 devstack sudo[105766]: pam_unix(sudo:session): session closed for user root Nov 04 12:27:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-032d3b45-a0ba-42a3-aa87-ec6cd71d27bf tempest-VolumesActionsTest-727782508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-50cac487-27a3-4e30-b57e-f2738f7bcb33" returned: 0 in 0.255s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:27:57 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-032d3b45-a0ba-42a3-aa87-ec6cd71d27bf tempest-VolumesActionsTest-727782508 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:27:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-032d3b45-a0ba-42a3-aa87-ec6cd71d27bf tempest-VolumesActionsTest-727782508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:27:57 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-032d3b45-a0ba-42a3-aa87-ec6cd71d27bf tempest-VolumesActionsTest-727782508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbc4d85c-d9a9-40fa-951b-86f5eedd554a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50cac487-27a3-4e30-b57e-f2738f7bcb33', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:27:57 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-032d3b45-a0ba-42a3-aa87-ec6cd71d27bf tempest-VolumesActionsTest-727782508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68c10c92-0f77-4ce0-8896-01f079ab9e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:27:57 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-032d3b45-a0ba-42a3-aa87-ec6cd71d27bf tempest-VolumesActionsTest-727782508 None] Volume volume-50cac487-27a3-4e30-b57e-f2738f7bcb33 (50cac487-27a3-4e30-b57e-f2738f7bcb33): created successfully Nov 04 12:27:57 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-032d3b45-a0ba-42a3-aa87-ec6cd71d27bf tempest-VolumesActionsTest-727782508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68c10c92-0f77-4ce0-8896-01f079ab9e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:27:57 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-032d3b45-a0ba-42a3-aa87-ec6cd71d27bf tempest-VolumesActionsTest-727782508 None] Flow 'volume_create_manager' (99b094e3-923d-4dca-932e-20fba9d3b5cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:27:57 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-032d3b45-a0ba-42a3-aa87-ec6cd71d27bf tempest-VolumesActionsTest-727782508 None] Created volume successfully. Nov 04 12:27:57 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0c72ed46-b81c-42dc-95de-ffbf022b6b89 tempest-VolumesActionsTest-727782508 None] Acquiring lock "cinder-50cac487-27a3-4e30-b57e-f2738f7bcb33" by "attach_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:27:57 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0c72ed46-b81c-42dc-95de-ffbf022b6b89 tempest-VolumesActionsTest-727782508 None] Lock "cinder-50cac487-27a3-4e30-b57e-f2738f7bcb33" acquired by "attach_volume" :: waited 0.016s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:27:57 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-0c72ed46-b81c-42dc-95de-ffbf022b6b89 tempest-VolumesActionsTest-727782508 None] Attaching volume 50cac487-27a3-4e30-b57e-f2738f7bcb33 to instance 20be9840-0ac6-409f-ab43-a832a71fda41 at mountpoint /dev/vdb on host None. Nov 04 12:27:57 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-0c72ed46-b81c-42dc-95de-ffbf022b6b89 tempest-VolumesActionsTest-727782508 None] Attach volume completed successfully. Nov 04 12:27:57 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0c72ed46-b81c-42dc-95de-ffbf022b6b89 tempest-VolumesActionsTest-727782508 None] Lock "cinder-50cac487-27a3-4e30-b57e-f2738f7bcb33" released by "attach_volume" :: held 0.123s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:27:58 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-dc7e18e8-2f6a-4767-aaff-3c80878ecaec tempest-VolumesActionsTest-1917607968 None] Terminate volume connection completed successfully. Nov 04 12:27:58 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-dc7e18e8-2f6a-4767-aaff-3c80878ecaec tempest-VolumesActionsTest-1917607968 None] Acquiring lock "cinder-50cac487-27a3-4e30-b57e-f2738f7bcb33-detach_volume" by "detach_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:27:58 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-dc7e18e8-2f6a-4767-aaff-3c80878ecaec tempest-VolumesActionsTest-1917607968 None] Lock "cinder-50cac487-27a3-4e30-b57e-f2738f7bcb33-detach_volume" acquired by "detach_volume" :: waited 0.015s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:27:58 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-dc7e18e8-2f6a-4767-aaff-3c80878ecaec tempest-VolumesActionsTest-1917607968 None] Detaching volume 50cac487-27a3-4e30-b57e-f2738f7bcb33 from instance 20be9840-0ac6-409f-ab43-a832a71fda41. Nov 04 12:27:58 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-dc7e18e8-2f6a-4767-aaff-3c80878ecaec tempest-VolumesActionsTest-1917607968 None] Detach volume completed successfully. Nov 04 12:27:58 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-dc7e18e8-2f6a-4767-aaff-3c80878ecaec tempest-VolumesActionsTest-1917607968 None] Lock "cinder-50cac487-27a3-4e30-b57e-f2738f7bcb33-detach_volume" released by "detach_volume" :: held 0.064s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:27:58 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0dc84275-0510-40db-80c3-5358f228a7ef tempest-VolumesActionsTest-727782508 None] Acquiring lock "cinder-50cac487-27a3-4e30-b57e-f2738f7bcb33-detach_volume" by "detach_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:27:58 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0dc84275-0510-40db-80c3-5358f228a7ef tempest-VolumesActionsTest-727782508 None] Lock "cinder-50cac487-27a3-4e30-b57e-f2738f7bcb33-detach_volume" acquired by "detach_volume" :: waited 0.012s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:27:58 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-0dc84275-0510-40db-80c3-5358f228a7ef tempest-VolumesActionsTest-727782508 None] Volume detach called, but volume not attached. Nov 04 12:27:58 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0dc84275-0510-40db-80c3-5358f228a7ef tempest-VolumesActionsTest-727782508 None] Lock "cinder-50cac487-27a3-4e30-b57e-f2738f7bcb33-detach_volume" released by "detach_volume" :: held 0.022s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:27:58 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e8e6cfeb-83e7-4352-a3e5-82eb52f85ef0 tempest-VolumesActionsTest-727782508 None] Acquiring lock "cinder-50cac487-27a3-4e30-b57e-f2738f7bcb33-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:27:58 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e8e6cfeb-83e7-4352-a3e5-82eb52f85ef0 tempest-VolumesActionsTest-727782508 None] Lock "cinder-50cac487-27a3-4e30-b57e-f2738f7bcb33-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:27:58 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e8e6cfeb-83e7-4352-a3e5-82eb52f85ef0 tempest-VolumesActionsTest-727782508 None] Acquiring lock "cinder-quobyte-50cac487-27a3-4e30-b57e-f2738f7bcb33" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:27:58 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e8e6cfeb-83e7-4352-a3e5-82eb52f85ef0 tempest-VolumesActionsTest-727782508 None] Lock "cinder-quobyte-50cac487-27a3-4e30-b57e-f2738f7bcb33" acquired by "delete_volume" :: waited 0.019s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:27:58 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cbcc2a7-494c-43f7-8b06-dd8beaf28344]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:27:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e8e6cfeb-83e7-4352-a3e5-82eb52f85ef0 tempest-VolumesActionsTest-727782508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-50cac487-27a3-4e30-b57e-f2738f7bcb33 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:27:58 devstack sudo[105770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-50cac487-27a3-4e30-b57e-f2738f7bcb33 Nov 04 12:27:58 devstack sudo[105770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:27:59 devstack sudo[105770]: pam_unix(sudo:session): session closed for user root Nov 04 12:27:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e8e6cfeb-83e7-4352-a3e5-82eb52f85ef0 tempest-VolumesActionsTest-727782508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-50cac487-27a3-4e30-b57e-f2738f7bcb33" returned: 0 in 0.371s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:27:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e8e6cfeb-83e7-4352-a3e5-82eb52f85ef0 tempest-VolumesActionsTest-727782508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-50cac487-27a3-4e30-b57e-f2738f7bcb33 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:27:59 devstack sudo[105775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-50cac487-27a3-4e30-b57e-f2738f7bcb33 Nov 04 12:27:59 devstack sudo[105775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:27:59 devstack sudo[105775]: pam_unix(sudo:session): session closed for user root Nov 04 12:27:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e8e6cfeb-83e7-4352-a3e5-82eb52f85ef0 tempest-VolumesActionsTest-727782508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-50cac487-27a3-4e30-b57e-f2738f7bcb33" returned: 0 in 0.266s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:27:59 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e8e6cfeb-83e7-4352-a3e5-82eb52f85ef0 tempest-VolumesActionsTest-727782508 None] Lock "cinder-quobyte-50cac487-27a3-4e30-b57e-f2738f7bcb33" released by "delete_volume" :: held 0.683s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:27:59 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-e8e6cfeb-83e7-4352-a3e5-82eb52f85ef0 tempest-VolumesActionsTest-727782508 None] Created reservations ['d8d37a7f-7423-48a0-a5b2-4646f9e4e1fb', '8ca6ff5d-20b2-4d33-b422-729924d006ac', '0b970ac7-f8ef-4f26-8ad0-38e98ef66409', '06577a8e-9627-48c0-a0d5-39a5367850f9'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:27:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e8e6cfeb-83e7-4352-a3e5-82eb52f85ef0 tempest-VolumesActionsTest-727782508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:27:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e8e6cfeb-83e7-4352-a3e5-82eb52f85ef0 tempest-VolumesActionsTest-727782508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:27:59 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e8e6cfeb-83e7-4352-a3e5-82eb52f85ef0 tempest-VolumesActionsTest-727782508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:27:59 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e8e6cfeb-83e7-4352-a3e5-82eb52f85ef0 tempest-VolumesActionsTest-727782508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:27:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e8e6cfeb-83e7-4352-a3e5-82eb52f85ef0 tempest-VolumesActionsTest-727782508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:27:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e8e6cfeb-83e7-4352-a3e5-82eb52f85ef0 tempest-VolumesActionsTest-727782508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:27:59 devstack sudo[105778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:27:59 devstack sudo[105778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:27:59 devstack sudo[105778]: pam_unix(sudo:session): session closed for user root Nov 04 12:27:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e8e6cfeb-83e7-4352-a3e5-82eb52f85ef0 tempest-VolumesActionsTest-727782508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.264s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:27:59 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-e8e6cfeb-83e7-4352-a3e5-82eb52f85ef0 tempest-VolumesActionsTest-727782508 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:27:59 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-e8e6cfeb-83e7-4352-a3e5-82eb52f85ef0 tempest-VolumesActionsTest-727782508 None] Deleted volume successfully. Nov 04 12:27:59 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e8e6cfeb-83e7-4352-a3e5-82eb52f85ef0 tempest-VolumesActionsTest-727782508 None] Lock "cinder-50cac487-27a3-4e30-b57e-f2738f7bcb33-delete_volume" released by "delete_volume" :: held 1.166s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:28:01 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 12:28:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:28:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:28:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:28:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:28:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:28:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:28:01 devstack sudo[105804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:28:01 devstack sudo[105804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:28:02 devstack sudo[105804]: pam_unix(sudo:session): session closed for user root Nov 04 12:28:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.237s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:28:02 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:28:02 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Running periodic task VolumeManager._thread_info {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 12:28:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] thread count: 28 {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 12:28:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] thread info: [<_MainThread(MainThread, started 140610387472512)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 12:28:03 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e401513-18e8-4e20-880e-0481cd920bee tempest-VolumesActionsTest-727782508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:28:03 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9e401513-18e8-4e20-880e-0481cd920bee tempest-VolumesActionsTest-727782508 None] Flow 'volume_create_manager' (0e09f977-bc87-4b62-9b2d-a227f2ee7dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:28:03 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9e401513-18e8-4e20-880e-0481cd920bee tempest-VolumesActionsTest-727782508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9138f9e7-23ff-4923-9898-6faeb45a137e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:28:03 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9e401513-18e8-4e20-880e-0481cd920bee tempest-VolumesActionsTest-727782508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9138f9e7-23ff-4923-9898-6faeb45a137e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2022569655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14e480bf-812b-41c0-aa10-2754d0322865,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a94c83563dc241f39a0ad7c290c7ffc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:28:03Z,use_quota=True,user_id='29a3156fdc7d48108b51ed9bb2f9474e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:28:03 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9e401513-18e8-4e20-880e-0481cd920bee tempest-VolumesActionsTest-727782508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (114a94ef-db87-4128-9087-0cfdb71b0250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:28:03 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9e401513-18e8-4e20-880e-0481cd920bee tempest-VolumesActionsTest-727782508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (114a94ef-db87-4128-9087-0cfdb71b0250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:28:03 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9e401513-18e8-4e20-880e-0481cd920bee tempest-VolumesActionsTest-727782508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40eec0a9-340d-4a54-9e91-ec6dbee32b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:28:03 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9e401513-18e8-4e20-880e-0481cd920bee tempest-VolumesActionsTest-727782508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40eec0a9-340d-4a54-9e91-ec6dbee32b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14e480bf-812b-41c0-aa10-2754d0322865', 'volume_name': 'volume-14e480bf-812b-41c0-aa10-2754d0322865', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:28:03 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9e401513-18e8-4e20-880e-0481cd920bee tempest-VolumesActionsTest-727782508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (318aa61d-20a6-4876-8f86-ae6207cf4fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:28:03 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9e401513-18e8-4e20-880e-0481cd920bee tempest-VolumesActionsTest-727782508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (318aa61d-20a6-4876-8f86-ae6207cf4fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:28:03 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9e401513-18e8-4e20-880e-0481cd920bee tempest-VolumesActionsTest-727782508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba8f0e60-63cc-4a73-88e3-cd4f6a276914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:28:03 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-9e401513-18e8-4e20-880e-0481cd920bee tempest-VolumesActionsTest-727782508 None] Volume 14e480bf-812b-41c0-aa10-2754d0322865: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14e480bf-812b-41c0-aa10-2754d0322865', 'volume_size': 1} Nov 04 12:28:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9e401513-18e8-4e20-880e-0481cd920bee tempest-VolumesActionsTest-727782508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:28:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9e401513-18e8-4e20-880e-0481cd920bee tempest-VolumesActionsTest-727782508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:28:03 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9e401513-18e8-4e20-880e-0481cd920bee tempest-VolumesActionsTest-727782508 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2022569655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14e480bf-812b-41c0-aa10-2754d0322865,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a94c83563dc241f39a0ad7c290c7ffc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:28:03Z,use_quota=True,user_id='29a3156fdc7d48108b51ed9bb2f9474e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:28:03 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-9e401513-18e8-4e20-880e-0481cd920bee tempest-VolumesActionsTest-727782508 None] Creating volume 14e480bf-812b-41c0-aa10-2754d0322865 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:28:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9e401513-18e8-4e20-880e-0481cd920bee tempest-VolumesActionsTest-727782508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:28:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9e401513-18e8-4e20-880e-0481cd920bee tempest-VolumesActionsTest-727782508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:28:03 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9e401513-18e8-4e20-880e-0481cd920bee tempest-VolumesActionsTest-727782508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:28:03 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9e401513-18e8-4e20-880e-0481cd920bee tempest-VolumesActionsTest-727782508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:28:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9e401513-18e8-4e20-880e-0481cd920bee tempest-VolumesActionsTest-727782508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:28:03 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9e401513-18e8-4e20-880e-0481cd920bee tempest-VolumesActionsTest-727782508 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:28:03 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-9e401513-18e8-4e20-880e-0481cd920bee tempest-VolumesActionsTest-727782508 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:28:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9e401513-18e8-4e20-880e-0481cd920bee tempest-VolumesActionsTest-727782508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-14e480bf-812b-41c0-aa10-2754d0322865 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:28:03 devstack sudo[105807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-14e480bf-812b-41c0-aa10-2754d0322865 1073741824 Nov 04 12:28:03 devstack sudo[105807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:28:03 devstack sudo[105807]: pam_unix(sudo:session): session closed for user root Nov 04 12:28:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9e401513-18e8-4e20-880e-0481cd920bee tempest-VolumesActionsTest-727782508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-14e480bf-812b-41c0-aa10-2754d0322865 1073741824" returned: 0 in 0.383s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:28:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9e401513-18e8-4e20-880e-0481cd920bee tempest-VolumesActionsTest-727782508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-14e480bf-812b-41c0-aa10-2754d0322865 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:28:03 devstack sudo[105813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-14e480bf-812b-41c0-aa10-2754d0322865 Nov 04 12:28:03 devstack sudo[105813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:28:03 devstack sudo[105813]: pam_unix(sudo:session): session closed for user root Nov 04 12:28:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9e401513-18e8-4e20-880e-0481cd920bee tempest-VolumesActionsTest-727782508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-14e480bf-812b-41c0-aa10-2754d0322865" returned: 0 in 0.239s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:28:03 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9e401513-18e8-4e20-880e-0481cd920bee tempest-VolumesActionsTest-727782508 None] <== create_volume: return (663ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:28:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9e401513-18e8-4e20-880e-0481cd920bee tempest-VolumesActionsTest-727782508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.667s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:28:03 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9e401513-18e8-4e20-880e-0481cd920bee tempest-VolumesActionsTest-727782508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba8f0e60-63cc-4a73-88e3-cd4f6a276914) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14e480bf-812b-41c0-aa10-2754d0322865', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:28:03 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9e401513-18e8-4e20-880e-0481cd920bee tempest-VolumesActionsTest-727782508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58b9a4d5-2a2b-42eb-89d8-13d003f6df1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:28:03 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-9e401513-18e8-4e20-880e-0481cd920bee tempest-VolumesActionsTest-727782508 None] Volume volume-14e480bf-812b-41c0-aa10-2754d0322865 (14e480bf-812b-41c0-aa10-2754d0322865): created successfully Nov 04 12:28:03 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9e401513-18e8-4e20-880e-0481cd920bee tempest-VolumesActionsTest-727782508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58b9a4d5-2a2b-42eb-89d8-13d003f6df1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:28:03 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9e401513-18e8-4e20-880e-0481cd920bee tempest-VolumesActionsTest-727782508 None] Flow 'volume_create_manager' (0e09f977-bc87-4b62-9b2d-a227f2ee7dff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:28:03 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-9e401513-18e8-4e20-880e-0481cd920bee tempest-VolumesActionsTest-727782508 None] Created volume successfully. Nov 04 12:28:04 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-dd35f8de-efce-4a1d-9e46-2d0aec182d28 tempest-VolumesActionsTest-1917607968 None] Acquiring lock "cinder-14e480bf-812b-41c0-aa10-2754d0322865-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:28:04 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-dd35f8de-efce-4a1d-9e46-2d0aec182d28 tempest-VolumesActionsTest-1917607968 None] Lock "cinder-14e480bf-812b-41c0-aa10-2754d0322865-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:28:04 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-dd35f8de-efce-4a1d-9e46-2d0aec182d28 tempest-VolumesActionsTest-1917607968 None] Acquiring lock "cinder-quobyte-14e480bf-812b-41c0-aa10-2754d0322865" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:28:04 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-dd35f8de-efce-4a1d-9e46-2d0aec182d28 tempest-VolumesActionsTest-1917607968 None] Lock "cinder-quobyte-14e480bf-812b-41c0-aa10-2754d0322865" acquired by "delete_volume" :: waited 0.015s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:28:04 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[660a7e64-6621-475c-b965-ac7e25e62ed0]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:28:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-dd35f8de-efce-4a1d-9e46-2d0aec182d28 tempest-VolumesActionsTest-1917607968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-14e480bf-812b-41c0-aa10-2754d0322865 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:28:04 devstack sudo[105816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-14e480bf-812b-41c0-aa10-2754d0322865 Nov 04 12:28:04 devstack sudo[105816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:28:04 devstack sudo[105816]: pam_unix(sudo:session): session closed for user root Nov 04 12:28:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-dd35f8de-efce-4a1d-9e46-2d0aec182d28 tempest-VolumesActionsTest-1917607968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-14e480bf-812b-41c0-aa10-2754d0322865" returned: 0 in 0.354s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:28:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-dd35f8de-efce-4a1d-9e46-2d0aec182d28 tempest-VolumesActionsTest-1917607968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-14e480bf-812b-41c0-aa10-2754d0322865 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:28:04 devstack sudo[105821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-14e480bf-812b-41c0-aa10-2754d0322865 Nov 04 12:28:04 devstack sudo[105821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:28:04 devstack sudo[105821]: pam_unix(sudo:session): session closed for user root Nov 04 12:28:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-dd35f8de-efce-4a1d-9e46-2d0aec182d28 tempest-VolumesActionsTest-1917607968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-14e480bf-812b-41c0-aa10-2754d0322865" returned: 0 in 0.234s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:28:04 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-dd35f8de-efce-4a1d-9e46-2d0aec182d28 tempest-VolumesActionsTest-1917607968 None] Lock "cinder-quobyte-14e480bf-812b-41c0-aa10-2754d0322865" released by "delete_volume" :: held 0.626s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:28:04 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-dd35f8de-efce-4a1d-9e46-2d0aec182d28 tempest-VolumesActionsTest-1917607968 None] Created reservations ['8f51591c-942c-4b71-8ccc-f395be28d6eb', 'f272ae71-5c26-4a8b-9ac4-c6ffda2c15c5', '2f2a0161-550a-4ab0-9cd8-94583b9f2fa3', '0dc3876e-c1e9-4c2c-83fa-0da661b9989a'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:28:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-dd35f8de-efce-4a1d-9e46-2d0aec182d28 tempest-VolumesActionsTest-1917607968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:28:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-dd35f8de-efce-4a1d-9e46-2d0aec182d28 tempest-VolumesActionsTest-1917607968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:28:05 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-dd35f8de-efce-4a1d-9e46-2d0aec182d28 tempest-VolumesActionsTest-1917607968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:28:05 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-dd35f8de-efce-4a1d-9e46-2d0aec182d28 tempest-VolumesActionsTest-1917607968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:28:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-dd35f8de-efce-4a1d-9e46-2d0aec182d28 tempest-VolumesActionsTest-1917607968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:28:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-dd35f8de-efce-4a1d-9e46-2d0aec182d28 tempest-VolumesActionsTest-1917607968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:28:05 devstack sudo[105824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:28:05 devstack sudo[105824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:28:05 devstack sudo[105824]: pam_unix(sudo:session): session closed for user root Nov 04 12:28:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-dd35f8de-efce-4a1d-9e46-2d0aec182d28 tempest-VolumesActionsTest-1917607968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.234s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:28:05 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-dd35f8de-efce-4a1d-9e46-2d0aec182d28 tempest-VolumesActionsTest-1917607968 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:28:05 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-dd35f8de-efce-4a1d-9e46-2d0aec182d28 tempest-VolumesActionsTest-1917607968 None] Deleted volume successfully. Nov 04 12:28:05 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-dd35f8de-efce-4a1d-9e46-2d0aec182d28 tempest-VolumesActionsTest-1917607968 None] Lock "cinder-14e480bf-812b-41c0-aa10-2754d0322865-delete_volume" released by "delete_volume" :: held 1.087s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:28:05 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e34f09d-34d4-4f14-87c3-ba42b27c3b1f tempest-VolumesActionsTest-727782508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:28:05 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7e34f09d-34d4-4f14-87c3-ba42b27c3b1f tempest-VolumesActionsTest-727782508 None] Flow 'volume_create_manager' (bbe837e4-d1da-4724-a754-ed98a8b0cf0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:28:05 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7e34f09d-34d4-4f14-87c3-ba42b27c3b1f tempest-VolumesActionsTest-727782508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5303fb7-7eb3-4bff-b812-23ecdfbc3c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:28:05 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7e34f09d-34d4-4f14-87c3-ba42b27c3b1f tempest-VolumesActionsTest-727782508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5303fb7-7eb3-4bff-b812-23ecdfbc3c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:28:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1220552324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13a4ae8f-429d-4331-80d5-871f2c6c01a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a94c83563dc241f39a0ad7c290c7ffc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:28:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:28:06Z,use_quota=True,user_id='29a3156fdc7d48108b51ed9bb2f9474e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:28:05 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7e34f09d-34d4-4f14-87c3-ba42b27c3b1f tempest-VolumesActionsTest-727782508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23745165-e202-4c81-b523-b3099d516630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:28:05 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7e34f09d-34d4-4f14-87c3-ba42b27c3b1f tempest-VolumesActionsTest-727782508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23745165-e202-4c81-b523-b3099d516630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:28:05 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7e34f09d-34d4-4f14-87c3-ba42b27c3b1f tempest-VolumesActionsTest-727782508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (946f2c77-3199-4eef-bf3f-a49526d30221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:28:05 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7e34f09d-34d4-4f14-87c3-ba42b27c3b1f tempest-VolumesActionsTest-727782508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (946f2c77-3199-4eef-bf3f-a49526d30221) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13a4ae8f-429d-4331-80d5-871f2c6c01a5', 'volume_name': 'volume-13a4ae8f-429d-4331-80d5-871f2c6c01a5', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:28:05 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7e34f09d-34d4-4f14-87c3-ba42b27c3b1f tempest-VolumesActionsTest-727782508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e45ec5dc-be83-4ae1-aa79-c248323a54cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:28:05 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7e34f09d-34d4-4f14-87c3-ba42b27c3b1f tempest-VolumesActionsTest-727782508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e45ec5dc-be83-4ae1-aa79-c248323a54cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:28:05 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7e34f09d-34d4-4f14-87c3-ba42b27c3b1f tempest-VolumesActionsTest-727782508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30b1f408-facd-41ad-a1a5-92ec58ceaa72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:28:05 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-7e34f09d-34d4-4f14-87c3-ba42b27c3b1f tempest-VolumesActionsTest-727782508 None] Volume 13a4ae8f-429d-4331-80d5-871f2c6c01a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13a4ae8f-429d-4331-80d5-871f2c6c01a5', 'volume_size': 1} Nov 04 12:28:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7e34f09d-34d4-4f14-87c3-ba42b27c3b1f tempest-VolumesActionsTest-727782508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:28:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7e34f09d-34d4-4f14-87c3-ba42b27c3b1f tempest-VolumesActionsTest-727782508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:28:05 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7e34f09d-34d4-4f14-87c3-ba42b27c3b1f tempest-VolumesActionsTest-727782508 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:28:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1220552324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13a4ae8f-429d-4331-80d5-871f2c6c01a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a94c83563dc241f39a0ad7c290c7ffc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:28:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:28:06Z,use_quota=True,user_id='29a3156fdc7d48108b51ed9bb2f9474e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:28:05 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-7e34f09d-34d4-4f14-87c3-ba42b27c3b1f tempest-VolumesActionsTest-727782508 None] Creating volume 13a4ae8f-429d-4331-80d5-871f2c6c01a5 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:28:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7e34f09d-34d4-4f14-87c3-ba42b27c3b1f tempest-VolumesActionsTest-727782508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:28:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7e34f09d-34d4-4f14-87c3-ba42b27c3b1f tempest-VolumesActionsTest-727782508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:28:05 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7e34f09d-34d4-4f14-87c3-ba42b27c3b1f tempest-VolumesActionsTest-727782508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:28:05 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7e34f09d-34d4-4f14-87c3-ba42b27c3b1f tempest-VolumesActionsTest-727782508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:28:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7e34f09d-34d4-4f14-87c3-ba42b27c3b1f tempest-VolumesActionsTest-727782508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:28:05 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7e34f09d-34d4-4f14-87c3-ba42b27c3b1f tempest-VolumesActionsTest-727782508 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:28:05 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-7e34f09d-34d4-4f14-87c3-ba42b27c3b1f tempest-VolumesActionsTest-727782508 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:28:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7e34f09d-34d4-4f14-87c3-ba42b27c3b1f tempest-VolumesActionsTest-727782508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-13a4ae8f-429d-4331-80d5-871f2c6c01a5 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:28:05 devstack sudo[105827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-13a4ae8f-429d-4331-80d5-871f2c6c01a5 1073741824 Nov 04 12:28:05 devstack sudo[105827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:28:06 devstack sudo[105827]: pam_unix(sudo:session): session closed for user root Nov 04 12:28:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7e34f09d-34d4-4f14-87c3-ba42b27c3b1f tempest-VolumesActionsTest-727782508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-13a4ae8f-429d-4331-80d5-871f2c6c01a5 1073741824" returned: 0 in 0.401s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:28:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7e34f09d-34d4-4f14-87c3-ba42b27c3b1f tempest-VolumesActionsTest-727782508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-13a4ae8f-429d-4331-80d5-871f2c6c01a5 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:28:06 devstack sudo[105832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-13a4ae8f-429d-4331-80d5-871f2c6c01a5 Nov 04 12:28:06 devstack sudo[105832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:28:06 devstack sudo[105832]: pam_unix(sudo:session): session closed for user root Nov 04 12:28:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7e34f09d-34d4-4f14-87c3-ba42b27c3b1f tempest-VolumesActionsTest-727782508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-13a4ae8f-429d-4331-80d5-871f2c6c01a5" returned: 0 in 0.250s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:28:06 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7e34f09d-34d4-4f14-87c3-ba42b27c3b1f tempest-VolumesActionsTest-727782508 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:28:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7e34f09d-34d4-4f14-87c3-ba42b27c3b1f tempest-VolumesActionsTest-727782508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:28:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7e34f09d-34d4-4f14-87c3-ba42b27c3b1f tempest-VolumesActionsTest-727782508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30b1f408-facd-41ad-a1a5-92ec58ceaa72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13a4ae8f-429d-4331-80d5-871f2c6c01a5', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:28:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7e34f09d-34d4-4f14-87c3-ba42b27c3b1f tempest-VolumesActionsTest-727782508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc611b0e-e7fc-48ae-ade1-5bf83af0119b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:28:06 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-7e34f09d-34d4-4f14-87c3-ba42b27c3b1f tempest-VolumesActionsTest-727782508 None] Volume volume-13a4ae8f-429d-4331-80d5-871f2c6c01a5 (13a4ae8f-429d-4331-80d5-871f2c6c01a5): created successfully Nov 04 12:28:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7e34f09d-34d4-4f14-87c3-ba42b27c3b1f tempest-VolumesActionsTest-727782508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc611b0e-e7fc-48ae-ade1-5bf83af0119b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:28:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7e34f09d-34d4-4f14-87c3-ba42b27c3b1f tempest-VolumesActionsTest-727782508 None] Flow 'volume_create_manager' (bbe837e4-d1da-4724-a754-ed98a8b0cf0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:28:06 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-7e34f09d-34d4-4f14-87c3-ba42b27c3b1f tempest-VolumesActionsTest-727782508 None] Created volume successfully. Nov 04 12:28:06 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f709d5cc-4af9-43be-b816-187f696720fc tempest-VolumesActionsTest-1917607968 None] Acquiring lock "cinder-13a4ae8f-429d-4331-80d5-871f2c6c01a5-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:28:06 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f709d5cc-4af9-43be-b816-187f696720fc tempest-VolumesActionsTest-1917607968 None] Lock "cinder-13a4ae8f-429d-4331-80d5-871f2c6c01a5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:28:07 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f709d5cc-4af9-43be-b816-187f696720fc tempest-VolumesActionsTest-1917607968 None] Acquiring lock "cinder-quobyte-13a4ae8f-429d-4331-80d5-871f2c6c01a5" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:28:07 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f709d5cc-4af9-43be-b816-187f696720fc tempest-VolumesActionsTest-1917607968 None] Lock "cinder-quobyte-13a4ae8f-429d-4331-80d5-871f2c6c01a5" acquired by "delete_volume" :: waited 0.015s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:28:07 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c6aa80-5caf-40c2-b860-6a569126c6a3]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:28:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f709d5cc-4af9-43be-b816-187f696720fc tempest-VolumesActionsTest-1917607968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-13a4ae8f-429d-4331-80d5-871f2c6c01a5 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:28:07 devstack sudo[105835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-13a4ae8f-429d-4331-80d5-871f2c6c01a5 Nov 04 12:28:07 devstack sudo[105835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:28:07 devstack sudo[105835]: pam_unix(sudo:session): session closed for user root Nov 04 12:28:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f709d5cc-4af9-43be-b816-187f696720fc tempest-VolumesActionsTest-1917607968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-13a4ae8f-429d-4331-80d5-871f2c6c01a5" returned: 0 in 0.353s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:28:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f709d5cc-4af9-43be-b816-187f696720fc tempest-VolumesActionsTest-1917607968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-13a4ae8f-429d-4331-80d5-871f2c6c01a5 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:28:07 devstack sudo[105840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-13a4ae8f-429d-4331-80d5-871f2c6c01a5 Nov 04 12:28:07 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:28:07 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root Nov 04 12:28:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f709d5cc-4af9-43be-b816-187f696720fc tempest-VolumesActionsTest-1917607968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-13a4ae8f-429d-4331-80d5-871f2c6c01a5" returned: 0 in 0.235s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:28:07 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f709d5cc-4af9-43be-b816-187f696720fc tempest-VolumesActionsTest-1917607968 None] Lock "cinder-quobyte-13a4ae8f-429d-4331-80d5-871f2c6c01a5" released by "delete_volume" :: held 0.624s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:28:07 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-f709d5cc-4af9-43be-b816-187f696720fc tempest-VolumesActionsTest-1917607968 None] Created reservations ['3356c0a9-a4d6-43eb-b0a9-a1d1308823ec', 'f8b7ab7f-e38b-4c4c-94d2-b5c96c579b09', 'f3c67eff-0b82-4c99-8b1c-6b5ac855b594', '1acd9ee2-d0de-48fc-8ca6-ff86fd5ed603'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:28:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f709d5cc-4af9-43be-b816-187f696720fc tempest-VolumesActionsTest-1917607968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:28:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f709d5cc-4af9-43be-b816-187f696720fc tempest-VolumesActionsTest-1917607968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:28:07 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f709d5cc-4af9-43be-b816-187f696720fc tempest-VolumesActionsTest-1917607968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:28:07 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f709d5cc-4af9-43be-b816-187f696720fc tempest-VolumesActionsTest-1917607968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:28:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f709d5cc-4af9-43be-b816-187f696720fc tempest-VolumesActionsTest-1917607968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:28:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f709d5cc-4af9-43be-b816-187f696720fc tempest-VolumesActionsTest-1917607968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:28:07 devstack sudo[105843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:28:07 devstack sudo[105843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:28:08 devstack sudo[105843]: pam_unix(sudo:session): session closed for user root Nov 04 12:28:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f709d5cc-4af9-43be-b816-187f696720fc tempest-VolumesActionsTest-1917607968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.230s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:28:08 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-f709d5cc-4af9-43be-b816-187f696720fc tempest-VolumesActionsTest-1917607968 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:28:08 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-f709d5cc-4af9-43be-b816-187f696720fc tempest-VolumesActionsTest-1917607968 None] Deleted volume successfully. Nov 04 12:28:08 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f709d5cc-4af9-43be-b816-187f696720fc tempest-VolumesActionsTest-1917607968 None] Lock "cinder-13a4ae8f-429d-4331-80d5-871f2c6c01a5-delete_volume" released by "delete_volume" :: held 1.070s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:28:08 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-1958513e-5e6f-474f-92be-d4af47f7d665 tempest-VolumesActionsTest-727782508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:28:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1958513e-5e6f-474f-92be-d4af47f7d665 tempest-VolumesActionsTest-727782508 None] Flow 'volume_create_manager' (90ecba20-f1fe-43a9-85b4-ecf4d6239352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:28:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1958513e-5e6f-474f-92be-d4af47f7d665 tempest-VolumesActionsTest-727782508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3e7c556-7cca-4d3f-8c32-9da872105770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:28:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1958513e-5e6f-474f-92be-d4af47f7d665 tempest-VolumesActionsTest-727782508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3e7c556-7cca-4d3f-8c32-9da872105770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:28:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1584247288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d4e15be-6907-4451-a975-542e3e1e3eb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a94c83563dc241f39a0ad7c290c7ffc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:28:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:28:09Z,use_quota=True,user_id='29a3156fdc7d48108b51ed9bb2f9474e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:28:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1958513e-5e6f-474f-92be-d4af47f7d665 tempest-VolumesActionsTest-727782508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11147a18-a023-4bd1-a13f-a95a670ac643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:28:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1958513e-5e6f-474f-92be-d4af47f7d665 tempest-VolumesActionsTest-727782508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11147a18-a023-4bd1-a13f-a95a670ac643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:28:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1958513e-5e6f-474f-92be-d4af47f7d665 tempest-VolumesActionsTest-727782508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58e3d5b7-3054-4e51-8d61-7a6205da7b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:28:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1958513e-5e6f-474f-92be-d4af47f7d665 tempest-VolumesActionsTest-727782508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58e3d5b7-3054-4e51-8d61-7a6205da7b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d4e15be-6907-4451-a975-542e3e1e3eb7', 'volume_name': 'volume-4d4e15be-6907-4451-a975-542e3e1e3eb7', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:28:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1958513e-5e6f-474f-92be-d4af47f7d665 tempest-VolumesActionsTest-727782508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f20ad3e-7868-4fad-9eae-0e39993c4cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:28:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1958513e-5e6f-474f-92be-d4af47f7d665 tempest-VolumesActionsTest-727782508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f20ad3e-7868-4fad-9eae-0e39993c4cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:28:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1958513e-5e6f-474f-92be-d4af47f7d665 tempest-VolumesActionsTest-727782508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (093b713f-8848-4c99-a4ae-f9867142a58f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:28:08 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-1958513e-5e6f-474f-92be-d4af47f7d665 tempest-VolumesActionsTest-727782508 None] Volume 4d4e15be-6907-4451-a975-542e3e1e3eb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d4e15be-6907-4451-a975-542e3e1e3eb7', 'volume_size': 1} Nov 04 12:28:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1958513e-5e6f-474f-92be-d4af47f7d665 tempest-VolumesActionsTest-727782508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:28:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1958513e-5e6f-474f-92be-d4af47f7d665 tempest-VolumesActionsTest-727782508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:28:08 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1958513e-5e6f-474f-92be-d4af47f7d665 tempest-VolumesActionsTest-727782508 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:28:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1584247288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d4e15be-6907-4451-a975-542e3e1e3eb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a94c83563dc241f39a0ad7c290c7ffc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:28:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:28:09Z,use_quota=True,user_id='29a3156fdc7d48108b51ed9bb2f9474e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:28:08 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-1958513e-5e6f-474f-92be-d4af47f7d665 tempest-VolumesActionsTest-727782508 None] Creating volume 4d4e15be-6907-4451-a975-542e3e1e3eb7 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:28:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1958513e-5e6f-474f-92be-d4af47f7d665 tempest-VolumesActionsTest-727782508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:28:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1958513e-5e6f-474f-92be-d4af47f7d665 tempest-VolumesActionsTest-727782508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:28:08 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1958513e-5e6f-474f-92be-d4af47f7d665 tempest-VolumesActionsTest-727782508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:28:08 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1958513e-5e6f-474f-92be-d4af47f7d665 tempest-VolumesActionsTest-727782508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:28:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1958513e-5e6f-474f-92be-d4af47f7d665 tempest-VolumesActionsTest-727782508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:28:08 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1958513e-5e6f-474f-92be-d4af47f7d665 tempest-VolumesActionsTest-727782508 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:28:08 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-1958513e-5e6f-474f-92be-d4af47f7d665 tempest-VolumesActionsTest-727782508 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:28:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1958513e-5e6f-474f-92be-d4af47f7d665 tempest-VolumesActionsTest-727782508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4d4e15be-6907-4451-a975-542e3e1e3eb7 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:28:08 devstack sudo[105846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4d4e15be-6907-4451-a975-542e3e1e3eb7 1073741824 Nov 04 12:28:08 devstack sudo[105846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:28:09 devstack sudo[105846]: pam_unix(sudo:session): session closed for user root Nov 04 12:28:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1958513e-5e6f-474f-92be-d4af47f7d665 tempest-VolumesActionsTest-727782508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4d4e15be-6907-4451-a975-542e3e1e3eb7 1073741824" returned: 0 in 0.388s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:28:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1958513e-5e6f-474f-92be-d4af47f7d665 tempest-VolumesActionsTest-727782508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4d4e15be-6907-4451-a975-542e3e1e3eb7 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:28:09 devstack sudo[105851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4d4e15be-6907-4451-a975-542e3e1e3eb7 Nov 04 12:28:09 devstack sudo[105851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:28:09 devstack sudo[105851]: pam_unix(sudo:session): session closed for user root Nov 04 12:28:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1958513e-5e6f-474f-92be-d4af47f7d665 tempest-VolumesActionsTest-727782508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4d4e15be-6907-4451-a975-542e3e1e3eb7" returned: 0 in 0.245s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:28:09 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1958513e-5e6f-474f-92be-d4af47f7d665 tempest-VolumesActionsTest-727782508 None] <== create_volume: return (681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:28:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1958513e-5e6f-474f-92be-d4af47f7d665 tempest-VolumesActionsTest-727782508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.683s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:28:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1958513e-5e6f-474f-92be-d4af47f7d665 tempest-VolumesActionsTest-727782508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (093b713f-8848-4c99-a4ae-f9867142a58f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d4e15be-6907-4451-a975-542e3e1e3eb7', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:28:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1958513e-5e6f-474f-92be-d4af47f7d665 tempest-VolumesActionsTest-727782508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60412f0b-feae-47ad-ac05-02b42c46c1ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:28:09 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-1958513e-5e6f-474f-92be-d4af47f7d665 tempest-VolumesActionsTest-727782508 None] Volume volume-4d4e15be-6907-4451-a975-542e3e1e3eb7 (4d4e15be-6907-4451-a975-542e3e1e3eb7): created successfully Nov 04 12:28:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1958513e-5e6f-474f-92be-d4af47f7d665 tempest-VolumesActionsTest-727782508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60412f0b-feae-47ad-ac05-02b42c46c1ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:28:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1958513e-5e6f-474f-92be-d4af47f7d665 tempest-VolumesActionsTest-727782508 None] Flow 'volume_create_manager' (90ecba20-f1fe-43a9-85b4-ecf4d6239352) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:28:09 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-1958513e-5e6f-474f-92be-d4af47f7d665 tempest-VolumesActionsTest-727782508 None] Created volume successfully. Nov 04 12:28:09 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-91c50626-9822-4efd-abf3-16fd52dd2cbf tempest-VolumesActionsTest-1917607968 None] Acquiring lock "cinder-4d4e15be-6907-4451-a975-542e3e1e3eb7-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:28:09 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-91c50626-9822-4efd-abf3-16fd52dd2cbf tempest-VolumesActionsTest-1917607968 None] Lock "cinder-4d4e15be-6907-4451-a975-542e3e1e3eb7-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:28:09 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-91c50626-9822-4efd-abf3-16fd52dd2cbf tempest-VolumesActionsTest-1917607968 None] Acquiring lock "cinder-quobyte-4d4e15be-6907-4451-a975-542e3e1e3eb7" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:28:09 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-91c50626-9822-4efd-abf3-16fd52dd2cbf tempest-VolumesActionsTest-1917607968 None] Lock "cinder-quobyte-4d4e15be-6907-4451-a975-542e3e1e3eb7" acquired by "delete_volume" :: waited 0.016s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:28:09 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb7fc43-4dd5-49f6-b9cf-a1d8c901efd8]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:28:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-91c50626-9822-4efd-abf3-16fd52dd2cbf tempest-VolumesActionsTest-1917607968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4d4e15be-6907-4451-a975-542e3e1e3eb7 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:28:09 devstack sudo[105855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4d4e15be-6907-4451-a975-542e3e1e3eb7 Nov 04 12:28:09 devstack sudo[105855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:28:10 devstack sudo[105855]: pam_unix(sudo:session): session closed for user root Nov 04 12:28:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-91c50626-9822-4efd-abf3-16fd52dd2cbf tempest-VolumesActionsTest-1917607968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4d4e15be-6907-4451-a975-542e3e1e3eb7" returned: 0 in 0.340s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:28:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-91c50626-9822-4efd-abf3-16fd52dd2cbf tempest-VolumesActionsTest-1917607968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4d4e15be-6907-4451-a975-542e3e1e3eb7 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:28:10 devstack sudo[105860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4d4e15be-6907-4451-a975-542e3e1e3eb7 Nov 04 12:28:10 devstack sudo[105860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:28:10 devstack sudo[105860]: pam_unix(sudo:session): session closed for user root Nov 04 12:28:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-91c50626-9822-4efd-abf3-16fd52dd2cbf tempest-VolumesActionsTest-1917607968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4d4e15be-6907-4451-a975-542e3e1e3eb7" returned: 0 in 0.240s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:28:10 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-91c50626-9822-4efd-abf3-16fd52dd2cbf tempest-VolumesActionsTest-1917607968 None] Lock "cinder-quobyte-4d4e15be-6907-4451-a975-542e3e1e3eb7" released by "delete_volume" :: held 0.620s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:28:10 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-91c50626-9822-4efd-abf3-16fd52dd2cbf tempest-VolumesActionsTest-1917607968 None] Created reservations ['6b346160-21f0-4340-ae3b-82a6c1aa03fc', '13accac1-845c-4bc4-93c2-4ae72e8b5044', '09939ba9-6762-434e-85f3-b5f88804a324', 'fc7c4238-86f1-4b7d-96a0-11e9faa9c12d'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:28:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-91c50626-9822-4efd-abf3-16fd52dd2cbf tempest-VolumesActionsTest-1917607968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:28:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-91c50626-9822-4efd-abf3-16fd52dd2cbf tempest-VolumesActionsTest-1917607968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:28:10 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-91c50626-9822-4efd-abf3-16fd52dd2cbf tempest-VolumesActionsTest-1917607968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:28:10 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-91c50626-9822-4efd-abf3-16fd52dd2cbf tempest-VolumesActionsTest-1917607968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:28:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-91c50626-9822-4efd-abf3-16fd52dd2cbf tempest-VolumesActionsTest-1917607968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:28:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-91c50626-9822-4efd-abf3-16fd52dd2cbf tempest-VolumesActionsTest-1917607968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:28:10 devstack sudo[105863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:28:10 devstack sudo[105863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:28:10 devstack sudo[105863]: pam_unix(sudo:session): session closed for user root Nov 04 12:28:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-91c50626-9822-4efd-abf3-16fd52dd2cbf tempest-VolumesActionsTest-1917607968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.236s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:28:10 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-91c50626-9822-4efd-abf3-16fd52dd2cbf tempest-VolumesActionsTest-1917607968 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:28:10 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-91c50626-9822-4efd-abf3-16fd52dd2cbf tempest-VolumesActionsTest-1917607968 None] Deleted volume successfully. Nov 04 12:28:10 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-91c50626-9822-4efd-abf3-16fd52dd2cbf tempest-VolumesActionsTest-1917607968 None] Lock "cinder-4d4e15be-6907-4451-a975-542e3e1e3eb7-delete_volume" released by "delete_volume" :: held 1.048s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:28:11 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-f09ee65b-6c99-418f-86f9-c500acd1f79a tempest-VolumesActionsTest-727782508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:28:11 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f09ee65b-6c99-418f-86f9-c500acd1f79a tempest-VolumesActionsTest-727782508 None] Flow 'volume_create_manager' (d3371160-3880-4371-a384-0e62082eb63c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:28:11 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f09ee65b-6c99-418f-86f9-c500acd1f79a tempest-VolumesActionsTest-727782508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5000ab83-7fab-4293-8d05-48ba2ffccd80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:28:11 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f09ee65b-6c99-418f-86f9-c500acd1f79a tempest-VolumesActionsTest-727782508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5000ab83-7fab-4293-8d05-48ba2ffccd80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:28:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2104963597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dea80f80-06ea-4559-9d4f-04778e7e6cbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a94c83563dc241f39a0ad7c290c7ffc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:28:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:28:11Z,use_quota=True,user_id='29a3156fdc7d48108b51ed9bb2f9474e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:28:11 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f09ee65b-6c99-418f-86f9-c500acd1f79a tempest-VolumesActionsTest-727782508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57a33ce5-44d1-4c7b-b1f5-bea50d89952f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:28:11 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f09ee65b-6c99-418f-86f9-c500acd1f79a tempest-VolumesActionsTest-727782508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57a33ce5-44d1-4c7b-b1f5-bea50d89952f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:28:11 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f09ee65b-6c99-418f-86f9-c500acd1f79a tempest-VolumesActionsTest-727782508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d2ec5f8-0c6f-401e-b1ee-03075de6ae6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:28:11 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f09ee65b-6c99-418f-86f9-c500acd1f79a tempest-VolumesActionsTest-727782508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d2ec5f8-0c6f-401e-b1ee-03075de6ae6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dea80f80-06ea-4559-9d4f-04778e7e6cbc', 'volume_name': 'volume-dea80f80-06ea-4559-9d4f-04778e7e6cbc', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:28:11 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f09ee65b-6c99-418f-86f9-c500acd1f79a tempest-VolumesActionsTest-727782508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c6997ea-7ec4-409b-82b4-5b180a10612b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:28:11 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f09ee65b-6c99-418f-86f9-c500acd1f79a tempest-VolumesActionsTest-727782508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c6997ea-7ec4-409b-82b4-5b180a10612b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:28:11 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f09ee65b-6c99-418f-86f9-c500acd1f79a tempest-VolumesActionsTest-727782508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66401a44-ab31-4937-bfb0-47601e216aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:28:11 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-f09ee65b-6c99-418f-86f9-c500acd1f79a tempest-VolumesActionsTest-727782508 None] Volume dea80f80-06ea-4559-9d4f-04778e7e6cbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dea80f80-06ea-4559-9d4f-04778e7e6cbc', 'volume_size': 1} Nov 04 12:28:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f09ee65b-6c99-418f-86f9-c500acd1f79a tempest-VolumesActionsTest-727782508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:28:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f09ee65b-6c99-418f-86f9-c500acd1f79a tempest-VolumesActionsTest-727782508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:28:11 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f09ee65b-6c99-418f-86f9-c500acd1f79a tempest-VolumesActionsTest-727782508 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:28:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2104963597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dea80f80-06ea-4559-9d4f-04778e7e6cbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a94c83563dc241f39a0ad7c290c7ffc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:28:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:28:11Z,use_quota=True,user_id='29a3156fdc7d48108b51ed9bb2f9474e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:28:11 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-f09ee65b-6c99-418f-86f9-c500acd1f79a tempest-VolumesActionsTest-727782508 None] Creating volume dea80f80-06ea-4559-9d4f-04778e7e6cbc {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:28:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f09ee65b-6c99-418f-86f9-c500acd1f79a tempest-VolumesActionsTest-727782508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:28:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f09ee65b-6c99-418f-86f9-c500acd1f79a tempest-VolumesActionsTest-727782508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:28:11 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f09ee65b-6c99-418f-86f9-c500acd1f79a tempest-VolumesActionsTest-727782508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:28:11 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f09ee65b-6c99-418f-86f9-c500acd1f79a tempest-VolumesActionsTest-727782508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:28:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f09ee65b-6c99-418f-86f9-c500acd1f79a tempest-VolumesActionsTest-727782508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:28:11 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f09ee65b-6c99-418f-86f9-c500acd1f79a tempest-VolumesActionsTest-727782508 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:28:11 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-f09ee65b-6c99-418f-86f9-c500acd1f79a tempest-VolumesActionsTest-727782508 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:28:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f09ee65b-6c99-418f-86f9-c500acd1f79a tempest-VolumesActionsTest-727782508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-dea80f80-06ea-4559-9d4f-04778e7e6cbc 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:28:11 devstack sudo[105866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-dea80f80-06ea-4559-9d4f-04778e7e6cbc 1073741824 Nov 04 12:28:11 devstack sudo[105866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:28:11 devstack sudo[105866]: pam_unix(sudo:session): session closed for user root Nov 04 12:28:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f09ee65b-6c99-418f-86f9-c500acd1f79a tempest-VolumesActionsTest-727782508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-dea80f80-06ea-4559-9d4f-04778e7e6cbc 1073741824" returned: 0 in 0.427s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:28:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f09ee65b-6c99-418f-86f9-c500acd1f79a tempest-VolumesActionsTest-727782508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-dea80f80-06ea-4559-9d4f-04778e7e6cbc {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:28:11 devstack sudo[105872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-dea80f80-06ea-4559-9d4f-04778e7e6cbc Nov 04 12:28:11 devstack sudo[105872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:28:12 devstack sudo[105872]: pam_unix(sudo:session): session closed for user root Nov 04 12:28:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f09ee65b-6c99-418f-86f9-c500acd1f79a tempest-VolumesActionsTest-727782508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-dea80f80-06ea-4559-9d4f-04778e7e6cbc" returned: 0 in 0.229s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:28:12 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f09ee65b-6c99-418f-86f9-c500acd1f79a tempest-VolumesActionsTest-727782508 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:28:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f09ee65b-6c99-418f-86f9-c500acd1f79a tempest-VolumesActionsTest-727782508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:28:12 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f09ee65b-6c99-418f-86f9-c500acd1f79a tempest-VolumesActionsTest-727782508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66401a44-ab31-4937-bfb0-47601e216aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dea80f80-06ea-4559-9d4f-04778e7e6cbc', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:28:12 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f09ee65b-6c99-418f-86f9-c500acd1f79a tempest-VolumesActionsTest-727782508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (490766b3-7292-4e6c-9649-58afa5ed78e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:28:12 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-f09ee65b-6c99-418f-86f9-c500acd1f79a tempest-VolumesActionsTest-727782508 None] Volume volume-dea80f80-06ea-4559-9d4f-04778e7e6cbc (dea80f80-06ea-4559-9d4f-04778e7e6cbc): created successfully Nov 04 12:28:12 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f09ee65b-6c99-418f-86f9-c500acd1f79a tempest-VolumesActionsTest-727782508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (490766b3-7292-4e6c-9649-58afa5ed78e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:28:12 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f09ee65b-6c99-418f-86f9-c500acd1f79a tempest-VolumesActionsTest-727782508 None] Flow 'volume_create_manager' (d3371160-3880-4371-a384-0e62082eb63c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:28:12 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-f09ee65b-6c99-418f-86f9-c500acd1f79a tempest-VolumesActionsTest-727782508 None] Created volume successfully. Nov 04 12:28:12 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-8bc7df5f-b6e6-41ad-92a3-d4879c9884bb tempest-VolumesActionsTest-1917607968 None] Acquiring lock "cinder-dea80f80-06ea-4559-9d4f-04778e7e6cbc-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:28:12 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-8bc7df5f-b6e6-41ad-92a3-d4879c9884bb tempest-VolumesActionsTest-1917607968 None] Lock "cinder-dea80f80-06ea-4559-9d4f-04778e7e6cbc-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:28:12 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-8bc7df5f-b6e6-41ad-92a3-d4879c9884bb tempest-VolumesActionsTest-1917607968 None] Acquiring lock "cinder-quobyte-dea80f80-06ea-4559-9d4f-04778e7e6cbc" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:28:12 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-8bc7df5f-b6e6-41ad-92a3-d4879c9884bb tempest-VolumesActionsTest-1917607968 None] Lock "cinder-quobyte-dea80f80-06ea-4559-9d4f-04778e7e6cbc" acquired by "delete_volume" :: waited 0.014s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:28:12 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f80e8ec-eb2c-41ed-91d1-bea1ce516ce0]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:28:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8bc7df5f-b6e6-41ad-92a3-d4879c9884bb tempest-VolumesActionsTest-1917607968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-dea80f80-06ea-4559-9d4f-04778e7e6cbc {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:28:12 devstack sudo[105875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-dea80f80-06ea-4559-9d4f-04778e7e6cbc Nov 04 12:28:12 devstack sudo[105875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:28:12 devstack sudo[105875]: pam_unix(sudo:session): session closed for user root Nov 04 12:28:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8bc7df5f-b6e6-41ad-92a3-d4879c9884bb tempest-VolumesActionsTest-1917607968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-dea80f80-06ea-4559-9d4f-04778e7e6cbc" returned: 0 in 0.373s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:28:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8bc7df5f-b6e6-41ad-92a3-d4879c9884bb tempest-VolumesActionsTest-1917607968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-dea80f80-06ea-4559-9d4f-04778e7e6cbc {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:28:13 devstack sudo[105880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-dea80f80-06ea-4559-9d4f-04778e7e6cbc Nov 04 12:28:13 devstack sudo[105880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:28:13 devstack sudo[105880]: pam_unix(sudo:session): session closed for user root Nov 04 12:28:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8bc7df5f-b6e6-41ad-92a3-d4879c9884bb tempest-VolumesActionsTest-1917607968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-dea80f80-06ea-4559-9d4f-04778e7e6cbc" returned: 0 in 0.252s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:28:13 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-8bc7df5f-b6e6-41ad-92a3-d4879c9884bb tempest-VolumesActionsTest-1917607968 None] Lock "cinder-quobyte-dea80f80-06ea-4559-9d4f-04778e7e6cbc" released by "delete_volume" :: held 0.667s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:28:13 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-8bc7df5f-b6e6-41ad-92a3-d4879c9884bb tempest-VolumesActionsTest-1917607968 None] Created reservations ['606b890b-4bcd-4c4b-9334-8b73090134ef', '70ef2594-2fe4-4e3f-ab20-d49433cedf37', 'a6f00c63-194d-4e3c-9ba0-a7c6a2fdf709', 'da28dba3-9c6e-453e-945a-70d4d9dcebc3'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:28:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-8bc7df5f-b6e6-41ad-92a3-d4879c9884bb tempest-VolumesActionsTest-1917607968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:28:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-8bc7df5f-b6e6-41ad-92a3-d4879c9884bb tempest-VolumesActionsTest-1917607968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:28:13 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-8bc7df5f-b6e6-41ad-92a3-d4879c9884bb tempest-VolumesActionsTest-1917607968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:28:13 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-8bc7df5f-b6e6-41ad-92a3-d4879c9884bb tempest-VolumesActionsTest-1917607968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:28:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-8bc7df5f-b6e6-41ad-92a3-d4879c9884bb tempest-VolumesActionsTest-1917607968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:28:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8bc7df5f-b6e6-41ad-92a3-d4879c9884bb tempest-VolumesActionsTest-1917607968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:28:13 devstack sudo[105884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:28:13 devstack sudo[105884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:28:13 devstack sudo[105884]: pam_unix(sudo:session): session closed for user root Nov 04 12:28:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8bc7df5f-b6e6-41ad-92a3-d4879c9884bb tempest-VolumesActionsTest-1917607968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.237s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:28:13 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-8bc7df5f-b6e6-41ad-92a3-d4879c9884bb tempest-VolumesActionsTest-1917607968 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:28:13 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-8bc7df5f-b6e6-41ad-92a3-d4879c9884bb tempest-VolumesActionsTest-1917607968 None] Deleted volume successfully. Nov 04 12:28:13 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-8bc7df5f-b6e6-41ad-92a3-d4879c9884bb tempest-VolumesActionsTest-1917607968 None] Lock "cinder-dea80f80-06ea-4559-9d4f-04778e7e6cbc-delete_volume" released by "delete_volume" :: held 1.090s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:28:14 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-64561ccd-abfd-46dc-85d9-d01b4ef18c49 tempest-VolumesActionsTest-727782508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:28:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-64561ccd-abfd-46dc-85d9-d01b4ef18c49 tempest-VolumesActionsTest-727782508 None] Flow 'volume_create_manager' (2e80b36b-03df-4563-bb33-32459bcaf97e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:28:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-64561ccd-abfd-46dc-85d9-d01b4ef18c49 tempest-VolumesActionsTest-727782508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13ed6fcf-6e1e-4ab2-88e3-f5f53798f939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:28:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-64561ccd-abfd-46dc-85d9-d01b4ef18c49 tempest-VolumesActionsTest-727782508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13ed6fcf-6e1e-4ab2-88e3-f5f53798f939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:28:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1418910100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbed49c2-124c-45d0-bd5d-d82b99c49225,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a94c83563dc241f39a0ad7c290c7ffc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:28:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:28:14Z,use_quota=True,user_id='29a3156fdc7d48108b51ed9bb2f9474e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:28:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-64561ccd-abfd-46dc-85d9-d01b4ef18c49 tempest-VolumesActionsTest-727782508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ed88238-b462-4a1f-be78-a6c6ddfb2823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:28:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-64561ccd-abfd-46dc-85d9-d01b4ef18c49 tempest-VolumesActionsTest-727782508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ed88238-b462-4a1f-be78-a6c6ddfb2823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:28:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-64561ccd-abfd-46dc-85d9-d01b4ef18c49 tempest-VolumesActionsTest-727782508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a28f1063-3f6a-4467-b16e-053cfc139ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:28:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-64561ccd-abfd-46dc-85d9-d01b4ef18c49 tempest-VolumesActionsTest-727782508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a28f1063-3f6a-4467-b16e-053cfc139ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbed49c2-124c-45d0-bd5d-d82b99c49225', 'volume_name': 'volume-cbed49c2-124c-45d0-bd5d-d82b99c49225', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:28:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-64561ccd-abfd-46dc-85d9-d01b4ef18c49 tempest-VolumesActionsTest-727782508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a940258-1413-4a59-a11a-f3a818c8e4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:28:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-64561ccd-abfd-46dc-85d9-d01b4ef18c49 tempest-VolumesActionsTest-727782508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a940258-1413-4a59-a11a-f3a818c8e4ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:28:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-64561ccd-abfd-46dc-85d9-d01b4ef18c49 tempest-VolumesActionsTest-727782508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46692f0c-35d5-45ad-a282-51130d7f25bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:28:14 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-64561ccd-abfd-46dc-85d9-d01b4ef18c49 tempest-VolumesActionsTest-727782508 None] Volume cbed49c2-124c-45d0-bd5d-d82b99c49225: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbed49c2-124c-45d0-bd5d-d82b99c49225', 'volume_size': 1} Nov 04 12:28:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-64561ccd-abfd-46dc-85d9-d01b4ef18c49 tempest-VolumesActionsTest-727782508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:28:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-64561ccd-abfd-46dc-85d9-d01b4ef18c49 tempest-VolumesActionsTest-727782508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:28:14 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-64561ccd-abfd-46dc-85d9-d01b4ef18c49 tempest-VolumesActionsTest-727782508 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:28:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1418910100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbed49c2-124c-45d0-bd5d-d82b99c49225,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a94c83563dc241f39a0ad7c290c7ffc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:28:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:28:14Z,use_quota=True,user_id='29a3156fdc7d48108b51ed9bb2f9474e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:28:14 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-64561ccd-abfd-46dc-85d9-d01b4ef18c49 tempest-VolumesActionsTest-727782508 None] Creating volume cbed49c2-124c-45d0-bd5d-d82b99c49225 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:28:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-64561ccd-abfd-46dc-85d9-d01b4ef18c49 tempest-VolumesActionsTest-727782508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:28:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-64561ccd-abfd-46dc-85d9-d01b4ef18c49 tempest-VolumesActionsTest-727782508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:28:14 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-64561ccd-abfd-46dc-85d9-d01b4ef18c49 tempest-VolumesActionsTest-727782508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:28:14 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-64561ccd-abfd-46dc-85d9-d01b4ef18c49 tempest-VolumesActionsTest-727782508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:28:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-64561ccd-abfd-46dc-85d9-d01b4ef18c49 tempest-VolumesActionsTest-727782508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:28:14 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-64561ccd-abfd-46dc-85d9-d01b4ef18c49 tempest-VolumesActionsTest-727782508 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:28:14 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-64561ccd-abfd-46dc-85d9-d01b4ef18c49 tempest-VolumesActionsTest-727782508 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:28:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-64561ccd-abfd-46dc-85d9-d01b4ef18c49 tempest-VolumesActionsTest-727782508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cbed49c2-124c-45d0-bd5d-d82b99c49225 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:28:14 devstack sudo[105887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cbed49c2-124c-45d0-bd5d-d82b99c49225 1073741824 Nov 04 12:28:14 devstack sudo[105887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:28:14 devstack sudo[105887]: pam_unix(sudo:session): session closed for user root Nov 04 12:28:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-64561ccd-abfd-46dc-85d9-d01b4ef18c49 tempest-VolumesActionsTest-727782508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cbed49c2-124c-45d0-bd5d-d82b99c49225 1073741824" returned: 0 in 0.392s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:28:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-64561ccd-abfd-46dc-85d9-d01b4ef18c49 tempest-VolumesActionsTest-727782508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cbed49c2-124c-45d0-bd5d-d82b99c49225 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:28:14 devstack sudo[105893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cbed49c2-124c-45d0-bd5d-d82b99c49225 Nov 04 12:28:14 devstack sudo[105893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:28:14 devstack sudo[105893]: pam_unix(sudo:session): session closed for user root Nov 04 12:28:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-64561ccd-abfd-46dc-85d9-d01b4ef18c49 tempest-VolumesActionsTest-727782508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cbed49c2-124c-45d0-bd5d-d82b99c49225" returned: 0 in 0.251s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:28:14 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-64561ccd-abfd-46dc-85d9-d01b4ef18c49 tempest-VolumesActionsTest-727782508 None] <== create_volume: return (681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:28:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-64561ccd-abfd-46dc-85d9-d01b4ef18c49 tempest-VolumesActionsTest-727782508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:28:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-64561ccd-abfd-46dc-85d9-d01b4ef18c49 tempest-VolumesActionsTest-727782508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46692f0c-35d5-45ad-a282-51130d7f25bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbed49c2-124c-45d0-bd5d-d82b99c49225', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:28:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-64561ccd-abfd-46dc-85d9-d01b4ef18c49 tempest-VolumesActionsTest-727782508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51b3052f-2651-4901-9d4e-5932be4e8899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:28:14 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-64561ccd-abfd-46dc-85d9-d01b4ef18c49 tempest-VolumesActionsTest-727782508 None] Volume volume-cbed49c2-124c-45d0-bd5d-d82b99c49225 (cbed49c2-124c-45d0-bd5d-d82b99c49225): created successfully Nov 04 12:28:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-64561ccd-abfd-46dc-85d9-d01b4ef18c49 tempest-VolumesActionsTest-727782508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51b3052f-2651-4901-9d4e-5932be4e8899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:28:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-64561ccd-abfd-46dc-85d9-d01b4ef18c49 tempest-VolumesActionsTest-727782508 None] Flow 'volume_create_manager' (2e80b36b-03df-4563-bb33-32459bcaf97e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:28:14 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-64561ccd-abfd-46dc-85d9-d01b4ef18c49 tempest-VolumesActionsTest-727782508 None] Created volume successfully. Nov 04 12:28:15 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3f6c7d97-54f2-4051-abca-6d7f19d9b8ba tempest-VolumesActionsTest-727782508 None] Acquiring lock "cinder-cbed49c2-124c-45d0-bd5d-d82b99c49225-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:28:15 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3f6c7d97-54f2-4051-abca-6d7f19d9b8ba tempest-VolumesActionsTest-727782508 None] Lock "cinder-cbed49c2-124c-45d0-bd5d-d82b99c49225-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:28:15 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3f6c7d97-54f2-4051-abca-6d7f19d9b8ba tempest-VolumesActionsTest-727782508 None] Acquiring lock "cinder-quobyte-cbed49c2-124c-45d0-bd5d-d82b99c49225" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:28:15 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3f6c7d97-54f2-4051-abca-6d7f19d9b8ba tempest-VolumesActionsTest-727782508 None] Lock "cinder-quobyte-cbed49c2-124c-45d0-bd5d-d82b99c49225" acquired by "delete_volume" :: waited 0.013s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:28:15 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4385a24c-0c12-49bb-ba06-d958e6d7f45a]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:28:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3f6c7d97-54f2-4051-abca-6d7f19d9b8ba tempest-VolumesActionsTest-727782508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cbed49c2-124c-45d0-bd5d-d82b99c49225 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:28:15 devstack sudo[105897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cbed49c2-124c-45d0-bd5d-d82b99c49225 Nov 04 12:28:15 devstack sudo[105897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:28:16 devstack sudo[105897]: pam_unix(sudo:session): session closed for user root Nov 04 12:28:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3f6c7d97-54f2-4051-abca-6d7f19d9b8ba tempest-VolumesActionsTest-727782508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cbed49c2-124c-45d0-bd5d-d82b99c49225" returned: 0 in 0.341s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:28:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3f6c7d97-54f2-4051-abca-6d7f19d9b8ba tempest-VolumesActionsTest-727782508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cbed49c2-124c-45d0-bd5d-d82b99c49225 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:28:16 devstack sudo[105902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cbed49c2-124c-45d0-bd5d-d82b99c49225 Nov 04 12:28:16 devstack sudo[105902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:28:16 devstack sudo[105902]: pam_unix(sudo:session): session closed for user root Nov 04 12:28:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3f6c7d97-54f2-4051-abca-6d7f19d9b8ba tempest-VolumesActionsTest-727782508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cbed49c2-124c-45d0-bd5d-d82b99c49225" returned: 0 in 0.248s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:28:16 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3f6c7d97-54f2-4051-abca-6d7f19d9b8ba tempest-VolumesActionsTest-727782508 None] Lock "cinder-quobyte-cbed49c2-124c-45d0-bd5d-d82b99c49225" released by "delete_volume" :: held 0.626s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:28:16 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-3f6c7d97-54f2-4051-abca-6d7f19d9b8ba tempest-VolumesActionsTest-727782508 None] Created reservations ['2ae90da7-a44b-442d-9d9b-6c2be4af98d3', '29d2ce15-4867-48e1-820c-f48e4c83a374', 'c1aac5ff-136a-4620-bebc-a891fc4f3309', '7fb6c93a-b6a9-4fc8-9d52-c85fecf6271a'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:28:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3f6c7d97-54f2-4051-abca-6d7f19d9b8ba tempest-VolumesActionsTest-727782508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:28:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3f6c7d97-54f2-4051-abca-6d7f19d9b8ba tempest-VolumesActionsTest-727782508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:28:16 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3f6c7d97-54f2-4051-abca-6d7f19d9b8ba tempest-VolumesActionsTest-727782508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:28:16 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3f6c7d97-54f2-4051-abca-6d7f19d9b8ba tempest-VolumesActionsTest-727782508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:28:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3f6c7d97-54f2-4051-abca-6d7f19d9b8ba tempest-VolumesActionsTest-727782508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:28:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3f6c7d97-54f2-4051-abca-6d7f19d9b8ba tempest-VolumesActionsTest-727782508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:28:16 devstack sudo[105905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:28:16 devstack sudo[105905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:28:16 devstack sudo[105905]: pam_unix(sudo:session): session closed for user root Nov 04 12:28:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3f6c7d97-54f2-4051-abca-6d7f19d9b8ba tempest-VolumesActionsTest-727782508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.243s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:28:16 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-3f6c7d97-54f2-4051-abca-6d7f19d9b8ba tempest-VolumesActionsTest-727782508 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:28:16 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-3f6c7d97-54f2-4051-abca-6d7f19d9b8ba tempest-VolumesActionsTest-727782508 None] Deleted volume successfully. Nov 04 12:28:16 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3f6c7d97-54f2-4051-abca-6d7f19d9b8ba tempest-VolumesActionsTest-727782508 None] Lock "cinder-cbed49c2-124c-45d0-bd5d-d82b99c49225-delete_volume" released by "delete_volume" :: held 1.062s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:28:26 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=47,cinder:UPDATE=75,cinder:INSERT=18,cinder:DELETE=5 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 12:28:26 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:UPDATE=64,cinder:SELECT=52,cinder:DELETE=7,cinder:INSERT=14 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 12:28:28 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-1406d024-f444-446b-8c85-968976755211 tempest-VolumesDeleteCascade-1812474022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:28:28 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1406d024-f444-446b-8c85-968976755211 tempest-VolumesDeleteCascade-1812474022 None] Flow 'volume_create_manager' (0126e383-f00f-498d-a386-8f6d153253cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:28:28 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1406d024-f444-446b-8c85-968976755211 tempest-VolumesDeleteCascade-1812474022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bf2cb4b-44e0-46fc-a9c5-42d82228ad49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:28:28 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1406d024-f444-446b-8c85-968976755211 tempest-VolumesDeleteCascade-1812474022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bf2cb4b-44e0-46fc-a9c5-42d82228ad49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:28:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-219897950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf3800b8-8343-4957-84f7-96687ac1618c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38eb51497afd4ac98e84c4a7df7ce1cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:28:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:28:29Z,use_quota=True,user_id='ede70ead855c4a7dab4c93db65794476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:28:28 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1406d024-f444-446b-8c85-968976755211 tempest-VolumesDeleteCascade-1812474022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54baeaa0-cea0-435e-88f1-ea3865b61faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:28:28 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1406d024-f444-446b-8c85-968976755211 tempest-VolumesDeleteCascade-1812474022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54baeaa0-cea0-435e-88f1-ea3865b61faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:28:28 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1406d024-f444-446b-8c85-968976755211 tempest-VolumesDeleteCascade-1812474022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90ff56e3-33e9-4d8d-ab3b-0e97c12ae3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:28:28 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1406d024-f444-446b-8c85-968976755211 tempest-VolumesDeleteCascade-1812474022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90ff56e3-33e9-4d8d-ab3b-0e97c12ae3e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf3800b8-8343-4957-84f7-96687ac1618c', 'volume_name': 'volume-cf3800b8-8343-4957-84f7-96687ac1618c', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:28:28 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1406d024-f444-446b-8c85-968976755211 tempest-VolumesDeleteCascade-1812474022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3740d51-d75c-4d9b-9d9a-f3de1d7ac514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:28:28 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1406d024-f444-446b-8c85-968976755211 tempest-VolumesDeleteCascade-1812474022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3740d51-d75c-4d9b-9d9a-f3de1d7ac514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:28:28 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1406d024-f444-446b-8c85-968976755211 tempest-VolumesDeleteCascade-1812474022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19db3e2c-26ea-4d42-b03b-7aad892defbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:28:28 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-1406d024-f444-446b-8c85-968976755211 tempest-VolumesDeleteCascade-1812474022 None] Volume cf3800b8-8343-4957-84f7-96687ac1618c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf3800b8-8343-4957-84f7-96687ac1618c', 'volume_size': 1} Nov 04 12:28:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1406d024-f444-446b-8c85-968976755211 tempest-VolumesDeleteCascade-1812474022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:28:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1406d024-f444-446b-8c85-968976755211 tempest-VolumesDeleteCascade-1812474022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:28:28 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1406d024-f444-446b-8c85-968976755211 tempest-VolumesDeleteCascade-1812474022 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:28:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-219897950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf3800b8-8343-4957-84f7-96687ac1618c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38eb51497afd4ac98e84c4a7df7ce1cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:28:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:28:29Z,use_quota=True,user_id='ede70ead855c4a7dab4c93db65794476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:28:28 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-1406d024-f444-446b-8c85-968976755211 tempest-VolumesDeleteCascade-1812474022 None] Creating volume cf3800b8-8343-4957-84f7-96687ac1618c {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:28:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1406d024-f444-446b-8c85-968976755211 tempest-VolumesDeleteCascade-1812474022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:28:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1406d024-f444-446b-8c85-968976755211 tempest-VolumesDeleteCascade-1812474022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:28:28 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1406d024-f444-446b-8c85-968976755211 tempest-VolumesDeleteCascade-1812474022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:28:28 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1406d024-f444-446b-8c85-968976755211 tempest-VolumesDeleteCascade-1812474022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:28:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1406d024-f444-446b-8c85-968976755211 tempest-VolumesDeleteCascade-1812474022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:28:28 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1406d024-f444-446b-8c85-968976755211 tempest-VolumesDeleteCascade-1812474022 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:28:28 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-1406d024-f444-446b-8c85-968976755211 tempest-VolumesDeleteCascade-1812474022 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:28:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1406d024-f444-446b-8c85-968976755211 tempest-VolumesDeleteCascade-1812474022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf3800b8-8343-4957-84f7-96687ac1618c 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:28:28 devstack sudo[105922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf3800b8-8343-4957-84f7-96687ac1618c 1073741824 Nov 04 12:28:28 devstack sudo[105922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:28:29 devstack sudo[105922]: pam_unix(sudo:session): session closed for user root Nov 04 12:28:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1406d024-f444-446b-8c85-968976755211 tempest-VolumesDeleteCascade-1812474022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf3800b8-8343-4957-84f7-96687ac1618c 1073741824" returned: 0 in 0.400s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:28:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1406d024-f444-446b-8c85-968976755211 tempest-VolumesDeleteCascade-1812474022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf3800b8-8343-4957-84f7-96687ac1618c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:28:29 devstack sudo[105927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf3800b8-8343-4957-84f7-96687ac1618c Nov 04 12:28:29 devstack sudo[105927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:28:29 devstack sudo[105927]: pam_unix(sudo:session): session closed for user root Nov 04 12:28:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1406d024-f444-446b-8c85-968976755211 tempest-VolumesDeleteCascade-1812474022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf3800b8-8343-4957-84f7-96687ac1618c" returned: 0 in 0.232s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:28:29 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1406d024-f444-446b-8c85-968976755211 tempest-VolumesDeleteCascade-1812474022 None] <== create_volume: return (669ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:28:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1406d024-f444-446b-8c85-968976755211 tempest-VolumesDeleteCascade-1812474022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.672s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:28:29 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1406d024-f444-446b-8c85-968976755211 tempest-VolumesDeleteCascade-1812474022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19db3e2c-26ea-4d42-b03b-7aad892defbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf3800b8-8343-4957-84f7-96687ac1618c', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:28:29 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1406d024-f444-446b-8c85-968976755211 tempest-VolumesDeleteCascade-1812474022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeb7a1f4-1f71-45c6-ba00-31953faa416a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:28:29 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-1406d024-f444-446b-8c85-968976755211 tempest-VolumesDeleteCascade-1812474022 None] Volume volume-cf3800b8-8343-4957-84f7-96687ac1618c (cf3800b8-8343-4957-84f7-96687ac1618c): created successfully Nov 04 12:28:29 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1406d024-f444-446b-8c85-968976755211 tempest-VolumesDeleteCascade-1812474022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeb7a1f4-1f71-45c6-ba00-31953faa416a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:28:29 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1406d024-f444-446b-8c85-968976755211 tempest-VolumesDeleteCascade-1812474022 None] Flow 'volume_create_manager' (0126e383-f00f-498d-a386-8f6d153253cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:28:29 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-1406d024-f444-446b-8c85-968976755211 tempest-VolumesDeleteCascade-1812474022 None] Created volume successfully. Nov 04 12:28:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ddcba27d-bdc6-4a16-9cf7-e3150743cee9 tempest-VolumesDeleteCascade-1812474022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:28:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ddcba27d-bdc6-4a16-9cf7-e3150743cee9 tempest-VolumesDeleteCascade-1812474022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:28:29 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-ddcba27d-bdc6-4a16-9cf7-e3150743cee9 tempest-VolumesDeleteCascade-1812474022 None] Creating offline snapshot 8da06398-4d4f-4754-9844-52a30e27d4ef of volume cf3800b8-8343-4957-84f7-96687ac1618c {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 12:28:29 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a724c0cd-8c3b-4f77-bc82-640425eb9a81]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:28:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ddcba27d-bdc6-4a16-9cf7-e3150743cee9 tempest-VolumesDeleteCascade-1812474022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf3800b8-8343-4957-84f7-96687ac1618c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:28:30 devstack sudo[105930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf3800b8-8343-4957-84f7-96687ac1618c Nov 04 12:28:30 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:28:30 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root Nov 04 12:28:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ddcba27d-bdc6-4a16-9cf7-e3150743cee9 tempest-VolumesDeleteCascade-1812474022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf3800b8-8343-4957-84f7-96687ac1618c" returned: 0 in 0.346s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:28:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ddcba27d-bdc6-4a16-9cf7-e3150743cee9 tempest-VolumesDeleteCascade-1812474022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf3800b8-8343-4957-84f7-96687ac1618c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf3800b8-8343-4957-84f7-96687ac1618c.8da06398-4d4f-4754-9844-52a30e27d4ef 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:28:30 devstack sudo[105936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf3800b8-8343-4957-84f7-96687ac1618c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf3800b8-8343-4957-84f7-96687ac1618c.8da06398-4d4f-4754-9844-52a30e27d4ef 1G Nov 04 12:28:30 devstack sudo[105936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:28:30 devstack sudo[105936]: pam_unix(sudo:session): session closed for user root Nov 04 12:28:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ddcba27d-bdc6-4a16-9cf7-e3150743cee9 tempest-VolumesDeleteCascade-1812474022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf3800b8-8343-4957-84f7-96687ac1618c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf3800b8-8343-4957-84f7-96687ac1618c.8da06398-4d4f-4754-9844-52a30e27d4ef 1G" returned: 0 in 0.387s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:28:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ddcba27d-bdc6-4a16-9cf7-e3150743cee9 tempest-VolumesDeleteCascade-1812474022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf3800b8-8343-4957-84f7-96687ac1618c -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf3800b8-8343-4957-84f7-96687ac1618c.8da06398-4d4f-4754-9844-52a30e27d4ef {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:28:30 devstack sudo[105975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf3800b8-8343-4957-84f7-96687ac1618c -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf3800b8-8343-4957-84f7-96687ac1618c.8da06398-4d4f-4754-9844-52a30e27d4ef Nov 04 12:28:30 devstack sudo[105975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:28:30 devstack sudo[105975]: pam_unix(sudo:session): session closed for user root Nov 04 12:28:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ddcba27d-bdc6-4a16-9cf7-e3150743cee9 tempest-VolumesDeleteCascade-1812474022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf3800b8-8343-4957-84f7-96687ac1618c -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf3800b8-8343-4957-84f7-96687ac1618c.8da06398-4d4f-4754-9844-52a30e27d4ef" returned: 0 in 0.295s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:28:30 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-ddcba27d-bdc6-4a16-9cf7-e3150743cee9 tempest-VolumesDeleteCascade-1812474022 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf3800b8-8343-4957-84f7-96687ac1618c.8da06398-4d4f-4754-9844-52a30e27d4ef is being set with open permissions: ugo+rw Nov 04 12:28:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ddcba27d-bdc6-4a16-9cf7-e3150743cee9 tempest-VolumesDeleteCascade-1812474022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf3800b8-8343-4957-84f7-96687ac1618c.8da06398-4d4f-4754-9844-52a30e27d4ef {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:28:30 devstack sudo[105983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf3800b8-8343-4957-84f7-96687ac1618c.8da06398-4d4f-4754-9844-52a30e27d4ef Nov 04 12:28:30 devstack sudo[105983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:28:31 devstack sudo[105983]: pam_unix(sudo:session): session closed for user root Nov 04 12:28:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ddcba27d-bdc6-4a16-9cf7-e3150743cee9 tempest-VolumesDeleteCascade-1812474022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf3800b8-8343-4957-84f7-96687ac1618c.8da06398-4d4f-4754-9844-52a30e27d4ef" returned: 0 in 0.230s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:28:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ddcba27d-bdc6-4a16-9cf7-e3150743cee9 tempest-VolumesDeleteCascade-1812474022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf3800b8-8343-4957-84f7-96687ac1618c.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:28:31 devstack sudo[105986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf3800b8-8343-4957-84f7-96687ac1618c.info Nov 04 12:28:31 devstack sudo[105986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:28:31 devstack sudo[105986]: pam_unix(sudo:session): session closed for user root Nov 04 12:28:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ddcba27d-bdc6-4a16-9cf7-e3150743cee9 tempest-VolumesDeleteCascade-1812474022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf3800b8-8343-4957-84f7-96687ac1618c.info" returned: 0 in 0.234s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:28:31 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-ddcba27d-bdc6-4a16-9cf7-e3150743cee9 tempest-VolumesDeleteCascade-1812474022 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf3800b8-8343-4957-84f7-96687ac1618c.info is being set with open permissions: ugo+rw Nov 04 12:28:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ddcba27d-bdc6-4a16-9cf7-e3150743cee9 tempest-VolumesDeleteCascade-1812474022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf3800b8-8343-4957-84f7-96687ac1618c.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:28:31 devstack sudo[105989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf3800b8-8343-4957-84f7-96687ac1618c.info Nov 04 12:28:31 devstack sudo[105989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:28:31 devstack sudo[105989]: pam_unix(sudo:session): session closed for user root Nov 04 12:28:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ddcba27d-bdc6-4a16-9cf7-e3150743cee9 tempest-VolumesDeleteCascade-1812474022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf3800b8-8343-4957-84f7-96687ac1618c.info" returned: 0 in 0.234s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:28:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ddcba27d-bdc6-4a16-9cf7-e3150743cee9 tempest-VolumesDeleteCascade-1812474022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.806s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:28:31 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-ddcba27d-bdc6-4a16-9cf7-e3150743cee9 tempest-VolumesDeleteCascade-1812474022 None] Create snapshot completed successfully Nov 04 12:28:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-65856efb-3ba8-40ee-857f-9002bd1ada08 tempest-VolumesDeleteCascade-1812474022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:28:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-65856efb-3ba8-40ee-857f-9002bd1ada08 tempest-VolumesDeleteCascade-1812474022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:28:32 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-65856efb-3ba8-40ee-857f-9002bd1ada08 tempest-VolumesDeleteCascade-1812474022 None] Creating offline snapshot 59a95ce1-b43e-4b05-94c1-1c23289d649d of volume cf3800b8-8343-4957-84f7-96687ac1618c {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 12:28:32 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e31730f-35d6-439c-aa6e-3895f6a171d8]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:28:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-65856efb-3ba8-40ee-857f-9002bd1ada08 tempest-VolumesDeleteCascade-1812474022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf3800b8-8343-4957-84f7-96687ac1618c.8da06398-4d4f-4754-9844-52a30e27d4ef {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:28:32 devstack sudo[105992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf3800b8-8343-4957-84f7-96687ac1618c.8da06398-4d4f-4754-9844-52a30e27d4ef Nov 04 12:28:32 devstack sudo[105992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:28:32 devstack sudo[105992]: pam_unix(sudo:session): session closed for user root Nov 04 12:28:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-65856efb-3ba8-40ee-857f-9002bd1ada08 tempest-VolumesDeleteCascade-1812474022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf3800b8-8343-4957-84f7-96687ac1618c.8da06398-4d4f-4754-9844-52a30e27d4ef" returned: 0 in 0.365s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:28:32 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-65856efb-3ba8-40ee-857f-9002bd1ada08 tempest-VolumesDeleteCascade-1812474022 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf3800b8-8343-4957-84f7-96687ac1618c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 12:28:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-65856efb-3ba8-40ee-857f-9002bd1ada08 tempest-VolumesDeleteCascade-1812474022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf3800b8-8343-4957-84f7-96687ac1618c.8da06398-4d4f-4754-9844-52a30e27d4ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf3800b8-8343-4957-84f7-96687ac1618c.59a95ce1-b43e-4b05-94c1-1c23289d649d 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:28:32 devstack sudo[105999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf3800b8-8343-4957-84f7-96687ac1618c.8da06398-4d4f-4754-9844-52a30e27d4ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf3800b8-8343-4957-84f7-96687ac1618c.59a95ce1-b43e-4b05-94c1-1c23289d649d 1G Nov 04 12:28:32 devstack sudo[105999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:28:32 devstack sudo[105999]: pam_unix(sudo:session): session closed for user root Nov 04 12:28:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-65856efb-3ba8-40ee-857f-9002bd1ada08 tempest-VolumesDeleteCascade-1812474022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf3800b8-8343-4957-84f7-96687ac1618c.8da06398-4d4f-4754-9844-52a30e27d4ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf3800b8-8343-4957-84f7-96687ac1618c.59a95ce1-b43e-4b05-94c1-1c23289d649d 1G" returned: 0 in 0.425s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:28:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-65856efb-3ba8-40ee-857f-9002bd1ada08 tempest-VolumesDeleteCascade-1812474022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf3800b8-8343-4957-84f7-96687ac1618c.8da06398-4d4f-4754-9844-52a30e27d4ef -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf3800b8-8343-4957-84f7-96687ac1618c.59a95ce1-b43e-4b05-94c1-1c23289d649d {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:28:33 devstack sudo[106004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf3800b8-8343-4957-84f7-96687ac1618c.8da06398-4d4f-4754-9844-52a30e27d4ef -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf3800b8-8343-4957-84f7-96687ac1618c.59a95ce1-b43e-4b05-94c1-1c23289d649d Nov 04 12:28:33 devstack sudo[106004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:28:33 devstack sudo[106004]: pam_unix(sudo:session): session closed for user root Nov 04 12:28:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-65856efb-3ba8-40ee-857f-9002bd1ada08 tempest-VolumesDeleteCascade-1812474022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf3800b8-8343-4957-84f7-96687ac1618c.8da06398-4d4f-4754-9844-52a30e27d4ef -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf3800b8-8343-4957-84f7-96687ac1618c.59a95ce1-b43e-4b05-94c1-1c23289d649d" returned: 0 in 0.270s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:28:33 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-65856efb-3ba8-40ee-857f-9002bd1ada08 tempest-VolumesDeleteCascade-1812474022 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf3800b8-8343-4957-84f7-96687ac1618c.59a95ce1-b43e-4b05-94c1-1c23289d649d is being set with open permissions: ugo+rw Nov 04 12:28:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-65856efb-3ba8-40ee-857f-9002bd1ada08 tempest-VolumesDeleteCascade-1812474022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf3800b8-8343-4957-84f7-96687ac1618c.59a95ce1-b43e-4b05-94c1-1c23289d649d {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:28:33 devstack sudo[106009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf3800b8-8343-4957-84f7-96687ac1618c.59a95ce1-b43e-4b05-94c1-1c23289d649d Nov 04 12:28:33 devstack sudo[106009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:28:33 devstack sudo[106009]: pam_unix(sudo:session): session closed for user root Nov 04 12:28:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-65856efb-3ba8-40ee-857f-9002bd1ada08 tempest-VolumesDeleteCascade-1812474022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf3800b8-8343-4957-84f7-96687ac1618c.59a95ce1-b43e-4b05-94c1-1c23289d649d" returned: 0 in 0.237s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:28:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-65856efb-3ba8-40ee-857f-9002bd1ada08 tempest-VolumesDeleteCascade-1812474022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.390s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:28:33 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-65856efb-3ba8-40ee-857f-9002bd1ada08 tempest-VolumesDeleteCascade-1812474022 None] Create snapshot completed successfully Nov 04 12:28:34 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-404a51dc-323f-41be-8cd8-15cdc11df3fe tempest-VolumesDeleteCascade-1812474022 None] Acquiring lock "cinder-cf3800b8-8343-4957-84f7-96687ac1618c-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:28:34 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-404a51dc-323f-41be-8cd8-15cdc11df3fe tempest-VolumesDeleteCascade-1812474022 None] Lock "cinder-cf3800b8-8343-4957-84f7-96687ac1618c-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:28:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-404a51dc-323f-41be-8cd8-15cdc11df3fe tempest-VolumesDeleteCascade-1812474022 None] Performing cascade delete. {{(pid=87095) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 04 12:28:34 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-404a51dc-323f-41be-8cd8-15cdc11df3fe tempest-VolumesDeleteCascade-1812474022 None] Acquiring lock "cinder-59a95ce1-b43e-4b05-94c1-1c23289d649d-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:28:34 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-404a51dc-323f-41be-8cd8-15cdc11df3fe tempest-VolumesDeleteCascade-1812474022 None] Lock "cinder-59a95ce1-b43e-4b05-94c1-1c23289d649d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:28:34 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-404a51dc-323f-41be-8cd8-15cdc11df3fe tempest-VolumesDeleteCascade-1812474022 None] Acquiring lock "cinder-quobyte-cf3800b8-8343-4957-84f7-96687ac1618c" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:28:34 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-404a51dc-323f-41be-8cd8-15cdc11df3fe tempest-VolumesDeleteCascade-1812474022 None] Lock "cinder-quobyte-cf3800b8-8343-4957-84f7-96687ac1618c" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:28:34 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-404a51dc-323f-41be-8cd8-15cdc11df3fe tempest-VolumesDeleteCascade-1812474022 None] Acquiring lock "cinder-quobyte-59a95ce1-b43e-4b05-94c1-1c23289d649d" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:28:34 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-404a51dc-323f-41be-8cd8-15cdc11df3fe tempest-VolumesDeleteCascade-1812474022 None] Lock "cinder-quobyte-59a95ce1-b43e-4b05-94c1-1c23289d649d" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:28:34 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-404a51dc-323f-41be-8cd8-15cdc11df3fe tempest-VolumesDeleteCascade-1812474022 None] Deleting offline snapshot 59a95ce1-b43e-4b05-94c1-1c23289d649d of volume cf3800b8-8343-4957-84f7-96687ac1618c {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 12:28:34 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-404a51dc-323f-41be-8cd8-15cdc11df3fe tempest-VolumesDeleteCascade-1812474022 None] snapshot_file for this snap is: volume-cf3800b8-8343-4957-84f7-96687ac1618c.59a95ce1-b43e-4b05-94c1-1c23289d649d {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 12:28:34 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[407370d0-13ae-471a-b16e-fdc93b3ebbc1]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:28:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-404a51dc-323f-41be-8cd8-15cdc11df3fe tempest-VolumesDeleteCascade-1812474022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf3800b8-8343-4957-84f7-96687ac1618c.59a95ce1-b43e-4b05-94c1-1c23289d649d {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:28:34 devstack sudo[106013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf3800b8-8343-4957-84f7-96687ac1618c.59a95ce1-b43e-4b05-94c1-1c23289d649d Nov 04 12:28:34 devstack sudo[106013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:28:34 devstack sudo[106013]: pam_unix(sudo:session): session closed for user root Nov 04 12:28:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-404a51dc-323f-41be-8cd8-15cdc11df3fe tempest-VolumesDeleteCascade-1812474022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf3800b8-8343-4957-84f7-96687ac1618c.59a95ce1-b43e-4b05-94c1-1c23289d649d" returned: 0 in 0.347s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:28:34 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-404a51dc-323f-41be-8cd8-15cdc11df3fe tempest-VolumesDeleteCascade-1812474022 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf3800b8-8343-4957-84f7-96687ac1618c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 12:28:34 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a67c3915-94b4-4705-83e1-1bf45b921940]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:28:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-404a51dc-323f-41be-8cd8-15cdc11df3fe tempest-VolumesDeleteCascade-1812474022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf3800b8-8343-4957-84f7-96687ac1618c.8da06398-4d4f-4754-9844-52a30e27d4ef {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:28:34 devstack sudo[106018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf3800b8-8343-4957-84f7-96687ac1618c.8da06398-4d4f-4754-9844-52a30e27d4ef Nov 04 12:28:34 devstack sudo[106018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:28:35 devstack sudo[106018]: pam_unix(sudo:session): session closed for user root Nov 04 12:28:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-404a51dc-323f-41be-8cd8-15cdc11df3fe tempest-VolumesDeleteCascade-1812474022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf3800b8-8343-4957-84f7-96687ac1618c.8da06398-4d4f-4754-9844-52a30e27d4ef" returned: 0 in 0.336s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:28:35 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-404a51dc-323f-41be-8cd8-15cdc11df3fe tempest-VolumesDeleteCascade-1812474022 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf3800b8-8343-4957-84f7-96687ac1618c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 12:28:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-404a51dc-323f-41be-8cd8-15cdc11df3fe tempest-VolumesDeleteCascade-1812474022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf3800b8-8343-4957-84f7-96687ac1618c.59a95ce1-b43e-4b05-94c1-1c23289d649d {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:28:35 devstack sudo[106023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf3800b8-8343-4957-84f7-96687ac1618c.59a95ce1-b43e-4b05-94c1-1c23289d649d Nov 04 12:28:35 devstack sudo[106023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:28:35 devstack sudo[106023]: pam_unix(sudo:session): session closed for user root Nov 04 12:28:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-404a51dc-323f-41be-8cd8-15cdc11df3fe tempest-VolumesDeleteCascade-1812474022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf3800b8-8343-4957-84f7-96687ac1618c.59a95ce1-b43e-4b05-94c1-1c23289d649d" returned: 0 in 0.363s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:28:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-404a51dc-323f-41be-8cd8-15cdc11df3fe tempest-VolumesDeleteCascade-1812474022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf3800b8-8343-4957-84f7-96687ac1618c.59a95ce1-b43e-4b05-94c1-1c23289d649d {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:28:35 devstack sudo[106028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf3800b8-8343-4957-84f7-96687ac1618c.59a95ce1-b43e-4b05-94c1-1c23289d649d Nov 04 12:28:35 devstack sudo[106028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:28:35 devstack sudo[106028]: pam_unix(sudo:session): session closed for user root Nov 04 12:28:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-404a51dc-323f-41be-8cd8-15cdc11df3fe tempest-VolumesDeleteCascade-1812474022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf3800b8-8343-4957-84f7-96687ac1618c.59a95ce1-b43e-4b05-94c1-1c23289d649d" returned: 0 in 0.232s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:28:35 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-404a51dc-323f-41be-8cd8-15cdc11df3fe tempest-VolumesDeleteCascade-1812474022 None] Lock "cinder-quobyte-59a95ce1-b43e-4b05-94c1-1c23289d649d" released by "_delete_snapshot" :: held 1.367s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:28:35 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-404a51dc-323f-41be-8cd8-15cdc11df3fe tempest-VolumesDeleteCascade-1812474022 None] Lock "cinder-quobyte-cf3800b8-8343-4957-84f7-96687ac1618c" released by "delete_snapshot" :: held 1.386s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:28:35 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-404a51dc-323f-41be-8cd8-15cdc11df3fe tempest-VolumesDeleteCascade-1812474022 None] Created reservations ['5c6da740-f315-48c1-8dc2-ae0e24c8dc0f', 'e928ce3d-f4ee-42d6-99bf-3dee72440f0d', '3d1d5c37-e73d-4996-bf4a-6c68702829bb', 'b3178f17-1306-434a-be99-33cbe41026bc'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:28:35 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-404a51dc-323f-41be-8cd8-15cdc11df3fe tempest-VolumesDeleteCascade-1812474022 None] Delete snapshot completed successfully. Nov 04 12:28:35 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-404a51dc-323f-41be-8cd8-15cdc11df3fe tempest-VolumesDeleteCascade-1812474022 None] Lock "cinder-59a95ce1-b43e-4b05-94c1-1c23289d649d-delete_snapshot" released by "delete_snapshot" :: held 1.525s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:28:35 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-404a51dc-323f-41be-8cd8-15cdc11df3fe tempest-VolumesDeleteCascade-1812474022 None] Acquiring lock "cinder-8da06398-4d4f-4754-9844-52a30e27d4ef-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:28:35 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-404a51dc-323f-41be-8cd8-15cdc11df3fe tempest-VolumesDeleteCascade-1812474022 None] Lock "cinder-8da06398-4d4f-4754-9844-52a30e27d4ef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:28:35 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-404a51dc-323f-41be-8cd8-15cdc11df3fe tempest-VolumesDeleteCascade-1812474022 None] Acquiring lock "cinder-quobyte-cf3800b8-8343-4957-84f7-96687ac1618c" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:28:35 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-404a51dc-323f-41be-8cd8-15cdc11df3fe tempest-VolumesDeleteCascade-1812474022 None] Lock "cinder-quobyte-cf3800b8-8343-4957-84f7-96687ac1618c" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:28:35 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-404a51dc-323f-41be-8cd8-15cdc11df3fe tempest-VolumesDeleteCascade-1812474022 None] Acquiring lock "cinder-quobyte-8da06398-4d4f-4754-9844-52a30e27d4ef" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:28:35 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-404a51dc-323f-41be-8cd8-15cdc11df3fe tempest-VolumesDeleteCascade-1812474022 None] Lock "cinder-quobyte-8da06398-4d4f-4754-9844-52a30e27d4ef" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:28:35 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-404a51dc-323f-41be-8cd8-15cdc11df3fe tempest-VolumesDeleteCascade-1812474022 None] Deleting offline snapshot 8da06398-4d4f-4754-9844-52a30e27d4ef of volume cf3800b8-8343-4957-84f7-96687ac1618c {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 12:28:35 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-404a51dc-323f-41be-8cd8-15cdc11df3fe tempest-VolumesDeleteCascade-1812474022 None] snapshot_file for this snap is: volume-cf3800b8-8343-4957-84f7-96687ac1618c.8da06398-4d4f-4754-9844-52a30e27d4ef {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 12:28:35 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2194f9-2203-4653-85e9-b52a81dcb923]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:28:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-404a51dc-323f-41be-8cd8-15cdc11df3fe tempest-VolumesDeleteCascade-1812474022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf3800b8-8343-4957-84f7-96687ac1618c.8da06398-4d4f-4754-9844-52a30e27d4ef {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:28:36 devstack sudo[106031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf3800b8-8343-4957-84f7-96687ac1618c.8da06398-4d4f-4754-9844-52a30e27d4ef Nov 04 12:28:36 devstack sudo[106031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:28:36 devstack sudo[106031]: pam_unix(sudo:session): session closed for user root Nov 04 12:28:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-404a51dc-323f-41be-8cd8-15cdc11df3fe tempest-VolumesDeleteCascade-1812474022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf3800b8-8343-4957-84f7-96687ac1618c.8da06398-4d4f-4754-9844-52a30e27d4ef" returned: 0 in 0.344s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:28:36 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-404a51dc-323f-41be-8cd8-15cdc11df3fe tempest-VolumesDeleteCascade-1812474022 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf3800b8-8343-4957-84f7-96687ac1618c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 12:28:36 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[92cd3365-2835-44ae-97f5-73aee83fc881]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:28:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-404a51dc-323f-41be-8cd8-15cdc11df3fe tempest-VolumesDeleteCascade-1812474022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf3800b8-8343-4957-84f7-96687ac1618c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:28:36 devstack sudo[106036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf3800b8-8343-4957-84f7-96687ac1618c Nov 04 12:28:36 devstack sudo[106036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:28:36 devstack sudo[106036]: pam_unix(sudo:session): session closed for user root Nov 04 12:28:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-404a51dc-323f-41be-8cd8-15cdc11df3fe tempest-VolumesDeleteCascade-1812474022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf3800b8-8343-4957-84f7-96687ac1618c" returned: 0 in 0.342s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:28:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-404a51dc-323f-41be-8cd8-15cdc11df3fe tempest-VolumesDeleteCascade-1812474022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf3800b8-8343-4957-84f7-96687ac1618c.8da06398-4d4f-4754-9844-52a30e27d4ef {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:28:36 devstack sudo[106041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf3800b8-8343-4957-84f7-96687ac1618c.8da06398-4d4f-4754-9844-52a30e27d4ef Nov 04 12:28:36 devstack sudo[106041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:28:36 devstack sudo[106041]: pam_unix(sudo:session): session closed for user root Nov 04 12:28:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-404a51dc-323f-41be-8cd8-15cdc11df3fe tempest-VolumesDeleteCascade-1812474022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf3800b8-8343-4957-84f7-96687ac1618c.8da06398-4d4f-4754-9844-52a30e27d4ef" returned: 0 in 0.310s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:28:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-404a51dc-323f-41be-8cd8-15cdc11df3fe tempest-VolumesDeleteCascade-1812474022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf3800b8-8343-4957-84f7-96687ac1618c.8da06398-4d4f-4754-9844-52a30e27d4ef {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:28:37 devstack sudo[106046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf3800b8-8343-4957-84f7-96687ac1618c.8da06398-4d4f-4754-9844-52a30e27d4ef Nov 04 12:28:37 devstack sudo[106046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:28:37 devstack sudo[106046]: pam_unix(sudo:session): session closed for user root Nov 04 12:28:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-404a51dc-323f-41be-8cd8-15cdc11df3fe tempest-VolumesDeleteCascade-1812474022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf3800b8-8343-4957-84f7-96687ac1618c.8da06398-4d4f-4754-9844-52a30e27d4ef" returned: 0 in 0.234s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:28:37 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-404a51dc-323f-41be-8cd8-15cdc11df3fe tempest-VolumesDeleteCascade-1812474022 None] Lock "cinder-quobyte-8da06398-4d4f-4754-9844-52a30e27d4ef" released by "_delete_snapshot" :: held 1.316s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:28:37 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-404a51dc-323f-41be-8cd8-15cdc11df3fe tempest-VolumesDeleteCascade-1812474022 None] Lock "cinder-quobyte-cf3800b8-8343-4957-84f7-96687ac1618c" released by "delete_snapshot" :: held 1.334s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:28:37 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-404a51dc-323f-41be-8cd8-15cdc11df3fe tempest-VolumesDeleteCascade-1812474022 None] Created reservations ['1acaa368-9ffc-41e4-b4ec-3f901abf9e73', 'ea33c39f-4bd2-4f6d-933f-fde926cc5253', 'a98e3faf-6195-42b7-8310-e26a11fa478f', 'efd5be12-b403-4447-a1be-20bde5fdb2d3'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:28:37 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-404a51dc-323f-41be-8cd8-15cdc11df3fe tempest-VolumesDeleteCascade-1812474022 None] Delete snapshot completed successfully. Nov 04 12:28:37 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-404a51dc-323f-41be-8cd8-15cdc11df3fe tempest-VolumesDeleteCascade-1812474022 None] Lock "cinder-8da06398-4d4f-4754-9844-52a30e27d4ef-delete_snapshot" released by "delete_snapshot" :: held 1.464s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:28:37 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-404a51dc-323f-41be-8cd8-15cdc11df3fe tempest-VolumesDeleteCascade-1812474022 None] Snapshots deleted, issuing volume delete {{(pid=87095) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 04 12:28:37 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-404a51dc-323f-41be-8cd8-15cdc11df3fe tempest-VolumesDeleteCascade-1812474022 None] Acquiring lock "cinder-quobyte-cf3800b8-8343-4957-84f7-96687ac1618c" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:28:37 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-404a51dc-323f-41be-8cd8-15cdc11df3fe tempest-VolumesDeleteCascade-1812474022 None] Lock "cinder-quobyte-cf3800b8-8343-4957-84f7-96687ac1618c" acquired by "delete_volume" :: waited 0.012s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:28:37 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9771a0d-3154-48f2-953a-be57f26152e0]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:28:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-404a51dc-323f-41be-8cd8-15cdc11df3fe tempest-VolumesDeleteCascade-1812474022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf3800b8-8343-4957-84f7-96687ac1618c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:28:37 devstack sudo[106049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf3800b8-8343-4957-84f7-96687ac1618c Nov 04 12:28:37 devstack sudo[106049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:28:37 devstack sudo[106049]: pam_unix(sudo:session): session closed for user root Nov 04 12:28:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-404a51dc-323f-41be-8cd8-15cdc11df3fe tempest-VolumesDeleteCascade-1812474022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf3800b8-8343-4957-84f7-96687ac1618c" returned: 0 in 0.339s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:28:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-404a51dc-323f-41be-8cd8-15cdc11df3fe tempest-VolumesDeleteCascade-1812474022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf3800b8-8343-4957-84f7-96687ac1618c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:28:37 devstack sudo[106054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf3800b8-8343-4957-84f7-96687ac1618c Nov 04 12:28:37 devstack sudo[106054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:28:37 devstack sudo[106054]: pam_unix(sudo:session): session closed for user root Nov 04 12:28:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-404a51dc-323f-41be-8cd8-15cdc11df3fe tempest-VolumesDeleteCascade-1812474022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf3800b8-8343-4957-84f7-96687ac1618c" returned: 0 in 0.234s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:28:38 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-404a51dc-323f-41be-8cd8-15cdc11df3fe tempest-VolumesDeleteCascade-1812474022 None] Lock "cinder-quobyte-cf3800b8-8343-4957-84f7-96687ac1618c" released by "delete_volume" :: held 0.635s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:28:38 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-404a51dc-323f-41be-8cd8-15cdc11df3fe tempest-VolumesDeleteCascade-1812474022 None] Created reservations ['86123f7a-53c0-4d8c-be23-f786515228ed', '1881e5d0-8b33-4b48-826d-240d34e9c682', 'c38d1229-ff5a-48a6-8eab-be4a729e0e0d', '033ce335-6ee1-4d0a-93aa-6b268c9bda45'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:28:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-404a51dc-323f-41be-8cd8-15cdc11df3fe tempest-VolumesDeleteCascade-1812474022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:28:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-404a51dc-323f-41be-8cd8-15cdc11df3fe tempest-VolumesDeleteCascade-1812474022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:28:38 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-404a51dc-323f-41be-8cd8-15cdc11df3fe tempest-VolumesDeleteCascade-1812474022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:28:38 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-404a51dc-323f-41be-8cd8-15cdc11df3fe tempest-VolumesDeleteCascade-1812474022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:28:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-404a51dc-323f-41be-8cd8-15cdc11df3fe tempest-VolumesDeleteCascade-1812474022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:28:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-404a51dc-323f-41be-8cd8-15cdc11df3fe tempest-VolumesDeleteCascade-1812474022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:28:38 devstack sudo[106057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:28:38 devstack sudo[106057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:28:38 devstack sudo[106057]: pam_unix(sudo:session): session closed for user root Nov 04 12:28:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-404a51dc-323f-41be-8cd8-15cdc11df3fe tempest-VolumesDeleteCascade-1812474022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.228s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:28:38 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-404a51dc-323f-41be-8cd8-15cdc11df3fe tempest-VolumesDeleteCascade-1812474022 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:28:38 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-404a51dc-323f-41be-8cd8-15cdc11df3fe tempest-VolumesDeleteCascade-1812474022 None] Deleted volume successfully. Nov 04 12:28:38 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-404a51dc-323f-41be-8cd8-15cdc11df3fe tempest-VolumesDeleteCascade-1812474022 None] Lock "cinder-cf3800b8-8343-4957-84f7-96687ac1618c-delete_volume" released by "delete_volume" :: held 4.098s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:28:39 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-d083a091-3bfd-4acb-871e-62f8380e76c0 tempest-VolumesDeleteCascade-1812474022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:28:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d083a091-3bfd-4acb-871e-62f8380e76c0 tempest-VolumesDeleteCascade-1812474022 None] Flow 'volume_create_manager' (6f1f9857-310d-4ae0-9226-a83fb07d0564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:28:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d083a091-3bfd-4acb-871e-62f8380e76c0 tempest-VolumesDeleteCascade-1812474022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9387142-139c-4f8c-822a-26cc390118d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:28:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d083a091-3bfd-4acb-871e-62f8380e76c0 tempest-VolumesDeleteCascade-1812474022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9387142-139c-4f8c-822a-26cc390118d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:28:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1804668028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12d59ea4-66c6-42e6-ada6-44660b345b3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38eb51497afd4ac98e84c4a7df7ce1cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:28:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:28:39Z,use_quota=True,user_id='ede70ead855c4a7dab4c93db65794476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:28:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d083a091-3bfd-4acb-871e-62f8380e76c0 tempest-VolumesDeleteCascade-1812474022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21f84751-a15b-4d0c-8472-6f4d4c43be5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:28:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d083a091-3bfd-4acb-871e-62f8380e76c0 tempest-VolumesDeleteCascade-1812474022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21f84751-a15b-4d0c-8472-6f4d4c43be5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:28:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d083a091-3bfd-4acb-871e-62f8380e76c0 tempest-VolumesDeleteCascade-1812474022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7bf2c5c-6fe5-4b73-a478-ea37df2ab442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:28:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d083a091-3bfd-4acb-871e-62f8380e76c0 tempest-VolumesDeleteCascade-1812474022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7bf2c5c-6fe5-4b73-a478-ea37df2ab442) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12d59ea4-66c6-42e6-ada6-44660b345b3d', 'volume_name': 'volume-12d59ea4-66c6-42e6-ada6-44660b345b3d', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:28:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d083a091-3bfd-4acb-871e-62f8380e76c0 tempest-VolumesDeleteCascade-1812474022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8695f280-7286-43c1-b5ec-96a741ee7bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:28:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d083a091-3bfd-4acb-871e-62f8380e76c0 tempest-VolumesDeleteCascade-1812474022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8695f280-7286-43c1-b5ec-96a741ee7bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:28:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d083a091-3bfd-4acb-871e-62f8380e76c0 tempest-VolumesDeleteCascade-1812474022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff2bd7d4-1141-4302-9599-edd4bf0a62d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:28:39 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-d083a091-3bfd-4acb-871e-62f8380e76c0 tempest-VolumesDeleteCascade-1812474022 None] Volume 12d59ea4-66c6-42e6-ada6-44660b345b3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12d59ea4-66c6-42e6-ada6-44660b345b3d', 'volume_size': 1} Nov 04 12:28:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d083a091-3bfd-4acb-871e-62f8380e76c0 tempest-VolumesDeleteCascade-1812474022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:28:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d083a091-3bfd-4acb-871e-62f8380e76c0 tempest-VolumesDeleteCascade-1812474022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:28:39 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d083a091-3bfd-4acb-871e-62f8380e76c0 tempest-VolumesDeleteCascade-1812474022 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:28:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1804668028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12d59ea4-66c6-42e6-ada6-44660b345b3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38eb51497afd4ac98e84c4a7df7ce1cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:28:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:28:39Z,use_quota=True,user_id='ede70ead855c4a7dab4c93db65794476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:28:39 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-d083a091-3bfd-4acb-871e-62f8380e76c0 tempest-VolumesDeleteCascade-1812474022 None] Creating volume 12d59ea4-66c6-42e6-ada6-44660b345b3d {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:28:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d083a091-3bfd-4acb-871e-62f8380e76c0 tempest-VolumesDeleteCascade-1812474022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:28:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d083a091-3bfd-4acb-871e-62f8380e76c0 tempest-VolumesDeleteCascade-1812474022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:28:39 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d083a091-3bfd-4acb-871e-62f8380e76c0 tempest-VolumesDeleteCascade-1812474022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:28:39 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d083a091-3bfd-4acb-871e-62f8380e76c0 tempest-VolumesDeleteCascade-1812474022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:28:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d083a091-3bfd-4acb-871e-62f8380e76c0 tempest-VolumesDeleteCascade-1812474022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:28:39 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d083a091-3bfd-4acb-871e-62f8380e76c0 tempest-VolumesDeleteCascade-1812474022 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:28:39 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-d083a091-3bfd-4acb-871e-62f8380e76c0 tempest-VolumesDeleteCascade-1812474022 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:28:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d083a091-3bfd-4acb-871e-62f8380e76c0 tempest-VolumesDeleteCascade-1812474022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-12d59ea4-66c6-42e6-ada6-44660b345b3d 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:28:39 devstack sudo[106060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-12d59ea4-66c6-42e6-ada6-44660b345b3d 1073741824 Nov 04 12:28:39 devstack sudo[106060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:28:39 devstack sudo[106060]: pam_unix(sudo:session): session closed for user root Nov 04 12:28:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d083a091-3bfd-4acb-871e-62f8380e76c0 tempest-VolumesDeleteCascade-1812474022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-12d59ea4-66c6-42e6-ada6-44660b345b3d 1073741824" returned: 0 in 0.382s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:28:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d083a091-3bfd-4acb-871e-62f8380e76c0 tempest-VolumesDeleteCascade-1812474022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-12d59ea4-66c6-42e6-ada6-44660b345b3d {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:28:39 devstack sudo[106065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-12d59ea4-66c6-42e6-ada6-44660b345b3d Nov 04 12:28:39 devstack sudo[106065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:28:39 devstack sudo[106065]: pam_unix(sudo:session): session closed for user root Nov 04 12:28:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d083a091-3bfd-4acb-871e-62f8380e76c0 tempest-VolumesDeleteCascade-1812474022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-12d59ea4-66c6-42e6-ada6-44660b345b3d" returned: 0 in 0.234s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:28:39 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d083a091-3bfd-4acb-871e-62f8380e76c0 tempest-VolumesDeleteCascade-1812474022 None] <== create_volume: return (657ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:28:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d083a091-3bfd-4acb-871e-62f8380e76c0 tempest-VolumesDeleteCascade-1812474022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.660s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:28:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d083a091-3bfd-4acb-871e-62f8380e76c0 tempest-VolumesDeleteCascade-1812474022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff2bd7d4-1141-4302-9599-edd4bf0a62d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12d59ea4-66c6-42e6-ada6-44660b345b3d', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:28:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d083a091-3bfd-4acb-871e-62f8380e76c0 tempest-VolumesDeleteCascade-1812474022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (802a85ab-1634-4e08-b783-51c1583764cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:28:39 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-d083a091-3bfd-4acb-871e-62f8380e76c0 tempest-VolumesDeleteCascade-1812474022 None] Volume volume-12d59ea4-66c6-42e6-ada6-44660b345b3d (12d59ea4-66c6-42e6-ada6-44660b345b3d): created successfully Nov 04 12:28:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d083a091-3bfd-4acb-871e-62f8380e76c0 tempest-VolumesDeleteCascade-1812474022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (802a85ab-1634-4e08-b783-51c1583764cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:28:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d083a091-3bfd-4acb-871e-62f8380e76c0 tempest-VolumesDeleteCascade-1812474022 None] Flow 'volume_create_manager' (6f1f9857-310d-4ae0-9226-a83fb07d0564) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:28:39 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-d083a091-3bfd-4acb-871e-62f8380e76c0 tempest-VolumesDeleteCascade-1812474022 None] Created volume successfully. Nov 04 12:28:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2013028f-3b2e-47fc-b0d3-de39deb0d699 tempest-VolumesDeleteCascade-1812474022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:28:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2013028f-3b2e-47fc-b0d3-de39deb0d699 tempest-VolumesDeleteCascade-1812474022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:28:40 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-2013028f-3b2e-47fc-b0d3-de39deb0d699 tempest-VolumesDeleteCascade-1812474022 None] Creating offline snapshot c8c5f838-071f-4fe9-8222-eaedce88b95a of volume 12d59ea4-66c6-42e6-ada6-44660b345b3d {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 12:28:40 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[25248039-6670-422b-9ffd-0d39aef2a584]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:28:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2013028f-3b2e-47fc-b0d3-de39deb0d699 tempest-VolumesDeleteCascade-1812474022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-12d59ea4-66c6-42e6-ada6-44660b345b3d {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:28:40 devstack sudo[106068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-12d59ea4-66c6-42e6-ada6-44660b345b3d Nov 04 12:28:40 devstack sudo[106068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:28:40 devstack sudo[106068]: pam_unix(sudo:session): session closed for user root Nov 04 12:28:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2013028f-3b2e-47fc-b0d3-de39deb0d699 tempest-VolumesDeleteCascade-1812474022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-12d59ea4-66c6-42e6-ada6-44660b345b3d" returned: 0 in 0.351s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:28:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2013028f-3b2e-47fc-b0d3-de39deb0d699 tempest-VolumesDeleteCascade-1812474022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-12d59ea4-66c6-42e6-ada6-44660b345b3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-12d59ea4-66c6-42e6-ada6-44660b345b3d.c8c5f838-071f-4fe9-8222-eaedce88b95a 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:28:40 devstack sudo[106073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-12d59ea4-66c6-42e6-ada6-44660b345b3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-12d59ea4-66c6-42e6-ada6-44660b345b3d.c8c5f838-071f-4fe9-8222-eaedce88b95a 1G Nov 04 12:28:40 devstack sudo[106073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:28:41 devstack sudo[106073]: pam_unix(sudo:session): session closed for user root Nov 04 12:28:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2013028f-3b2e-47fc-b0d3-de39deb0d699 tempest-VolumesDeleteCascade-1812474022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-12d59ea4-66c6-42e6-ada6-44660b345b3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-12d59ea4-66c6-42e6-ada6-44660b345b3d.c8c5f838-071f-4fe9-8222-eaedce88b95a 1G" returned: 0 in 0.383s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:28:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2013028f-3b2e-47fc-b0d3-de39deb0d699 tempest-VolumesDeleteCascade-1812474022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12d59ea4-66c6-42e6-ada6-44660b345b3d -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-12d59ea4-66c6-42e6-ada6-44660b345b3d.c8c5f838-071f-4fe9-8222-eaedce88b95a {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:28:41 devstack sudo[106078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12d59ea4-66c6-42e6-ada6-44660b345b3d -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-12d59ea4-66c6-42e6-ada6-44660b345b3d.c8c5f838-071f-4fe9-8222-eaedce88b95a Nov 04 12:28:41 devstack sudo[106078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:28:41 devstack sudo[106078]: pam_unix(sudo:session): session closed for user root Nov 04 12:28:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2013028f-3b2e-47fc-b0d3-de39deb0d699 tempest-VolumesDeleteCascade-1812474022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12d59ea4-66c6-42e6-ada6-44660b345b3d -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-12d59ea4-66c6-42e6-ada6-44660b345b3d.c8c5f838-071f-4fe9-8222-eaedce88b95a" returned: 0 in 0.278s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:28:41 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-2013028f-3b2e-47fc-b0d3-de39deb0d699 tempest-VolumesDeleteCascade-1812474022 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-12d59ea4-66c6-42e6-ada6-44660b345b3d.c8c5f838-071f-4fe9-8222-eaedce88b95a is being set with open permissions: ugo+rw Nov 04 12:28:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2013028f-3b2e-47fc-b0d3-de39deb0d699 tempest-VolumesDeleteCascade-1812474022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-12d59ea4-66c6-42e6-ada6-44660b345b3d.c8c5f838-071f-4fe9-8222-eaedce88b95a {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:28:41 devstack sudo[106084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-12d59ea4-66c6-42e6-ada6-44660b345b3d.c8c5f838-071f-4fe9-8222-eaedce88b95a Nov 04 12:28:41 devstack sudo[106084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:28:41 devstack sudo[106084]: pam_unix(sudo:session): session closed for user root Nov 04 12:28:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2013028f-3b2e-47fc-b0d3-de39deb0d699 tempest-VolumesDeleteCascade-1812474022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-12d59ea4-66c6-42e6-ada6-44660b345b3d.c8c5f838-071f-4fe9-8222-eaedce88b95a" returned: 0 in 0.231s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:28:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2013028f-3b2e-47fc-b0d3-de39deb0d699 tempest-VolumesDeleteCascade-1812474022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-12d59ea4-66c6-42e6-ada6-44660b345b3d.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:28:41 devstack sudo[106087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-12d59ea4-66c6-42e6-ada6-44660b345b3d.info Nov 04 12:28:41 devstack sudo[106087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:28:41 devstack sudo[106087]: pam_unix(sudo:session): session closed for user root Nov 04 12:28:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2013028f-3b2e-47fc-b0d3-de39deb0d699 tempest-VolumesDeleteCascade-1812474022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-12d59ea4-66c6-42e6-ada6-44660b345b3d.info" returned: 0 in 0.265s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:28:41 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-2013028f-3b2e-47fc-b0d3-de39deb0d699 tempest-VolumesDeleteCascade-1812474022 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-12d59ea4-66c6-42e6-ada6-44660b345b3d.info is being set with open permissions: ugo+rw Nov 04 12:28:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2013028f-3b2e-47fc-b0d3-de39deb0d699 tempest-VolumesDeleteCascade-1812474022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-12d59ea4-66c6-42e6-ada6-44660b345b3d.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:28:41 devstack sudo[106090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-12d59ea4-66c6-42e6-ada6-44660b345b3d.info Nov 04 12:28:41 devstack sudo[106090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:28:42 devstack sudo[106090]: pam_unix(sudo:session): session closed for user root Nov 04 12:28:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2013028f-3b2e-47fc-b0d3-de39deb0d699 tempest-VolumesDeleteCascade-1812474022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-12d59ea4-66c6-42e6-ada6-44660b345b3d.info" returned: 0 in 0.237s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:28:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2013028f-3b2e-47fc-b0d3-de39deb0d699 tempest-VolumesDeleteCascade-1812474022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.832s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:28:42 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-2013028f-3b2e-47fc-b0d3-de39deb0d699 tempest-VolumesDeleteCascade-1812474022 None] Create snapshot completed successfully Nov 04 12:28:42 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7f663dd-8216-4c00-a241-b2d4a03805bf tempest-VolumesDeleteCascade-1812474022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:28:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d7f663dd-8216-4c00-a241-b2d4a03805bf tempest-VolumesDeleteCascade-1812474022 None] Flow 'volume_create_manager' (2d719733-5037-471a-90bc-11201d39a6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:28:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d7f663dd-8216-4c00-a241-b2d4a03805bf tempest-VolumesDeleteCascade-1812474022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (895d80e5-0c85-4a16-9e3e-daaee707ce8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:28:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d7f663dd-8216-4c00-a241-b2d4a03805bf tempest-VolumesDeleteCascade-1812474022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (895d80e5-0c85-4a16-9e3e-daaee707ce8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:28:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1464759220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d095462-c67b-4990-996f-0a511601bc3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38eb51497afd4ac98e84c4a7df7ce1cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:28:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c8c5f838-071f-4fe9-8222-eaedce88b95a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:28:43Z,use_quota=True,user_id='ede70ead855c4a7dab4c93db65794476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:28:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d7f663dd-8216-4c00-a241-b2d4a03805bf tempest-VolumesDeleteCascade-1812474022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76251239-3ebd-499d-9d94-f6b8236927cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:28:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d7f663dd-8216-4c00-a241-b2d4a03805bf tempest-VolumesDeleteCascade-1812474022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76251239-3ebd-499d-9d94-f6b8236927cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:28:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d7f663dd-8216-4c00-a241-b2d4a03805bf tempest-VolumesDeleteCascade-1812474022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2162ec6-cff4-4d04-bb4e-3d3ea74e11d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:28:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d7f663dd-8216-4c00-a241-b2d4a03805bf tempest-VolumesDeleteCascade-1812474022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2162ec6-cff4-4d04-bb4e-3d3ea74e11d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9d095462-c67b-4990-996f-0a511601bc3d', 'volume_name': 'volume-9d095462-c67b-4990-996f-0a511601bc3d', 'volume_size': 1, 'snapshot_id': 'c8c5f838-071f-4fe9-8222-eaedce88b95a'}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:28:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d7f663dd-8216-4c00-a241-b2d4a03805bf tempest-VolumesDeleteCascade-1812474022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (506eab30-8578-4ab1-9810-4b0ec803877a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:28:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d7f663dd-8216-4c00-a241-b2d4a03805bf tempest-VolumesDeleteCascade-1812474022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (506eab30-8578-4ab1-9810-4b0ec803877a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:28:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d7f663dd-8216-4c00-a241-b2d4a03805bf tempest-VolumesDeleteCascade-1812474022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48c5a24b-fef0-4e4d-b1f1-4167c88ca7d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:28:43 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-d7f663dd-8216-4c00-a241-b2d4a03805bf tempest-VolumesDeleteCascade-1812474022 None] Volume 9d095462-c67b-4990-996f-0a511601bc3d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9d095462-c67b-4990-996f-0a511601bc3d', 'volume_size': 1, 'snapshot_id': 'c8c5f838-071f-4fe9-8222-eaedce88b95a'} Nov 04 12:28:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d7f663dd-8216-4c00-a241-b2d4a03805bf tempest-VolumesDeleteCascade-1812474022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:28:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d7f663dd-8216-4c00-a241-b2d4a03805bf tempest-VolumesDeleteCascade-1812474022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:28:43 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-d7f663dd-8216-4c00-a241-b2d4a03805bf tempest-VolumesDeleteCascade-1812474022 None] Acquiring lock "cinder-quobyte-c8c5f838-071f-4fe9-8222-eaedce88b95a-9d095462-c67b-4990-996f-0a511601bc3d" by "_create_volume_from_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:28:43 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-d7f663dd-8216-4c00-a241-b2d4a03805bf tempest-VolumesDeleteCascade-1812474022 None] Lock "cinder-quobyte-c8c5f838-071f-4fe9-8222-eaedce88b95a-9d095462-c67b-4990-996f-0a511601bc3d" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:28:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d7f663dd-8216-4c00-a241-b2d4a03805bf tempest-VolumesDeleteCascade-1812474022 None] Creating volume 9d095462-c67b-4990-996f-0a511601bc3d from snapshot c8c5f838-071f-4fe9-8222-eaedce88b95a {{(pid=87095) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 04 12:28:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d7f663dd-8216-4c00-a241-b2d4a03805bf tempest-VolumesDeleteCascade-1812474022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:28:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d7f663dd-8216-4c00-a241-b2d4a03805bf tempest-VolumesDeleteCascade-1812474022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:28:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d7f663dd-8216-4c00-a241-b2d4a03805bf tempest-VolumesDeleteCascade-1812474022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:28:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d7f663dd-8216-4c00-a241-b2d4a03805bf tempest-VolumesDeleteCascade-1812474022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:28:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d7f663dd-8216-4c00-a241-b2d4a03805bf tempest-VolumesDeleteCascade-1812474022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:28:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d7f663dd-8216-4c00-a241-b2d4a03805bf tempest-VolumesDeleteCascade-1812474022 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:28:43 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-d7f663dd-8216-4c00-a241-b2d4a03805bf tempest-VolumesDeleteCascade-1812474022 None] Acquiring lock "cinder-quobyte-9d095462-c67b-4990-996f-0a511601bc3d" by "_copy_volume_from_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:28:43 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-d7f663dd-8216-4c00-a241-b2d4a03805bf tempest-VolumesDeleteCascade-1812474022 None] Lock "cinder-quobyte-9d095462-c67b-4990-996f-0a511601bc3d" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:28:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d7f663dd-8216-4c00-a241-b2d4a03805bf tempest-VolumesDeleteCascade-1812474022 None] snapshot: c8c5f838-071f-4fe9-8222-eaedce88b95a, volume: 9d095462-c67b-4990-996f-0a511601bc3d, {{(pid=87095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 12:28:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d7f663dd-8216-4c00-a241-b2d4a03805bf tempest-VolumesDeleteCascade-1812474022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:28:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d7f663dd-8216-4c00-a241-b2d4a03805bf tempest-VolumesDeleteCascade-1812474022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:28:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d7f663dd-8216-4c00-a241-b2d4a03805bf tempest-VolumesDeleteCascade-1812474022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:28:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d7f663dd-8216-4c00-a241-b2d4a03805bf tempest-VolumesDeleteCascade-1812474022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:28:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d7f663dd-8216-4c00-a241-b2d4a03805bf tempest-VolumesDeleteCascade-1812474022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:28:43 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd6aa5c-664c-4926-9359-ddbec31f36cd]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:28:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d7f663dd-8216-4c00-a241-b2d4a03805bf tempest-VolumesDeleteCascade-1812474022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-12d59ea4-66c6-42e6-ada6-44660b345b3d.c8c5f838-071f-4fe9-8222-eaedce88b95a {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:28:43 devstack sudo[106093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-12d59ea4-66c6-42e6-ada6-44660b345b3d.c8c5f838-071f-4fe9-8222-eaedce88b95a Nov 04 12:28:43 devstack sudo[106093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:28:43 devstack sudo[106093]: pam_unix(sudo:session): session closed for user root Nov 04 12:28:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d7f663dd-8216-4c00-a241-b2d4a03805bf tempest-VolumesDeleteCascade-1812474022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-12d59ea4-66c6-42e6-ada6-44660b345b3d.c8c5f838-071f-4fe9-8222-eaedce88b95a" returned: 0 in 0.344s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:28:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-d7f663dd-8216-4c00-a241-b2d4a03805bf tempest-VolumesDeleteCascade-1812474022 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12d59ea4-66c6-42e6-ada6-44660b345b3d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 12:28:43 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94da3ff-f9cb-494e-a373-60dc106150f6]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:28:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d7f663dd-8216-4c00-a241-b2d4a03805bf tempest-VolumesDeleteCascade-1812474022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-12d59ea4-66c6-42e6-ada6-44660b345b3d {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:28:43 devstack sudo[106099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-12d59ea4-66c6-42e6-ada6-44660b345b3d Nov 04 12:28:43 devstack sudo[106099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:28:43 devstack sudo[106099]: pam_unix(sudo:session): session closed for user root Nov 04 12:28:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d7f663dd-8216-4c00-a241-b2d4a03805bf tempest-VolumesDeleteCascade-1812474022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-12d59ea4-66c6-42e6-ada6-44660b345b3d" returned: 0 in 0.338s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:28:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d7f663dd-8216-4c00-a241-b2d4a03805bf tempest-VolumesDeleteCascade-1812474022 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-12d59ea4-66c6-42e6-ada6-44660b345b3d {{(pid=87095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 12:28:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d7f663dd-8216-4c00-a241-b2d4a03805bf tempest-VolumesDeleteCascade-1812474022 None] Creating direct copy from snapshot {{(pid=87095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 12:28:43 devstack cinder-volume[87095]: DEBUG cinder.utils [None req-d7f663dd-8216-4c00-a241-b2d4a03805bf tempest-VolumesDeleteCascade-1812474022 None] Path /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9d095462-c67b-4990-996f-0a511601bc3d not found in is_blk_device check {{(pid=87095) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 04 12:28:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d7f663dd-8216-4c00-a241-b2d4a03805bf tempest-VolumesDeleteCascade-1812474022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-12d59ea4-66c6-42e6-ada6-44660b345b3d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9d095462-c67b-4990-996f-0a511601bc3d {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:28:43 devstack sudo[106104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-12d59ea4-66c6-42e6-ada6-44660b345b3d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9d095462-c67b-4990-996f-0a511601bc3d Nov 04 12:28:43 devstack sudo[106104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:28:49 devstack sudo[106104]: pam_unix(sudo:session): session closed for user root Nov 04 12:28:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d7f663dd-8216-4c00-a241-b2d4a03805bf tempest-VolumesDeleteCascade-1812474022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-12d59ea4-66c6-42e6-ada6-44660b345b3d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9d095462-c67b-4990-996f-0a511601bc3d" returned: 0 in 5.885s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:28:49 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-d7f663dd-8216-4c00-a241-b2d4a03805bf tempest-VolumesDeleteCascade-1812474022 None] Image conversion details: src /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-12d59ea4-66c6-42e6-ada6-44660b345b3d, size 1024.00 MB, duration 5.89 sec, destination /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9d095462-c67b-4990-996f-0a511601bc3d {{(pid=87095) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 12:28:49 devstack cinder-volume[87095]: INFO cinder.image.image_utils [None req-d7f663dd-8216-4c00-a241-b2d4a03805bf tempest-VolumesDeleteCascade-1812474022 None] Converted 1024.00 MB image at 173.95 MB/s Nov 04 12:28:49 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-d7f663dd-8216-4c00-a241-b2d4a03805bf tempest-VolumesDeleteCascade-1812474022 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9d095462-c67b-4990-996f-0a511601bc3d is being set with open permissions: ugo+rw Nov 04 12:28:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d7f663dd-8216-4c00-a241-b2d4a03805bf tempest-VolumesDeleteCascade-1812474022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9d095462-c67b-4990-996f-0a511601bc3d {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:28:49 devstack sudo[106118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9d095462-c67b-4990-996f-0a511601bc3d Nov 04 12:28:49 devstack sudo[106118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:28:49 devstack sudo[106118]: pam_unix(sudo:session): session closed for user root Nov 04 12:28:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d7f663dd-8216-4c00-a241-b2d4a03805bf tempest-VolumesDeleteCascade-1812474022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9d095462-c67b-4990-996f-0a511601bc3d" returned: 0 in 0.227s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:28:49 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-d7f663dd-8216-4c00-a241-b2d4a03805bf tempest-VolumesDeleteCascade-1812474022 None] Lock "cinder-quobyte-9d095462-c67b-4990-996f-0a511601bc3d" released by "_copy_volume_from_snapshot" :: held 6.870s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:28:50 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-d7f663dd-8216-4c00-a241-b2d4a03805bf tempest-VolumesDeleteCascade-1812474022 None] Lock "cinder-quobyte-c8c5f838-071f-4fe9-8222-eaedce88b95a-9d095462-c67b-4990-996f-0a511601bc3d" released by "_create_volume_from_snapshot" :: held 6.932s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:28:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d7f663dd-8216-4c00-a241-b2d4a03805bf tempest-VolumesDeleteCascade-1812474022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.948s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:28:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d7f663dd-8216-4c00-a241-b2d4a03805bf tempest-VolumesDeleteCascade-1812474022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48c5a24b-fef0-4e4d-b1f1-4167c88ca7d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d095462-c67b-4990-996f-0a511601bc3d', 'volume_size': 1, 'snapshot_id': 'c8c5f838-071f-4fe9-8222-eaedce88b95a'}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:28:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d7f663dd-8216-4c00-a241-b2d4a03805bf tempest-VolumesDeleteCascade-1812474022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09bb331c-34c7-4f0f-b76b-3dc86c881238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:28:50 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-d7f663dd-8216-4c00-a241-b2d4a03805bf tempest-VolumesDeleteCascade-1812474022 None] Volume volume-9d095462-c67b-4990-996f-0a511601bc3d (9d095462-c67b-4990-996f-0a511601bc3d): created successfully Nov 04 12:28:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d7f663dd-8216-4c00-a241-b2d4a03805bf tempest-VolumesDeleteCascade-1812474022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09bb331c-34c7-4f0f-b76b-3dc86c881238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:28:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d7f663dd-8216-4c00-a241-b2d4a03805bf tempest-VolumesDeleteCascade-1812474022 None] Flow 'volume_create_manager' (2d719733-5037-471a-90bc-11201d39a6c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:28:50 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-d7f663dd-8216-4c00-a241-b2d4a03805bf tempest-VolumesDeleteCascade-1812474022 None] Created volume successfully. Nov 04 12:28:50 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a02ee5fa-7ad8-4144-aba6-583fafa7839a tempest-VolumesDeleteCascade-1812474022 None] Acquiring lock "cinder-12d59ea4-66c6-42e6-ada6-44660b345b3d-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:28:50 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a02ee5fa-7ad8-4144-aba6-583fafa7839a tempest-VolumesDeleteCascade-1812474022 None] Lock "cinder-12d59ea4-66c6-42e6-ada6-44660b345b3d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:28:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a02ee5fa-7ad8-4144-aba6-583fafa7839a tempest-VolumesDeleteCascade-1812474022 None] Performing cascade delete. {{(pid=87095) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 04 12:28:50 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a02ee5fa-7ad8-4144-aba6-583fafa7839a tempest-VolumesDeleteCascade-1812474022 None] Acquiring lock "cinder-c8c5f838-071f-4fe9-8222-eaedce88b95a-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:28:50 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a02ee5fa-7ad8-4144-aba6-583fafa7839a tempest-VolumesDeleteCascade-1812474022 None] Lock "cinder-c8c5f838-071f-4fe9-8222-eaedce88b95a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:28:50 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a02ee5fa-7ad8-4144-aba6-583fafa7839a tempest-VolumesDeleteCascade-1812474022 None] Acquiring lock "cinder-quobyte-12d59ea4-66c6-42e6-ada6-44660b345b3d" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:28:50 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a02ee5fa-7ad8-4144-aba6-583fafa7839a tempest-VolumesDeleteCascade-1812474022 None] Lock "cinder-quobyte-12d59ea4-66c6-42e6-ada6-44660b345b3d" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:28:50 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a02ee5fa-7ad8-4144-aba6-583fafa7839a tempest-VolumesDeleteCascade-1812474022 None] Acquiring lock "cinder-quobyte-c8c5f838-071f-4fe9-8222-eaedce88b95a" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:28:50 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a02ee5fa-7ad8-4144-aba6-583fafa7839a tempest-VolumesDeleteCascade-1812474022 None] Lock "cinder-quobyte-c8c5f838-071f-4fe9-8222-eaedce88b95a" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:28:50 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-a02ee5fa-7ad8-4144-aba6-583fafa7839a tempest-VolumesDeleteCascade-1812474022 None] Deleting offline snapshot c8c5f838-071f-4fe9-8222-eaedce88b95a of volume 12d59ea4-66c6-42e6-ada6-44660b345b3d {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 12:28:50 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-a02ee5fa-7ad8-4144-aba6-583fafa7839a tempest-VolumesDeleteCascade-1812474022 None] snapshot_file for this snap is: volume-12d59ea4-66c6-42e6-ada6-44660b345b3d.c8c5f838-071f-4fe9-8222-eaedce88b95a {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 12:28:50 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5001aa48-f3ea-45dc-945e-2a1f3789c2ef]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:28:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a02ee5fa-7ad8-4144-aba6-583fafa7839a tempest-VolumesDeleteCascade-1812474022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-12d59ea4-66c6-42e6-ada6-44660b345b3d.c8c5f838-071f-4fe9-8222-eaedce88b95a {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:28:50 devstack sudo[106121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-12d59ea4-66c6-42e6-ada6-44660b345b3d.c8c5f838-071f-4fe9-8222-eaedce88b95a Nov 04 12:28:50 devstack sudo[106121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:28:51 devstack sudo[106121]: pam_unix(sudo:session): session closed for user root Nov 04 12:28:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a02ee5fa-7ad8-4144-aba6-583fafa7839a tempest-VolumesDeleteCascade-1812474022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-12d59ea4-66c6-42e6-ada6-44660b345b3d.c8c5f838-071f-4fe9-8222-eaedce88b95a" returned: 0 in 0.342s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:28:51 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-a02ee5fa-7ad8-4144-aba6-583fafa7839a tempest-VolumesDeleteCascade-1812474022 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12d59ea4-66c6-42e6-ada6-44660b345b3d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 12:28:51 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5e5180-c3a0-47eb-8a17-ee2b39a5152f]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:28:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a02ee5fa-7ad8-4144-aba6-583fafa7839a tempest-VolumesDeleteCascade-1812474022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-12d59ea4-66c6-42e6-ada6-44660b345b3d {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:28:51 devstack sudo[106127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-12d59ea4-66c6-42e6-ada6-44660b345b3d Nov 04 12:28:51 devstack sudo[106127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:28:51 devstack sudo[106127]: pam_unix(sudo:session): session closed for user root Nov 04 12:28:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a02ee5fa-7ad8-4144-aba6-583fafa7839a tempest-VolumesDeleteCascade-1812474022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-12d59ea4-66c6-42e6-ada6-44660b345b3d" returned: 0 in 0.509s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:28:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a02ee5fa-7ad8-4144-aba6-583fafa7839a tempest-VolumesDeleteCascade-1812474022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-12d59ea4-66c6-42e6-ada6-44660b345b3d.c8c5f838-071f-4fe9-8222-eaedce88b95a {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:28:51 devstack sudo[106132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-12d59ea4-66c6-42e6-ada6-44660b345b3d.c8c5f838-071f-4fe9-8222-eaedce88b95a Nov 04 12:28:51 devstack sudo[106132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:28:51 devstack sudo[106132]: pam_unix(sudo:session): session closed for user root Nov 04 12:28:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a02ee5fa-7ad8-4144-aba6-583fafa7839a tempest-VolumesDeleteCascade-1812474022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-12d59ea4-66c6-42e6-ada6-44660b345b3d.c8c5f838-071f-4fe9-8222-eaedce88b95a" returned: 0 in 0.319s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:28:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a02ee5fa-7ad8-4144-aba6-583fafa7839a tempest-VolumesDeleteCascade-1812474022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-12d59ea4-66c6-42e6-ada6-44660b345b3d.c8c5f838-071f-4fe9-8222-eaedce88b95a {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:28:51 devstack sudo[106137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-12d59ea4-66c6-42e6-ada6-44660b345b3d.c8c5f838-071f-4fe9-8222-eaedce88b95a Nov 04 12:28:51 devstack sudo[106137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:28:52 devstack sudo[106137]: pam_unix(sudo:session): session closed for user root Nov 04 12:28:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a02ee5fa-7ad8-4144-aba6-583fafa7839a tempest-VolumesDeleteCascade-1812474022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-12d59ea4-66c6-42e6-ada6-44660b345b3d.c8c5f838-071f-4fe9-8222-eaedce88b95a" returned: 0 in 0.233s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:28:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a02ee5fa-7ad8-4144-aba6-583fafa7839a tempest-VolumesDeleteCascade-1812474022 None] Lock "cinder-quobyte-c8c5f838-071f-4fe9-8222-eaedce88b95a" released by "_delete_snapshot" :: held 1.491s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:28:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a02ee5fa-7ad8-4144-aba6-583fafa7839a tempest-VolumesDeleteCascade-1812474022 None] Lock "cinder-quobyte-12d59ea4-66c6-42e6-ada6-44660b345b3d" released by "delete_snapshot" :: held 1.511s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:28:52 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-a02ee5fa-7ad8-4144-aba6-583fafa7839a tempest-VolumesDeleteCascade-1812474022 None] Created reservations ['e3bf07c1-25f4-4fae-a2bd-75432cb2e53e', '5d159372-7d7a-4191-949f-fb3b04e2576b', '3fe6b5c1-6c58-44c7-a6e5-6cee2d3b26da', '4172667a-0eee-4f1d-809f-90e0cd4ab132'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:28:52 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-a02ee5fa-7ad8-4144-aba6-583fafa7839a tempest-VolumesDeleteCascade-1812474022 None] Delete snapshot completed successfully. Nov 04 12:28:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a02ee5fa-7ad8-4144-aba6-583fafa7839a tempest-VolumesDeleteCascade-1812474022 None] Lock "cinder-c8c5f838-071f-4fe9-8222-eaedce88b95a-delete_snapshot" released by "delete_snapshot" :: held 1.652s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:28:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a02ee5fa-7ad8-4144-aba6-583fafa7839a tempest-VolumesDeleteCascade-1812474022 None] Snapshots deleted, issuing volume delete {{(pid=87095) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 04 12:28:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a02ee5fa-7ad8-4144-aba6-583fafa7839a tempest-VolumesDeleteCascade-1812474022 None] Acquiring lock "cinder-quobyte-12d59ea4-66c6-42e6-ada6-44660b345b3d" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:28:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a02ee5fa-7ad8-4144-aba6-583fafa7839a tempest-VolumesDeleteCascade-1812474022 None] Lock "cinder-quobyte-12d59ea4-66c6-42e6-ada6-44660b345b3d" acquired by "delete_volume" :: waited 0.012s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:28:52 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a14390a2-fa09-4c6e-b095-e0e6c852cf21]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:28:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a02ee5fa-7ad8-4144-aba6-583fafa7839a tempest-VolumesDeleteCascade-1812474022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-12d59ea4-66c6-42e6-ada6-44660b345b3d {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:28:52 devstack sudo[106140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-12d59ea4-66c6-42e6-ada6-44660b345b3d Nov 04 12:28:52 devstack sudo[106140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:28:52 devstack sudo[106140]: pam_unix(sudo:session): session closed for user root Nov 04 12:28:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a02ee5fa-7ad8-4144-aba6-583fafa7839a tempest-VolumesDeleteCascade-1812474022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-12d59ea4-66c6-42e6-ada6-44660b345b3d" returned: 0 in 0.358s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:28:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a02ee5fa-7ad8-4144-aba6-583fafa7839a tempest-VolumesDeleteCascade-1812474022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-12d59ea4-66c6-42e6-ada6-44660b345b3d {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:28:52 devstack sudo[106145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-12d59ea4-66c6-42e6-ada6-44660b345b3d Nov 04 12:28:52 devstack sudo[106145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:28:52 devstack sudo[106145]: pam_unix(sudo:session): session closed for user root Nov 04 12:28:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a02ee5fa-7ad8-4144-aba6-583fafa7839a tempest-VolumesDeleteCascade-1812474022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-12d59ea4-66c6-42e6-ada6-44660b345b3d" returned: 0 in 0.240s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:28:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a02ee5fa-7ad8-4144-aba6-583fafa7839a tempest-VolumesDeleteCascade-1812474022 None] Lock "cinder-quobyte-12d59ea4-66c6-42e6-ada6-44660b345b3d" released by "delete_volume" :: held 0.656s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:28:53 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-a02ee5fa-7ad8-4144-aba6-583fafa7839a tempest-VolumesDeleteCascade-1812474022 None] Created reservations ['08189520-2c3c-42cc-a0e4-a4f671c3193c', 'ad2e72fd-49f8-474e-9d80-b3ce8624250f', 'c0b8c4ed-1a6f-4f7d-bae3-87531b50bba6', '788fa6e9-796f-4043-abca-51c26945d3db'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:28:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a02ee5fa-7ad8-4144-aba6-583fafa7839a tempest-VolumesDeleteCascade-1812474022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:28:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a02ee5fa-7ad8-4144-aba6-583fafa7839a tempest-VolumesDeleteCascade-1812474022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:28:53 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a02ee5fa-7ad8-4144-aba6-583fafa7839a tempest-VolumesDeleteCascade-1812474022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:28:53 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a02ee5fa-7ad8-4144-aba6-583fafa7839a tempest-VolumesDeleteCascade-1812474022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:28:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a02ee5fa-7ad8-4144-aba6-583fafa7839a tempest-VolumesDeleteCascade-1812474022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:28:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a02ee5fa-7ad8-4144-aba6-583fafa7839a tempest-VolumesDeleteCascade-1812474022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:28:53 devstack sudo[106148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:28:53 devstack sudo[106148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:28:53 devstack sudo[106148]: pam_unix(sudo:session): session closed for user root Nov 04 12:28:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a02ee5fa-7ad8-4144-aba6-583fafa7839a tempest-VolumesDeleteCascade-1812474022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.242s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:28:53 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-a02ee5fa-7ad8-4144-aba6-583fafa7839a tempest-VolumesDeleteCascade-1812474022 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:28:53 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-a02ee5fa-7ad8-4144-aba6-583fafa7839a tempest-VolumesDeleteCascade-1812474022 None] Deleted volume successfully. Nov 04 12:28:53 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a02ee5fa-7ad8-4144-aba6-583fafa7839a tempest-VolumesDeleteCascade-1812474022 None] Lock "cinder-12d59ea4-66c6-42e6-ada6-44660b345b3d-delete_volume" released by "delete_volume" :: held 2.750s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:28:53 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-8b7f5c2f-aa76-41a3-8971-dc2aba2556be tempest-VolumesDeleteCascade-1812474022 None] Acquiring lock "cinder-9d095462-c67b-4990-996f-0a511601bc3d-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:28:53 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-8b7f5c2f-aa76-41a3-8971-dc2aba2556be tempest-VolumesDeleteCascade-1812474022 None] Lock "cinder-9d095462-c67b-4990-996f-0a511601bc3d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:28:54 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-8b7f5c2f-aa76-41a3-8971-dc2aba2556be tempest-VolumesDeleteCascade-1812474022 None] Acquiring lock "cinder-quobyte-9d095462-c67b-4990-996f-0a511601bc3d" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:28:54 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-8b7f5c2f-aa76-41a3-8971-dc2aba2556be tempest-VolumesDeleteCascade-1812474022 None] Lock "cinder-quobyte-9d095462-c67b-4990-996f-0a511601bc3d" acquired by "delete_volume" :: waited 0.013s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:28:54 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f40d7d-7320-45dc-8b20-8df8ba126ea0]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:28:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8b7f5c2f-aa76-41a3-8971-dc2aba2556be tempest-VolumesDeleteCascade-1812474022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9d095462-c67b-4990-996f-0a511601bc3d {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:28:54 devstack sudo[106152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9d095462-c67b-4990-996f-0a511601bc3d Nov 04 12:28:54 devstack sudo[106152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:28:54 devstack sudo[106152]: pam_unix(sudo:session): session closed for user root Nov 04 12:28:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8b7f5c2f-aa76-41a3-8971-dc2aba2556be tempest-VolumesDeleteCascade-1812474022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9d095462-c67b-4990-996f-0a511601bc3d" returned: 0 in 0.355s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:28:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8b7f5c2f-aa76-41a3-8971-dc2aba2556be tempest-VolumesDeleteCascade-1812474022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9d095462-c67b-4990-996f-0a511601bc3d {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:28:54 devstack sudo[106157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9d095462-c67b-4990-996f-0a511601bc3d Nov 04 12:28:54 devstack sudo[106157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:28:54 devstack sudo[106157]: pam_unix(sudo:session): session closed for user root Nov 04 12:28:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8b7f5c2f-aa76-41a3-8971-dc2aba2556be tempest-VolumesDeleteCascade-1812474022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9d095462-c67b-4990-996f-0a511601bc3d" returned: 0 in 0.248s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:28:54 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-8b7f5c2f-aa76-41a3-8971-dc2aba2556be tempest-VolumesDeleteCascade-1812474022 None] Lock "cinder-quobyte-9d095462-c67b-4990-996f-0a511601bc3d" released by "delete_volume" :: held 0.643s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:28:54 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-8b7f5c2f-aa76-41a3-8971-dc2aba2556be tempest-VolumesDeleteCascade-1812474022 None] Created reservations ['bc9472b6-0ce0-4d51-be20-753141670609', '006c3c4f-c8cc-413b-8a2e-b133f2ea612f', 'e1538df9-b812-4f33-8d68-024e7bc780c7', 'bceb8b45-928f-4b18-adcf-4aca7787ab86'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:28:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-8b7f5c2f-aa76-41a3-8971-dc2aba2556be tempest-VolumesDeleteCascade-1812474022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:28:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-8b7f5c2f-aa76-41a3-8971-dc2aba2556be tempest-VolumesDeleteCascade-1812474022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:28:54 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-8b7f5c2f-aa76-41a3-8971-dc2aba2556be tempest-VolumesDeleteCascade-1812474022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:28:54 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-8b7f5c2f-aa76-41a3-8971-dc2aba2556be tempest-VolumesDeleteCascade-1812474022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:28:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-8b7f5c2f-aa76-41a3-8971-dc2aba2556be tempest-VolumesDeleteCascade-1812474022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:28:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8b7f5c2f-aa76-41a3-8971-dc2aba2556be tempest-VolumesDeleteCascade-1812474022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:28:54 devstack sudo[106160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:28:54 devstack sudo[106160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:28:55 devstack sudo[106160]: pam_unix(sudo:session): session closed for user root Nov 04 12:28:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8b7f5c2f-aa76-41a3-8971-dc2aba2556be tempest-VolumesDeleteCascade-1812474022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.235s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:28:55 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-8b7f5c2f-aa76-41a3-8971-dc2aba2556be tempest-VolumesDeleteCascade-1812474022 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:28:55 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-8b7f5c2f-aa76-41a3-8971-dc2aba2556be tempest-VolumesDeleteCascade-1812474022 None] Deleted volume successfully. Nov 04 12:28:55 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-8b7f5c2f-aa76-41a3-8971-dc2aba2556be tempest-VolumesDeleteCascade-1812474022 None] Lock "cinder-9d095462-c67b-4990-996f-0a511601bc3d-delete_volume" released by "delete_volume" :: held 1.061s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:29:01 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fc5d1c7-0a91-4716-b4fa-9ea822fd091f tempest-VolumesListTestJSON-834052618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:29:01 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4fc5d1c7-0a91-4716-b4fa-9ea822fd091f tempest-VolumesListTestJSON-834052618 None] Flow 'volume_create_manager' (b697aea6-4d9c-4896-b52b-86c89e4e59ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:29:01 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4fc5d1c7-0a91-4716-b4fa-9ea822fd091f tempest-VolumesListTestJSON-834052618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a15bc0e9-eb02-4e2e-b965-59d0461e6662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:29:01 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4fc5d1c7-0a91-4716-b4fa-9ea822fd091f tempest-VolumesListTestJSON-834052618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a15bc0e9-eb02-4e2e-b965-59d0461e6662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:29:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-962939665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afcf49f0-4737-4b94-bb2c-394b90f4449e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2db3ce27057f4a52ad388b00b0bb2733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:29:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:29:01Z,use_quota=True,user_id='911abbf4d053482eae3b33be6e55185e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:29:01 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4fc5d1c7-0a91-4716-b4fa-9ea822fd091f tempest-VolumesListTestJSON-834052618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a656554-3b91-4550-aeb3-d44d478fff10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:29:01 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4fc5d1c7-0a91-4716-b4fa-9ea822fd091f tempest-VolumesListTestJSON-834052618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a656554-3b91-4550-aeb3-d44d478fff10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:29:01 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4fc5d1c7-0a91-4716-b4fa-9ea822fd091f tempest-VolumesListTestJSON-834052618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bab038ce-e6d9-49c5-88d6-7bf14ef6ec2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:29:01 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4fc5d1c7-0a91-4716-b4fa-9ea822fd091f tempest-VolumesListTestJSON-834052618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bab038ce-e6d9-49c5-88d6-7bf14ef6ec2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afcf49f0-4737-4b94-bb2c-394b90f4449e', 'volume_name': 'volume-afcf49f0-4737-4b94-bb2c-394b90f4449e', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:29:01 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4fc5d1c7-0a91-4716-b4fa-9ea822fd091f tempest-VolumesListTestJSON-834052618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2509e61f-7bcc-453f-b7ce-35fb5ecfea85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:29:01 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4fc5d1c7-0a91-4716-b4fa-9ea822fd091f tempest-VolumesListTestJSON-834052618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2509e61f-7bcc-453f-b7ce-35fb5ecfea85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:29:01 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4fc5d1c7-0a91-4716-b4fa-9ea822fd091f tempest-VolumesListTestJSON-834052618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d2aaee6-cd14-4322-918c-c941b074106d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:29:01 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-4fc5d1c7-0a91-4716-b4fa-9ea822fd091f tempest-VolumesListTestJSON-834052618 None] Volume afcf49f0-4737-4b94-bb2c-394b90f4449e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afcf49f0-4737-4b94-bb2c-394b90f4449e', 'volume_size': 1} Nov 04 12:29:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4fc5d1c7-0a91-4716-b4fa-9ea822fd091f tempest-VolumesListTestJSON-834052618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:29:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4fc5d1c7-0a91-4716-b4fa-9ea822fd091f tempest-VolumesListTestJSON-834052618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:29:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4fc5d1c7-0a91-4716-b4fa-9ea822fd091f tempest-VolumesListTestJSON-834052618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:29:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-962939665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afcf49f0-4737-4b94-bb2c-394b90f4449e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2db3ce27057f4a52ad388b00b0bb2733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:29:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:29:01Z,use_quota=True,user_id='911abbf4d053482eae3b33be6e55185e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:29:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-4fc5d1c7-0a91-4716-b4fa-9ea822fd091f tempest-VolumesListTestJSON-834052618 None] Creating volume afcf49f0-4737-4b94-bb2c-394b90f4449e {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:29:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4fc5d1c7-0a91-4716-b4fa-9ea822fd091f tempest-VolumesListTestJSON-834052618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:29:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4fc5d1c7-0a91-4716-b4fa-9ea822fd091f tempest-VolumesListTestJSON-834052618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:29:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4fc5d1c7-0a91-4716-b4fa-9ea822fd091f tempest-VolumesListTestJSON-834052618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:29:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4fc5d1c7-0a91-4716-b4fa-9ea822fd091f tempest-VolumesListTestJSON-834052618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:29:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4fc5d1c7-0a91-4716-b4fa-9ea822fd091f tempest-VolumesListTestJSON-834052618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:29:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4fc5d1c7-0a91-4716-b4fa-9ea822fd091f tempest-VolumesListTestJSON-834052618 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:29:01 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-4fc5d1c7-0a91-4716-b4fa-9ea822fd091f tempest-VolumesListTestJSON-834052618 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:29:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4fc5d1c7-0a91-4716-b4fa-9ea822fd091f tempest-VolumesListTestJSON-834052618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-afcf49f0-4737-4b94-bb2c-394b90f4449e 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:29:01 devstack sudo[106170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-afcf49f0-4737-4b94-bb2c-394b90f4449e 1073741824 Nov 04 12:29:01 devstack sudo[106170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:29:01 devstack sudo[106170]: pam_unix(sudo:session): session closed for user root Nov 04 12:29:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4fc5d1c7-0a91-4716-b4fa-9ea822fd091f tempest-VolumesListTestJSON-834052618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-afcf49f0-4737-4b94-bb2c-394b90f4449e 1073741824" returned: 0 in 0.429s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:29:01 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 12:29:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:29:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:29:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:29:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:29:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:29:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:29:01 devstack sudo[106175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:29:01 devstack sudo[106175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:29:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4fc5d1c7-0a91-4716-b4fa-9ea822fd091f tempest-VolumesListTestJSON-834052618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-afcf49f0-4737-4b94-bb2c-394b90f4449e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:29:01 devstack sudo[106177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-afcf49f0-4737-4b94-bb2c-394b90f4449e Nov 04 12:29:01 devstack sudo[106177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:29:02 devstack sudo[106175]: pam_unix(sudo:session): session closed for user root Nov 04 12:29:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.252s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:29:02 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:29:02 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Running periodic task VolumeManager._thread_info {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 12:29:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] thread count: 28 {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 12:29:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] thread info: [<_MainThread(MainThread, started 140610387472512)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 12:29:02 devstack sudo[106177]: pam_unix(sudo:session): session closed for user root Nov 04 12:29:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4fc5d1c7-0a91-4716-b4fa-9ea822fd091f tempest-VolumesListTestJSON-834052618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-afcf49f0-4737-4b94-bb2c-394b90f4449e" returned: 0 in 0.246s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:29:02 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4fc5d1c7-0a91-4716-b4fa-9ea822fd091f tempest-VolumesListTestJSON-834052618 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:29:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4fc5d1c7-0a91-4716-b4fa-9ea822fd091f tempest-VolumesListTestJSON-834052618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:29:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4fc5d1c7-0a91-4716-b4fa-9ea822fd091f tempest-VolumesListTestJSON-834052618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d2aaee6-cd14-4322-918c-c941b074106d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afcf49f0-4737-4b94-bb2c-394b90f4449e', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:29:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4fc5d1c7-0a91-4716-b4fa-9ea822fd091f tempest-VolumesListTestJSON-834052618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (624716fa-e37b-4872-97fb-c4f36b21792a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:29:02 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-4fc5d1c7-0a91-4716-b4fa-9ea822fd091f tempest-VolumesListTestJSON-834052618 None] Volume volume-afcf49f0-4737-4b94-bb2c-394b90f4449e (afcf49f0-4737-4b94-bb2c-394b90f4449e): created successfully Nov 04 12:29:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4fc5d1c7-0a91-4716-b4fa-9ea822fd091f tempest-VolumesListTestJSON-834052618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (624716fa-e37b-4872-97fb-c4f36b21792a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:29:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4fc5d1c7-0a91-4716-b4fa-9ea822fd091f tempest-VolumesListTestJSON-834052618 None] Flow 'volume_create_manager' (b697aea6-4d9c-4896-b52b-86c89e4e59ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:29:02 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-4fc5d1c7-0a91-4716-b4fa-9ea822fd091f tempest-VolumesListTestJSON-834052618 None] Created volume successfully. Nov 04 12:29:02 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-022ab93e-5af2-43f4-85b2-2707e4f1c99d tempest-VolumesListTestJSON-834052618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:29:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-022ab93e-5af2-43f4-85b2-2707e4f1c99d tempest-VolumesListTestJSON-834052618 None] Flow 'volume_create_manager' (118bfccf-70bd-4966-9e89-0ac306d4db85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:29:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-022ab93e-5af2-43f4-85b2-2707e4f1c99d tempest-VolumesListTestJSON-834052618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c95c9cda-90ee-4336-98d1-5039a76a2155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:29:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-022ab93e-5af2-43f4-85b2-2707e4f1c99d tempest-VolumesListTestJSON-834052618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c95c9cda-90ee-4336-98d1-5039a76a2155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:29:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-732709952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78c0a0df-2a8f-4786-8c54-63839b828a5f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2db3ce27057f4a52ad388b00b0bb2733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:29:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:29:03Z,use_quota=True,user_id='911abbf4d053482eae3b33be6e55185e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:29:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-022ab93e-5af2-43f4-85b2-2707e4f1c99d tempest-VolumesListTestJSON-834052618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af555f78-44ed-4287-a216-7318073a9a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:29:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-022ab93e-5af2-43f4-85b2-2707e4f1c99d tempest-VolumesListTestJSON-834052618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af555f78-44ed-4287-a216-7318073a9a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:29:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-022ab93e-5af2-43f4-85b2-2707e4f1c99d tempest-VolumesListTestJSON-834052618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17491810-f127-4adb-818d-8623bccba02c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:29:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-022ab93e-5af2-43f4-85b2-2707e4f1c99d tempest-VolumesListTestJSON-834052618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17491810-f127-4adb-818d-8623bccba02c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78c0a0df-2a8f-4786-8c54-63839b828a5f', 'volume_name': 'volume-78c0a0df-2a8f-4786-8c54-63839b828a5f', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:29:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-022ab93e-5af2-43f4-85b2-2707e4f1c99d tempest-VolumesListTestJSON-834052618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8afa2800-2155-4526-8e02-1298c06887d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:29:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-022ab93e-5af2-43f4-85b2-2707e4f1c99d tempest-VolumesListTestJSON-834052618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8afa2800-2155-4526-8e02-1298c06887d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:29:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-022ab93e-5af2-43f4-85b2-2707e4f1c99d tempest-VolumesListTestJSON-834052618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cb86c7d-7920-43fe-b109-8edc9ff129a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:29:02 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-022ab93e-5af2-43f4-85b2-2707e4f1c99d tempest-VolumesListTestJSON-834052618 None] Volume 78c0a0df-2a8f-4786-8c54-63839b828a5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78c0a0df-2a8f-4786-8c54-63839b828a5f', 'volume_size': 1} Nov 04 12:29:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-022ab93e-5af2-43f4-85b2-2707e4f1c99d tempest-VolumesListTestJSON-834052618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:29:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-022ab93e-5af2-43f4-85b2-2707e4f1c99d tempest-VolumesListTestJSON-834052618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:29:02 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-022ab93e-5af2-43f4-85b2-2707e4f1c99d tempest-VolumesListTestJSON-834052618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:29:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-732709952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78c0a0df-2a8f-4786-8c54-63839b828a5f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2db3ce27057f4a52ad388b00b0bb2733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:29:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:29:03Z,use_quota=True,user_id='911abbf4d053482eae3b33be6e55185e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:29:03 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-022ab93e-5af2-43f4-85b2-2707e4f1c99d tempest-VolumesListTestJSON-834052618 None] Creating volume 78c0a0df-2a8f-4786-8c54-63839b828a5f {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:29:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-022ab93e-5af2-43f4-85b2-2707e4f1c99d tempest-VolumesListTestJSON-834052618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:29:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-022ab93e-5af2-43f4-85b2-2707e4f1c99d tempest-VolumesListTestJSON-834052618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:29:03 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-022ab93e-5af2-43f4-85b2-2707e4f1c99d tempest-VolumesListTestJSON-834052618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:29:03 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-022ab93e-5af2-43f4-85b2-2707e4f1c99d tempest-VolumesListTestJSON-834052618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:29:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-022ab93e-5af2-43f4-85b2-2707e4f1c99d tempest-VolumesListTestJSON-834052618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:29:03 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-022ab93e-5af2-43f4-85b2-2707e4f1c99d tempest-VolumesListTestJSON-834052618 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:29:03 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-022ab93e-5af2-43f4-85b2-2707e4f1c99d tempest-VolumesListTestJSON-834052618 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:29:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-022ab93e-5af2-43f4-85b2-2707e4f1c99d tempest-VolumesListTestJSON-834052618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-78c0a0df-2a8f-4786-8c54-63839b828a5f 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:29:03 devstack sudo[106181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-78c0a0df-2a8f-4786-8c54-63839b828a5f 1073741824 Nov 04 12:29:03 devstack sudo[106181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:29:03 devstack sudo[106181]: pam_unix(sudo:session): session closed for user root Nov 04 12:29:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-022ab93e-5af2-43f4-85b2-2707e4f1c99d tempest-VolumesListTestJSON-834052618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-78c0a0df-2a8f-4786-8c54-63839b828a5f 1073741824" returned: 0 in 0.410s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:29:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-022ab93e-5af2-43f4-85b2-2707e4f1c99d tempest-VolumesListTestJSON-834052618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-78c0a0df-2a8f-4786-8c54-63839b828a5f {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:29:03 devstack sudo[106187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-78c0a0df-2a8f-4786-8c54-63839b828a5f Nov 04 12:29:03 devstack sudo[106187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:29:03 devstack sudo[106187]: pam_unix(sudo:session): session closed for user root Nov 04 12:29:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-022ab93e-5af2-43f4-85b2-2707e4f1c99d tempest-VolumesListTestJSON-834052618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-78c0a0df-2a8f-4786-8c54-63839b828a5f" returned: 0 in 0.254s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:29:03 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-022ab93e-5af2-43f4-85b2-2707e4f1c99d tempest-VolumesListTestJSON-834052618 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:29:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-022ab93e-5af2-43f4-85b2-2707e4f1c99d tempest-VolumesListTestJSON-834052618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:29:03 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-022ab93e-5af2-43f4-85b2-2707e4f1c99d tempest-VolumesListTestJSON-834052618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cb86c7d-7920-43fe-b109-8edc9ff129a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78c0a0df-2a8f-4786-8c54-63839b828a5f', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:29:03 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-022ab93e-5af2-43f4-85b2-2707e4f1c99d tempest-VolumesListTestJSON-834052618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a262586-be0a-4673-b953-c2afe5434360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:29:03 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-022ab93e-5af2-43f4-85b2-2707e4f1c99d tempest-VolumesListTestJSON-834052618 None] Volume volume-78c0a0df-2a8f-4786-8c54-63839b828a5f (78c0a0df-2a8f-4786-8c54-63839b828a5f): created successfully Nov 04 12:29:03 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-022ab93e-5af2-43f4-85b2-2707e4f1c99d tempest-VolumesListTestJSON-834052618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a262586-be0a-4673-b953-c2afe5434360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:29:03 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-022ab93e-5af2-43f4-85b2-2707e4f1c99d tempest-VolumesListTestJSON-834052618 None] Flow 'volume_create_manager' (118bfccf-70bd-4966-9e89-0ac306d4db85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:29:03 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-022ab93e-5af2-43f4-85b2-2707e4f1c99d tempest-VolumesListTestJSON-834052618 None] Created volume successfully. Nov 04 12:29:04 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-97e30906-d2dd-427d-b0af-4b123eddaf47 tempest-VolumesListTestJSON-834052618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:29:04 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-97e30906-d2dd-427d-b0af-4b123eddaf47 tempest-VolumesListTestJSON-834052618 None] Flow 'volume_create_manager' (b209d1fb-2e51-4547-9319-79f91f0fcf7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:29:04 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-97e30906-d2dd-427d-b0af-4b123eddaf47 tempest-VolumesListTestJSON-834052618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5a8893a-6dbc-48e8-9817-13082e77d24b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:29:04 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-97e30906-d2dd-427d-b0af-4b123eddaf47 tempest-VolumesListTestJSON-834052618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5a8893a-6dbc-48e8-9817-13082e77d24b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:29:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-539330064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c45c9b2b-af33-4ff9-9bad-febfc65bf407,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2db3ce27057f4a52ad388b00b0bb2733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:29:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:29:04Z,use_quota=True,user_id='911abbf4d053482eae3b33be6e55185e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:29:04 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-97e30906-d2dd-427d-b0af-4b123eddaf47 tempest-VolumesListTestJSON-834052618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8bf9d23-f895-46cf-9c64-56fe4aa97bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:29:04 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-97e30906-d2dd-427d-b0af-4b123eddaf47 tempest-VolumesListTestJSON-834052618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8bf9d23-f895-46cf-9c64-56fe4aa97bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:29:04 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-97e30906-d2dd-427d-b0af-4b123eddaf47 tempest-VolumesListTestJSON-834052618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff94820b-75c1-4dac-a250-e4f484db7e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:29:04 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-97e30906-d2dd-427d-b0af-4b123eddaf47 tempest-VolumesListTestJSON-834052618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff94820b-75c1-4dac-a250-e4f484db7e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c45c9b2b-af33-4ff9-9bad-febfc65bf407', 'volume_name': 'volume-c45c9b2b-af33-4ff9-9bad-febfc65bf407', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:29:04 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-97e30906-d2dd-427d-b0af-4b123eddaf47 tempest-VolumesListTestJSON-834052618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ca20a1a-8910-4e86-bac6-68e08cbdab5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:29:04 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-97e30906-d2dd-427d-b0af-4b123eddaf47 tempest-VolumesListTestJSON-834052618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ca20a1a-8910-4e86-bac6-68e08cbdab5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:29:04 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-97e30906-d2dd-427d-b0af-4b123eddaf47 tempest-VolumesListTestJSON-834052618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9602dd49-2843-463b-8312-7b08c832d3d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:29:04 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-97e30906-d2dd-427d-b0af-4b123eddaf47 tempest-VolumesListTestJSON-834052618 None] Volume c45c9b2b-af33-4ff9-9bad-febfc65bf407: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c45c9b2b-af33-4ff9-9bad-febfc65bf407', 'volume_size': 1} Nov 04 12:29:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-97e30906-d2dd-427d-b0af-4b123eddaf47 tempest-VolumesListTestJSON-834052618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:29:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-97e30906-d2dd-427d-b0af-4b123eddaf47 tempest-VolumesListTestJSON-834052618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:29:04 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-97e30906-d2dd-427d-b0af-4b123eddaf47 tempest-VolumesListTestJSON-834052618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:29:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-539330064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c45c9b2b-af33-4ff9-9bad-febfc65bf407,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2db3ce27057f4a52ad388b00b0bb2733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:29:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:29:04Z,use_quota=True,user_id='911abbf4d053482eae3b33be6e55185e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:29:04 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-97e30906-d2dd-427d-b0af-4b123eddaf47 tempest-VolumesListTestJSON-834052618 None] Creating volume c45c9b2b-af33-4ff9-9bad-febfc65bf407 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:29:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-97e30906-d2dd-427d-b0af-4b123eddaf47 tempest-VolumesListTestJSON-834052618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:29:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-97e30906-d2dd-427d-b0af-4b123eddaf47 tempest-VolumesListTestJSON-834052618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:29:04 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-97e30906-d2dd-427d-b0af-4b123eddaf47 tempest-VolumesListTestJSON-834052618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:29:04 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-97e30906-d2dd-427d-b0af-4b123eddaf47 tempest-VolumesListTestJSON-834052618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:29:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-97e30906-d2dd-427d-b0af-4b123eddaf47 tempest-VolumesListTestJSON-834052618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:29:04 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-97e30906-d2dd-427d-b0af-4b123eddaf47 tempest-VolumesListTestJSON-834052618 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:29:04 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-97e30906-d2dd-427d-b0af-4b123eddaf47 tempest-VolumesListTestJSON-834052618 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:29:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-97e30906-d2dd-427d-b0af-4b123eddaf47 tempest-VolumesListTestJSON-834052618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c45c9b2b-af33-4ff9-9bad-febfc65bf407 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:29:04 devstack sudo[106190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c45c9b2b-af33-4ff9-9bad-febfc65bf407 1073741824 Nov 04 12:29:04 devstack sudo[106190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:29:04 devstack sudo[106190]: pam_unix(sudo:session): session closed for user root Nov 04 12:29:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-97e30906-d2dd-427d-b0af-4b123eddaf47 tempest-VolumesListTestJSON-834052618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c45c9b2b-af33-4ff9-9bad-febfc65bf407 1073741824" returned: 0 in 0.417s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:29:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-97e30906-d2dd-427d-b0af-4b123eddaf47 tempest-VolumesListTestJSON-834052618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c45c9b2b-af33-4ff9-9bad-febfc65bf407 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:29:04 devstack sudo[106196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c45c9b2b-af33-4ff9-9bad-febfc65bf407 Nov 04 12:29:04 devstack sudo[106196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:29:05 devstack sudo[106196]: pam_unix(sudo:session): session closed for user root Nov 04 12:29:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-97e30906-d2dd-427d-b0af-4b123eddaf47 tempest-VolumesListTestJSON-834052618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c45c9b2b-af33-4ff9-9bad-febfc65bf407" returned: 0 in 0.255s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:29:05 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-97e30906-d2dd-427d-b0af-4b123eddaf47 tempest-VolumesListTestJSON-834052618 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:29:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-97e30906-d2dd-427d-b0af-4b123eddaf47 tempest-VolumesListTestJSON-834052618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.717s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:29:05 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-97e30906-d2dd-427d-b0af-4b123eddaf47 tempest-VolumesListTestJSON-834052618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9602dd49-2843-463b-8312-7b08c832d3d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c45c9b2b-af33-4ff9-9bad-febfc65bf407', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:29:05 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-97e30906-d2dd-427d-b0af-4b123eddaf47 tempest-VolumesListTestJSON-834052618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3ed588a-8541-45e0-be6a-3167a9a624fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:29:05 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-97e30906-d2dd-427d-b0af-4b123eddaf47 tempest-VolumesListTestJSON-834052618 None] Volume volume-c45c9b2b-af33-4ff9-9bad-febfc65bf407 (c45c9b2b-af33-4ff9-9bad-febfc65bf407): created successfully Nov 04 12:29:05 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-97e30906-d2dd-427d-b0af-4b123eddaf47 tempest-VolumesListTestJSON-834052618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3ed588a-8541-45e0-be6a-3167a9a624fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:29:05 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-97e30906-d2dd-427d-b0af-4b123eddaf47 tempest-VolumesListTestJSON-834052618 None] Flow 'volume_create_manager' (b209d1fb-2e51-4547-9319-79f91f0fcf7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:29:05 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-97e30906-d2dd-427d-b0af-4b123eddaf47 tempest-VolumesListTestJSON-834052618 None] Created volume successfully. Nov 04 12:29:07 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-4fbb6dda-c64d-41bd-950d-964fac90f5e6 tempest-VolumesListTestJSON-834052618 None] Acquiring lock "cinder-c45c9b2b-af33-4ff9-9bad-febfc65bf407-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:29:07 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-4fbb6dda-c64d-41bd-950d-964fac90f5e6 tempest-VolumesListTestJSON-834052618 None] Lock "cinder-c45c9b2b-af33-4ff9-9bad-febfc65bf407-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:29:07 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-4fbb6dda-c64d-41bd-950d-964fac90f5e6 tempest-VolumesListTestJSON-834052618 None] Acquiring lock "cinder-quobyte-c45c9b2b-af33-4ff9-9bad-febfc65bf407" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:29:07 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-4fbb6dda-c64d-41bd-950d-964fac90f5e6 tempest-VolumesListTestJSON-834052618 None] Lock "cinder-quobyte-c45c9b2b-af33-4ff9-9bad-febfc65bf407" acquired by "delete_volume" :: waited 0.016s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:29:07 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7bba884-c489-4d32-b377-157cb14c04c6]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:29:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4fbb6dda-c64d-41bd-950d-964fac90f5e6 tempest-VolumesListTestJSON-834052618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c45c9b2b-af33-4ff9-9bad-febfc65bf407 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:29:07 devstack sudo[106199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c45c9b2b-af33-4ff9-9bad-febfc65bf407 Nov 04 12:29:07 devstack sudo[106199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:29:07 devstack sudo[106199]: pam_unix(sudo:session): session closed for user root Nov 04 12:29:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4fbb6dda-c64d-41bd-950d-964fac90f5e6 tempest-VolumesListTestJSON-834052618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c45c9b2b-af33-4ff9-9bad-febfc65bf407" returned: 0 in 0.344s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:29:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4fbb6dda-c64d-41bd-950d-964fac90f5e6 tempest-VolumesListTestJSON-834052618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c45c9b2b-af33-4ff9-9bad-febfc65bf407 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:29:07 devstack sudo[106204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c45c9b2b-af33-4ff9-9bad-febfc65bf407 Nov 04 12:29:07 devstack sudo[106204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:29:08 devstack sudo[106204]: pam_unix(sudo:session): session closed for user root Nov 04 12:29:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4fbb6dda-c64d-41bd-950d-964fac90f5e6 tempest-VolumesListTestJSON-834052618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c45c9b2b-af33-4ff9-9bad-febfc65bf407" returned: 0 in 0.240s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:29:08 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-4fbb6dda-c64d-41bd-950d-964fac90f5e6 tempest-VolumesListTestJSON-834052618 None] Lock "cinder-quobyte-c45c9b2b-af33-4ff9-9bad-febfc65bf407" released by "delete_volume" :: held 0.627s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:29:08 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-4fbb6dda-c64d-41bd-950d-964fac90f5e6 tempest-VolumesListTestJSON-834052618 None] Created reservations ['206e0208-59c3-4dae-963f-8f7267aadf59', '39cd69f8-eaa8-4ce4-982c-1acac405f919', '9b33e544-017f-4d68-8490-1d0311776ca5', 'df3a5954-51e5-42ab-8654-ec5f517c59b2'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:29:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4fbb6dda-c64d-41bd-950d-964fac90f5e6 tempest-VolumesListTestJSON-834052618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:29:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4fbb6dda-c64d-41bd-950d-964fac90f5e6 tempest-VolumesListTestJSON-834052618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:29:08 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4fbb6dda-c64d-41bd-950d-964fac90f5e6 tempest-VolumesListTestJSON-834052618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:29:08 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4fbb6dda-c64d-41bd-950d-964fac90f5e6 tempest-VolumesListTestJSON-834052618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:29:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4fbb6dda-c64d-41bd-950d-964fac90f5e6 tempest-VolumesListTestJSON-834052618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:29:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4fbb6dda-c64d-41bd-950d-964fac90f5e6 tempest-VolumesListTestJSON-834052618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:29:08 devstack sudo[106207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:29:08 devstack sudo[106207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:29:08 devstack sudo[106207]: pam_unix(sudo:session): session closed for user root Nov 04 12:29:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4fbb6dda-c64d-41bd-950d-964fac90f5e6 tempest-VolumesListTestJSON-834052618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.231s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:29:08 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-4fbb6dda-c64d-41bd-950d-964fac90f5e6 tempest-VolumesListTestJSON-834052618 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:29:08 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-4fbb6dda-c64d-41bd-950d-964fac90f5e6 tempest-VolumesListTestJSON-834052618 None] Deleted volume successfully. Nov 04 12:29:08 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-4fbb6dda-c64d-41bd-950d-964fac90f5e6 tempest-VolumesListTestJSON-834052618 None] Lock "cinder-c45c9b2b-af33-4ff9-9bad-febfc65bf407-delete_volume" released by "delete_volume" :: held 1.038s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:29:08 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-2461e508-70b8-455c-864b-e57fa0de6c8a tempest-VolumesListTestJSON-834052618 None] Acquiring lock "cinder-78c0a0df-2a8f-4786-8c54-63839b828a5f-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:29:08 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-2461e508-70b8-455c-864b-e57fa0de6c8a tempest-VolumesListTestJSON-834052618 None] Lock "cinder-78c0a0df-2a8f-4786-8c54-63839b828a5f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:29:08 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-2461e508-70b8-455c-864b-e57fa0de6c8a tempest-VolumesListTestJSON-834052618 None] Acquiring lock "cinder-quobyte-78c0a0df-2a8f-4786-8c54-63839b828a5f" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:29:08 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-2461e508-70b8-455c-864b-e57fa0de6c8a tempest-VolumesListTestJSON-834052618 None] Lock "cinder-quobyte-78c0a0df-2a8f-4786-8c54-63839b828a5f" acquired by "delete_volume" :: waited 0.015s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:29:08 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc60911a-9afb-4dd8-beec-ce9ec780f95e]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:29:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2461e508-70b8-455c-864b-e57fa0de6c8a tempest-VolumesListTestJSON-834052618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-78c0a0df-2a8f-4786-8c54-63839b828a5f {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:29:08 devstack sudo[106210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-78c0a0df-2a8f-4786-8c54-63839b828a5f Nov 04 12:29:08 devstack sudo[106210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:29:08 devstack sudo[106210]: pam_unix(sudo:session): session closed for user root Nov 04 12:29:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2461e508-70b8-455c-864b-e57fa0de6c8a tempest-VolumesListTestJSON-834052618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-78c0a0df-2a8f-4786-8c54-63839b828a5f" returned: 0 in 0.347s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:29:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2461e508-70b8-455c-864b-e57fa0de6c8a tempest-VolumesListTestJSON-834052618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-78c0a0df-2a8f-4786-8c54-63839b828a5f {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:29:08 devstack sudo[106215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-78c0a0df-2a8f-4786-8c54-63839b828a5f Nov 04 12:29:08 devstack sudo[106215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:29:09 devstack sudo[106215]: pam_unix(sudo:session): session closed for user root Nov 04 12:29:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2461e508-70b8-455c-864b-e57fa0de6c8a tempest-VolumesListTestJSON-834052618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-78c0a0df-2a8f-4786-8c54-63839b828a5f" returned: 0 in 0.239s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:29:09 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-2461e508-70b8-455c-864b-e57fa0de6c8a tempest-VolumesListTestJSON-834052618 None] Lock "cinder-quobyte-78c0a0df-2a8f-4786-8c54-63839b828a5f" released by "delete_volume" :: held 0.632s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:29:09 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-2461e508-70b8-455c-864b-e57fa0de6c8a tempest-VolumesListTestJSON-834052618 None] Created reservations ['6dadf451-fa4a-4765-89d3-1e2fe7ddc726', '9e4f22ae-649c-49c6-af10-be1c0c62c99b', 'a0f3d92b-70c1-4d1e-aac5-e991f0373bce', 'a356239a-511a-4ed6-889c-43df01c53717'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:29:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2461e508-70b8-455c-864b-e57fa0de6c8a tempest-VolumesListTestJSON-834052618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:29:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2461e508-70b8-455c-864b-e57fa0de6c8a tempest-VolumesListTestJSON-834052618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:29:09 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2461e508-70b8-455c-864b-e57fa0de6c8a tempest-VolumesListTestJSON-834052618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:29:09 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2461e508-70b8-455c-864b-e57fa0de6c8a tempest-VolumesListTestJSON-834052618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:29:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2461e508-70b8-455c-864b-e57fa0de6c8a tempest-VolumesListTestJSON-834052618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:29:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2461e508-70b8-455c-864b-e57fa0de6c8a tempest-VolumesListTestJSON-834052618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:29:09 devstack sudo[106218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:29:09 devstack sudo[106218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:29:09 devstack sudo[106218]: pam_unix(sudo:session): session closed for user root Nov 04 12:29:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2461e508-70b8-455c-864b-e57fa0de6c8a tempest-VolumesListTestJSON-834052618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.245s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:29:09 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-2461e508-70b8-455c-864b-e57fa0de6c8a tempest-VolumesListTestJSON-834052618 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:29:09 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-2461e508-70b8-455c-864b-e57fa0de6c8a tempest-VolumesListTestJSON-834052618 None] Deleted volume successfully. Nov 04 12:29:09 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-2461e508-70b8-455c-864b-e57fa0de6c8a tempest-VolumesListTestJSON-834052618 None] Lock "cinder-78c0a0df-2a8f-4786-8c54-63839b828a5f-delete_volume" released by "delete_volume" :: held 1.094s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:29:09 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-78d8551d-0b5d-4c5c-a898-0ed80236f183 tempest-VolumesListTestJSON-834052618 None] Acquiring lock "cinder-afcf49f0-4737-4b94-bb2c-394b90f4449e-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:29:09 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-78d8551d-0b5d-4c5c-a898-0ed80236f183 tempest-VolumesListTestJSON-834052618 None] Lock "cinder-afcf49f0-4737-4b94-bb2c-394b90f4449e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:29:09 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-78d8551d-0b5d-4c5c-a898-0ed80236f183 tempest-VolumesListTestJSON-834052618 None] Acquiring lock "cinder-quobyte-afcf49f0-4737-4b94-bb2c-394b90f4449e" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:29:09 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-78d8551d-0b5d-4c5c-a898-0ed80236f183 tempest-VolumesListTestJSON-834052618 None] Lock "cinder-quobyte-afcf49f0-4737-4b94-bb2c-394b90f4449e" acquired by "delete_volume" :: waited 0.017s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:29:09 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c013acbc-72a6-425e-b003-0a0b39abdc37]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:29:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-78d8551d-0b5d-4c5c-a898-0ed80236f183 tempest-VolumesListTestJSON-834052618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-afcf49f0-4737-4b94-bb2c-394b90f4449e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:29:09 devstack sudo[106221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-afcf49f0-4737-4b94-bb2c-394b90f4449e Nov 04 12:29:09 devstack sudo[106221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:29:10 devstack sudo[106221]: pam_unix(sudo:session): session closed for user root Nov 04 12:29:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-78d8551d-0b5d-4c5c-a898-0ed80236f183 tempest-VolumesListTestJSON-834052618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-afcf49f0-4737-4b94-bb2c-394b90f4449e" returned: 0 in 0.359s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:29:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-78d8551d-0b5d-4c5c-a898-0ed80236f183 tempest-VolumesListTestJSON-834052618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-afcf49f0-4737-4b94-bb2c-394b90f4449e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:29:10 devstack sudo[106226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-afcf49f0-4737-4b94-bb2c-394b90f4449e Nov 04 12:29:10 devstack sudo[106226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:29:10 devstack sudo[106226]: pam_unix(sudo:session): session closed for user root Nov 04 12:29:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-78d8551d-0b5d-4c5c-a898-0ed80236f183 tempest-VolumesListTestJSON-834052618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-afcf49f0-4737-4b94-bb2c-394b90f4449e" returned: 0 in 0.244s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:29:10 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-78d8551d-0b5d-4c5c-a898-0ed80236f183 tempest-VolumesListTestJSON-834052618 None] Lock "cinder-quobyte-afcf49f0-4737-4b94-bb2c-394b90f4449e" released by "delete_volume" :: held 0.644s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:29:10 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-78d8551d-0b5d-4c5c-a898-0ed80236f183 tempest-VolumesListTestJSON-834052618 None] Created reservations ['43f20fd1-0d85-4a08-b5d5-2e53af783f64', 'd9309c8a-bd3f-474b-a0c1-05e89ed8f518', '3dae9ddd-8dee-4338-a14d-d7eadb23e585', '11bd0a5e-cd78-4308-b84d-a416227a0a0f'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:29:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-78d8551d-0b5d-4c5c-a898-0ed80236f183 tempest-VolumesListTestJSON-834052618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:29:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-78d8551d-0b5d-4c5c-a898-0ed80236f183 tempest-VolumesListTestJSON-834052618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:29:10 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-78d8551d-0b5d-4c5c-a898-0ed80236f183 tempest-VolumesListTestJSON-834052618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:29:10 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-78d8551d-0b5d-4c5c-a898-0ed80236f183 tempest-VolumesListTestJSON-834052618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:29:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-78d8551d-0b5d-4c5c-a898-0ed80236f183 tempest-VolumesListTestJSON-834052618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:29:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-78d8551d-0b5d-4c5c-a898-0ed80236f183 tempest-VolumesListTestJSON-834052618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:29:10 devstack sudo[106229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:29:10 devstack sudo[106229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:29:10 devstack sudo[106229]: pam_unix(sudo:session): session closed for user root Nov 04 12:29:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-78d8551d-0b5d-4c5c-a898-0ed80236f183 tempest-VolumesListTestJSON-834052618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.244s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:29:10 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-78d8551d-0b5d-4c5c-a898-0ed80236f183 tempest-VolumesListTestJSON-834052618 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:29:10 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-78d8551d-0b5d-4c5c-a898-0ed80236f183 tempest-VolumesListTestJSON-834052618 None] Deleted volume successfully. Nov 04 12:29:10 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-78d8551d-0b5d-4c5c-a898-0ed80236f183 tempest-VolumesListTestJSON-834052618 None] Lock "cinder-afcf49f0-4737-4b94-bb2c-394b90f4449e-delete_volume" released by "delete_volume" :: held 1.082s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:29:13 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e2c0483-53f8-4877-9aea-9ac50f17e7f5 tempest-CreateVolumesFromImageTest-1307702323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:29:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8e2c0483-53f8-4877-9aea-9ac50f17e7f5 tempest-CreateVolumesFromImageTest-1307702323 None] Flow 'volume_create_manager' (78da968d-d62c-4207-a30a-ae236416dd7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:29:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8e2c0483-53f8-4877-9aea-9ac50f17e7f5 tempest-CreateVolumesFromImageTest-1307702323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (533ec468-eaac-4b40-85e9-1c79aef238e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:29:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8e2c0483-53f8-4877-9aea-9ac50f17e7f5 tempest-CreateVolumesFromImageTest-1307702323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (533ec468-eaac-4b40-85e9-1c79aef238e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:29:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1080792806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88ff9d34-a895-4cbe-ac8d-fbbef3034e16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfdd2987cfc54c8cada13d0fd81e6576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:29:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:29:14Z,use_quota=True,user_id='9c42e46276b04672aa091da2c6975303',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:29:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8e2c0483-53f8-4877-9aea-9ac50f17e7f5 tempest-CreateVolumesFromImageTest-1307702323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39dafae5-700a-4d59-a6ac-5281a03d4e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:29:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8e2c0483-53f8-4877-9aea-9ac50f17e7f5 tempest-CreateVolumesFromImageTest-1307702323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39dafae5-700a-4d59-a6ac-5281a03d4e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:29:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8e2c0483-53f8-4877-9aea-9ac50f17e7f5 tempest-CreateVolumesFromImageTest-1307702323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bff8759-3aaf-42e3-a3f3-e52b75a9e7a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:29:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8e2c0483-53f8-4877-9aea-9ac50f17e7f5 tempest-CreateVolumesFromImageTest-1307702323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bff8759-3aaf-42e3-a3f3-e52b75a9e7a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88ff9d34-a895-4cbe-ac8d-fbbef3034e16', 'volume_name': 'volume-88ff9d34-a895-4cbe-ac8d-fbbef3034e16', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:29:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8e2c0483-53f8-4877-9aea-9ac50f17e7f5 tempest-CreateVolumesFromImageTest-1307702323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d563dd9-587f-4330-8e52-d5d9d463e97e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:29:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8e2c0483-53f8-4877-9aea-9ac50f17e7f5 tempest-CreateVolumesFromImageTest-1307702323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d563dd9-587f-4330-8e52-d5d9d463e97e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:29:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8e2c0483-53f8-4877-9aea-9ac50f17e7f5 tempest-CreateVolumesFromImageTest-1307702323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05c6bce9-2cb2-4c98-af4c-07b5c162e77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:29:13 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-8e2c0483-53f8-4877-9aea-9ac50f17e7f5 tempest-CreateVolumesFromImageTest-1307702323 None] Volume 88ff9d34-a895-4cbe-ac8d-fbbef3034e16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88ff9d34-a895-4cbe-ac8d-fbbef3034e16', 'volume_size': 1} Nov 04 12:29:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-8e2c0483-53f8-4877-9aea-9ac50f17e7f5 tempest-CreateVolumesFromImageTest-1307702323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:29:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-8e2c0483-53f8-4877-9aea-9ac50f17e7f5 tempest-CreateVolumesFromImageTest-1307702323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:29:13 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-8e2c0483-53f8-4877-9aea-9ac50f17e7f5 tempest-CreateVolumesFromImageTest-1307702323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:29:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1080792806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88ff9d34-a895-4cbe-ac8d-fbbef3034e16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfdd2987cfc54c8cada13d0fd81e6576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:29:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:29:14Z,use_quota=True,user_id='9c42e46276b04672aa091da2c6975303',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:29:13 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-8e2c0483-53f8-4877-9aea-9ac50f17e7f5 tempest-CreateVolumesFromImageTest-1307702323 None] Creating volume 88ff9d34-a895-4cbe-ac8d-fbbef3034e16 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:29:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-8e2c0483-53f8-4877-9aea-9ac50f17e7f5 tempest-CreateVolumesFromImageTest-1307702323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:29:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-8e2c0483-53f8-4877-9aea-9ac50f17e7f5 tempest-CreateVolumesFromImageTest-1307702323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:29:13 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-8e2c0483-53f8-4877-9aea-9ac50f17e7f5 tempest-CreateVolumesFromImageTest-1307702323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:29:13 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-8e2c0483-53f8-4877-9aea-9ac50f17e7f5 tempest-CreateVolumesFromImageTest-1307702323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:29:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-8e2c0483-53f8-4877-9aea-9ac50f17e7f5 tempest-CreateVolumesFromImageTest-1307702323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:29:13 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-8e2c0483-53f8-4877-9aea-9ac50f17e7f5 tempest-CreateVolumesFromImageTest-1307702323 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:29:13 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-8e2c0483-53f8-4877-9aea-9ac50f17e7f5 tempest-CreateVolumesFromImageTest-1307702323 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:29:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8e2c0483-53f8-4877-9aea-9ac50f17e7f5 tempest-CreateVolumesFromImageTest-1307702323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-88ff9d34-a895-4cbe-ac8d-fbbef3034e16 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:29:13 devstack sudo[106233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-88ff9d34-a895-4cbe-ac8d-fbbef3034e16 1073741824 Nov 04 12:29:13 devstack sudo[106233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:29:14 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-2860346b-3d9f-443a-b696-5cad781dc418 tempest-CreateVolumesFromImageTest-1307702323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:29:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2860346b-3d9f-443a-b696-5cad781dc418 tempest-CreateVolumesFromImageTest-1307702323 None] Flow 'volume_create_manager' (96447e6f-084e-4186-b723-ad738e91c2d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:29:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2860346b-3d9f-443a-b696-5cad781dc418 tempest-CreateVolumesFromImageTest-1307702323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d9a4ba6-72fb-4c69-9746-e4f0c016afb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:29:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2860346b-3d9f-443a-b696-5cad781dc418 tempest-CreateVolumesFromImageTest-1307702323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d9a4ba6-72fb-4c69-9746-e4f0c016afb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:29:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1617034496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=708968b8-2cea-4f55-8e87-89e6eb90bdc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfdd2987cfc54c8cada13d0fd81e6576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:29:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:29:14Z,use_quota=True,user_id='9c42e46276b04672aa091da2c6975303',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:29:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2860346b-3d9f-443a-b696-5cad781dc418 tempest-CreateVolumesFromImageTest-1307702323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f59b1142-6a68-4a47-8419-c9b0860ecb87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:29:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2860346b-3d9f-443a-b696-5cad781dc418 tempest-CreateVolumesFromImageTest-1307702323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f59b1142-6a68-4a47-8419-c9b0860ecb87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:29:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2860346b-3d9f-443a-b696-5cad781dc418 tempest-CreateVolumesFromImageTest-1307702323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92334989-9997-4f47-af1a-a1d224142835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:29:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2860346b-3d9f-443a-b696-5cad781dc418 tempest-CreateVolumesFromImageTest-1307702323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92334989-9997-4f47-af1a-a1d224142835) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '708968b8-2cea-4f55-8e87-89e6eb90bdc6', 'volume_name': 'volume-708968b8-2cea-4f55-8e87-89e6eb90bdc6', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:29:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2860346b-3d9f-443a-b696-5cad781dc418 tempest-CreateVolumesFromImageTest-1307702323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d2cb6c6-d152-409f-bb26-625d2bbe88f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:29:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2860346b-3d9f-443a-b696-5cad781dc418 tempest-CreateVolumesFromImageTest-1307702323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d2cb6c6-d152-409f-bb26-625d2bbe88f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:29:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2860346b-3d9f-443a-b696-5cad781dc418 tempest-CreateVolumesFromImageTest-1307702323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a60de0d-4301-4458-86e0-535b2f8abf2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:29:14 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-2860346b-3d9f-443a-b696-5cad781dc418 tempest-CreateVolumesFromImageTest-1307702323 None] Volume 708968b8-2cea-4f55-8e87-89e6eb90bdc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-708968b8-2cea-4f55-8e87-89e6eb90bdc6', 'volume_size': 1} Nov 04 12:29:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2860346b-3d9f-443a-b696-5cad781dc418 tempest-CreateVolumesFromImageTest-1307702323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:29:14 devstack sudo[106233]: pam_unix(sudo:session): session closed for user root Nov 04 12:29:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8e2c0483-53f8-4877-9aea-9ac50f17e7f5 tempest-CreateVolumesFromImageTest-1307702323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-88ff9d34-a895-4cbe-ac8d-fbbef3034e16 1073741824" returned: 0 in 0.495s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:29:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8e2c0483-53f8-4877-9aea-9ac50f17e7f5 tempest-CreateVolumesFromImageTest-1307702323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-88ff9d34-a895-4cbe-ac8d-fbbef3034e16 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:29:14 devstack sudo[106239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-88ff9d34-a895-4cbe-ac8d-fbbef3034e16 Nov 04 12:29:14 devstack sudo[106239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:29:14 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-acce45ec-8c17-4033-9f1a-c04d37e08531 tempest-CreateVolumesFromImageTest-1307702323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:29:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-acce45ec-8c17-4033-9f1a-c04d37e08531 tempest-CreateVolumesFromImageTest-1307702323 None] Flow 'volume_create_manager' (62d569bc-c048-4b28-858b-9ecc5df762b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:29:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-acce45ec-8c17-4033-9f1a-c04d37e08531 tempest-CreateVolumesFromImageTest-1307702323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53063a93-79b2-4971-b967-0f3648dcaaac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:29:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-acce45ec-8c17-4033-9f1a-c04d37e08531 tempest-CreateVolumesFromImageTest-1307702323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53063a93-79b2-4971-b967-0f3648dcaaac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:29:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1903540483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7ec54c2-88da-4a5c-850f-b5965e8a2385,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfdd2987cfc54c8cada13d0fd81e6576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:29:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:29:14Z,use_quota=True,user_id='9c42e46276b04672aa091da2c6975303',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:29:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-acce45ec-8c17-4033-9f1a-c04d37e08531 tempest-CreateVolumesFromImageTest-1307702323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93b3222a-7583-48be-903c-b523eea2bcfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:29:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-acce45ec-8c17-4033-9f1a-c04d37e08531 tempest-CreateVolumesFromImageTest-1307702323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93b3222a-7583-48be-903c-b523eea2bcfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:29:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-acce45ec-8c17-4033-9f1a-c04d37e08531 tempest-CreateVolumesFromImageTest-1307702323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0274223-e2c4-45f6-9453-ef297ca8185f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:29:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-acce45ec-8c17-4033-9f1a-c04d37e08531 tempest-CreateVolumesFromImageTest-1307702323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0274223-e2c4-45f6-9453-ef297ca8185f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7ec54c2-88da-4a5c-850f-b5965e8a2385', 'volume_name': 'volume-f7ec54c2-88da-4a5c-850f-b5965e8a2385', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:29:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-acce45ec-8c17-4033-9f1a-c04d37e08531 tempest-CreateVolumesFromImageTest-1307702323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90192153-9853-4c61-84bb-0d0c03283dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:29:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-acce45ec-8c17-4033-9f1a-c04d37e08531 tempest-CreateVolumesFromImageTest-1307702323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90192153-9853-4c61-84bb-0d0c03283dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:29:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-acce45ec-8c17-4033-9f1a-c04d37e08531 tempest-CreateVolumesFromImageTest-1307702323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f53617c-90d1-4290-8b2f-59346aee8b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:29:14 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-acce45ec-8c17-4033-9f1a-c04d37e08531 tempest-CreateVolumesFromImageTest-1307702323 None] Volume f7ec54c2-88da-4a5c-850f-b5965e8a2385: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7ec54c2-88da-4a5c-850f-b5965e8a2385', 'volume_size': 1} Nov 04 12:29:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-acce45ec-8c17-4033-9f1a-c04d37e08531 tempest-CreateVolumesFromImageTest-1307702323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:29:14 devstack sudo[106239]: pam_unix(sudo:session): session closed for user root Nov 04 12:29:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8e2c0483-53f8-4877-9aea-9ac50f17e7f5 tempest-CreateVolumesFromImageTest-1307702323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-88ff9d34-a895-4cbe-ac8d-fbbef3034e16" returned: 0 in 0.296s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:29:14 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-8e2c0483-53f8-4877-9aea-9ac50f17e7f5 tempest-CreateVolumesFromImageTest-1307702323 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:29:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-8e2c0483-53f8-4877-9aea-9ac50f17e7f5 tempest-CreateVolumesFromImageTest-1307702323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:29:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2860346b-3d9f-443a-b696-5cad781dc418 tempest-CreateVolumesFromImageTest-1307702323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.446s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:29:14 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2860346b-3d9f-443a-b696-5cad781dc418 tempest-CreateVolumesFromImageTest-1307702323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:29:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1617034496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=708968b8-2cea-4f55-8e87-89e6eb90bdc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfdd2987cfc54c8cada13d0fd81e6576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:29:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:29:14Z,use_quota=True,user_id='9c42e46276b04672aa091da2c6975303',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:29:14 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-2860346b-3d9f-443a-b696-5cad781dc418 tempest-CreateVolumesFromImageTest-1307702323 None] Creating volume 708968b8-2cea-4f55-8e87-89e6eb90bdc6 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:29:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2860346b-3d9f-443a-b696-5cad781dc418 tempest-CreateVolumesFromImageTest-1307702323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:29:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2860346b-3d9f-443a-b696-5cad781dc418 tempest-CreateVolumesFromImageTest-1307702323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:29:14 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2860346b-3d9f-443a-b696-5cad781dc418 tempest-CreateVolumesFromImageTest-1307702323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:29:14 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2860346b-3d9f-443a-b696-5cad781dc418 tempest-CreateVolumesFromImageTest-1307702323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:29:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2860346b-3d9f-443a-b696-5cad781dc418 tempest-CreateVolumesFromImageTest-1307702323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:29:14 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2860346b-3d9f-443a-b696-5cad781dc418 tempest-CreateVolumesFromImageTest-1307702323 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:29:14 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-2860346b-3d9f-443a-b696-5cad781dc418 tempest-CreateVolumesFromImageTest-1307702323 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:29:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2860346b-3d9f-443a-b696-5cad781dc418 tempest-CreateVolumesFromImageTest-1307702323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-708968b8-2cea-4f55-8e87-89e6eb90bdc6 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:29:14 devstack sudo[106242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-708968b8-2cea-4f55-8e87-89e6eb90bdc6 1073741824 Nov 04 12:29:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8e2c0483-53f8-4877-9aea-9ac50f17e7f5 tempest-CreateVolumesFromImageTest-1307702323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05c6bce9-2cb2-4c98-af4c-07b5c162e77a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88ff9d34-a895-4cbe-ac8d-fbbef3034e16', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:29:14 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:29:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8e2c0483-53f8-4877-9aea-9ac50f17e7f5 tempest-CreateVolumesFromImageTest-1307702323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93382850-1fd9-4747-abec-9c3659b53bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:29:14 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-8e2c0483-53f8-4877-9aea-9ac50f17e7f5 tempest-CreateVolumesFromImageTest-1307702323 None] Volume volume-88ff9d34-a895-4cbe-ac8d-fbbef3034e16 (88ff9d34-a895-4cbe-ac8d-fbbef3034e16): created successfully Nov 04 12:29:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8e2c0483-53f8-4877-9aea-9ac50f17e7f5 tempest-CreateVolumesFromImageTest-1307702323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93382850-1fd9-4747-abec-9c3659b53bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:29:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8e2c0483-53f8-4877-9aea-9ac50f17e7f5 tempest-CreateVolumesFromImageTest-1307702323 None] Flow 'volume_create_manager' (78da968d-d62c-4207-a30a-ae236416dd7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:29:14 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-8e2c0483-53f8-4877-9aea-9ac50f17e7f5 tempest-CreateVolumesFromImageTest-1307702323 None] Created volume successfully. Nov 04 12:29:14 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-794fee81-9e9d-4559-9ff8-79fc307d252d tempest-CreateVolumesFromImageTest-1307702323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:29:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-794fee81-9e9d-4559-9ff8-79fc307d252d tempest-CreateVolumesFromImageTest-1307702323 None] Flow 'volume_create_manager' (c101692f-77cd-42c2-aefd-297d6ec6af58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:29:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-794fee81-9e9d-4559-9ff8-79fc307d252d tempest-CreateVolumesFromImageTest-1307702323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1816529-ced1-4022-b855-9179015a9ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:29:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-794fee81-9e9d-4559-9ff8-79fc307d252d tempest-CreateVolumesFromImageTest-1307702323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1816529-ced1-4022-b855-9179015a9ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:29:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1447835780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf796f7a-6195-48ce-b926-3402c8c441c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfdd2987cfc54c8cada13d0fd81e6576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:29:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:29:15Z,use_quota=True,user_id='9c42e46276b04672aa091da2c6975303',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:29:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-794fee81-9e9d-4559-9ff8-79fc307d252d tempest-CreateVolumesFromImageTest-1307702323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcf5d4fe-ba62-4147-bf37-99fc792abb10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:29:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-794fee81-9e9d-4559-9ff8-79fc307d252d tempest-CreateVolumesFromImageTest-1307702323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcf5d4fe-ba62-4147-bf37-99fc792abb10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:29:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-794fee81-9e9d-4559-9ff8-79fc307d252d tempest-CreateVolumesFromImageTest-1307702323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8806ab24-d074-43df-8856-2dac5c526b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:29:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-794fee81-9e9d-4559-9ff8-79fc307d252d tempest-CreateVolumesFromImageTest-1307702323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8806ab24-d074-43df-8856-2dac5c526b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf796f7a-6195-48ce-b926-3402c8c441c0', 'volume_name': 'volume-cf796f7a-6195-48ce-b926-3402c8c441c0', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:29:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-794fee81-9e9d-4559-9ff8-79fc307d252d tempest-CreateVolumesFromImageTest-1307702323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab2fc8ae-2370-48ad-8bd0-47def55535e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:29:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-794fee81-9e9d-4559-9ff8-79fc307d252d tempest-CreateVolumesFromImageTest-1307702323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab2fc8ae-2370-48ad-8bd0-47def55535e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:29:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-794fee81-9e9d-4559-9ff8-79fc307d252d tempest-CreateVolumesFromImageTest-1307702323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b8726ba-247d-4d05-a9cc-e8723bcde67f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:29:14 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-794fee81-9e9d-4559-9ff8-79fc307d252d tempest-CreateVolumesFromImageTest-1307702323 None] Volume cf796f7a-6195-48ce-b926-3402c8c441c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf796f7a-6195-48ce-b926-3402c8c441c0', 'volume_size': 1} Nov 04 12:29:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-794fee81-9e9d-4559-9ff8-79fc307d252d tempest-CreateVolumesFromImageTest-1307702323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:29:15 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root Nov 04 12:29:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2860346b-3d9f-443a-b696-5cad781dc418 tempest-CreateVolumesFromImageTest-1307702323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-708968b8-2cea-4f55-8e87-89e6eb90bdc6 1073741824" returned: 0 in 0.497s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:29:15 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc04eeae-8ef6-4f16-afd7-dde6df426f2b tempest-CreateVolumesFromImageTest-1307702323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:29:15 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cc04eeae-8ef6-4f16-afd7-dde6df426f2b tempest-CreateVolumesFromImageTest-1307702323 None] Flow 'volume_create_manager' (c1d512de-a90c-4b6e-96e5-02bc4325b0da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:29:15 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cc04eeae-8ef6-4f16-afd7-dde6df426f2b tempest-CreateVolumesFromImageTest-1307702323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6061c73a-b3c2-4158-b72a-85b3cf9f45d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:29:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2860346b-3d9f-443a-b696-5cad781dc418 tempest-CreateVolumesFromImageTest-1307702323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-708968b8-2cea-4f55-8e87-89e6eb90bdc6 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:29:15 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cc04eeae-8ef6-4f16-afd7-dde6df426f2b tempest-CreateVolumesFromImageTest-1307702323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6061c73a-b3c2-4158-b72a-85b3cf9f45d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:29:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1467117889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6b45192-4362-491c-bfea-06cfc339bdc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfdd2987cfc54c8cada13d0fd81e6576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:29:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:29:15Z,use_quota=True,user_id='9c42e46276b04672aa091da2c6975303',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:29:15 devstack sudo[106248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-708968b8-2cea-4f55-8e87-89e6eb90bdc6 Nov 04 12:29:15 devstack sudo[106248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:29:15 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cc04eeae-8ef6-4f16-afd7-dde6df426f2b tempest-CreateVolumesFromImageTest-1307702323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd921ad6-12d4-4cd3-b398-2b0de334e815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:29:15 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cc04eeae-8ef6-4f16-afd7-dde6df426f2b tempest-CreateVolumesFromImageTest-1307702323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd921ad6-12d4-4cd3-b398-2b0de334e815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:29:15 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cc04eeae-8ef6-4f16-afd7-dde6df426f2b tempest-CreateVolumesFromImageTest-1307702323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69c53287-f625-49fc-9f76-7816f928aa36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:29:15 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cc04eeae-8ef6-4f16-afd7-dde6df426f2b tempest-CreateVolumesFromImageTest-1307702323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69c53287-f625-49fc-9f76-7816f928aa36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6b45192-4362-491c-bfea-06cfc339bdc0', 'volume_name': 'volume-e6b45192-4362-491c-bfea-06cfc339bdc0', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:29:15 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cc04eeae-8ef6-4f16-afd7-dde6df426f2b tempest-CreateVolumesFromImageTest-1307702323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65fbc083-0ff5-4f62-956f-efa9ff0d965c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:29:15 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cc04eeae-8ef6-4f16-afd7-dde6df426f2b tempest-CreateVolumesFromImageTest-1307702323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65fbc083-0ff5-4f62-956f-efa9ff0d965c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:29:15 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cc04eeae-8ef6-4f16-afd7-dde6df426f2b tempest-CreateVolumesFromImageTest-1307702323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de0a5b60-4630-43c9-a04f-af406c126028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:29:15 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-cc04eeae-8ef6-4f16-afd7-dde6df426f2b tempest-CreateVolumesFromImageTest-1307702323 None] Volume e6b45192-4362-491c-bfea-06cfc339bdc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6b45192-4362-491c-bfea-06cfc339bdc0', 'volume_size': 1} Nov 04 12:29:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cc04eeae-8ef6-4f16-afd7-dde6df426f2b tempest-CreateVolumesFromImageTest-1307702323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:29:15 devstack sudo[106248]: pam_unix(sudo:session): session closed for user root Nov 04 12:29:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2860346b-3d9f-443a-b696-5cad781dc418 tempest-CreateVolumesFromImageTest-1307702323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-708968b8-2cea-4f55-8e87-89e6eb90bdc6" returned: 0 in 0.238s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:29:15 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2860346b-3d9f-443a-b696-5cad781dc418 tempest-CreateVolumesFromImageTest-1307702323 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:29:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2860346b-3d9f-443a-b696-5cad781dc418 tempest-CreateVolumesFromImageTest-1307702323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:29:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-acce45ec-8c17-4033-9f1a-c04d37e08531 tempest-CreateVolumesFromImageTest-1307702323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.934s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:29:15 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-acce45ec-8c17-4033-9f1a-c04d37e08531 tempest-CreateVolumesFromImageTest-1307702323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:29:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1903540483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7ec54c2-88da-4a5c-850f-b5965e8a2385,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfdd2987cfc54c8cada13d0fd81e6576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:29:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:29:14Z,use_quota=True,user_id='9c42e46276b04672aa091da2c6975303',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:29:15 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-acce45ec-8c17-4033-9f1a-c04d37e08531 tempest-CreateVolumesFromImageTest-1307702323 None] Creating volume f7ec54c2-88da-4a5c-850f-b5965e8a2385 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:29:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-acce45ec-8c17-4033-9f1a-c04d37e08531 tempest-CreateVolumesFromImageTest-1307702323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:29:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-acce45ec-8c17-4033-9f1a-c04d37e08531 tempest-CreateVolumesFromImageTest-1307702323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:29:15 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-acce45ec-8c17-4033-9f1a-c04d37e08531 tempest-CreateVolumesFromImageTest-1307702323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:29:15 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-acce45ec-8c17-4033-9f1a-c04d37e08531 tempest-CreateVolumesFromImageTest-1307702323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:29:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-acce45ec-8c17-4033-9f1a-c04d37e08531 tempest-CreateVolumesFromImageTest-1307702323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:29:15 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-acce45ec-8c17-4033-9f1a-c04d37e08531 tempest-CreateVolumesFromImageTest-1307702323 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:29:15 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-acce45ec-8c17-4033-9f1a-c04d37e08531 tempest-CreateVolumesFromImageTest-1307702323 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:29:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-acce45ec-8c17-4033-9f1a-c04d37e08531 tempest-CreateVolumesFromImageTest-1307702323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f7ec54c2-88da-4a5c-850f-b5965e8a2385 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:29:15 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2860346b-3d9f-443a-b696-5cad781dc418 tempest-CreateVolumesFromImageTest-1307702323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a60de0d-4301-4458-86e0-535b2f8abf2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-708968b8-2cea-4f55-8e87-89e6eb90bdc6', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:29:15 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2860346b-3d9f-443a-b696-5cad781dc418 tempest-CreateVolumesFromImageTest-1307702323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59399c2e-3d18-4e86-9f0f-8e3a82ee3cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:29:15 devstack sudo[106252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f7ec54c2-88da-4a5c-850f-b5965e8a2385 1073741824 Nov 04 12:29:15 devstack sudo[106252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:29:15 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-2860346b-3d9f-443a-b696-5cad781dc418 tempest-CreateVolumesFromImageTest-1307702323 None] Volume volume-708968b8-2cea-4f55-8e87-89e6eb90bdc6 (708968b8-2cea-4f55-8e87-89e6eb90bdc6): created successfully Nov 04 12:29:15 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2860346b-3d9f-443a-b696-5cad781dc418 tempest-CreateVolumesFromImageTest-1307702323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59399c2e-3d18-4e86-9f0f-8e3a82ee3cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:29:15 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2860346b-3d9f-443a-b696-5cad781dc418 tempest-CreateVolumesFromImageTest-1307702323 None] Flow 'volume_create_manager' (96447e6f-084e-4186-b723-ad738e91c2d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:29:15 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-2860346b-3d9f-443a-b696-5cad781dc418 tempest-CreateVolumesFromImageTest-1307702323 None] Created volume successfully. Nov 04 12:29:15 devstack sudo[106252]: pam_unix(sudo:session): session closed for user root Nov 04 12:29:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-acce45ec-8c17-4033-9f1a-c04d37e08531 tempest-CreateVolumesFromImageTest-1307702323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f7ec54c2-88da-4a5c-850f-b5965e8a2385 1073741824" returned: 0 in 0.412s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:29:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-acce45ec-8c17-4033-9f1a-c04d37e08531 tempest-CreateVolumesFromImageTest-1307702323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f7ec54c2-88da-4a5c-850f-b5965e8a2385 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:29:15 devstack sudo[106258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f7ec54c2-88da-4a5c-850f-b5965e8a2385 Nov 04 12:29:15 devstack sudo[106258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:29:16 devstack sudo[106258]: pam_unix(sudo:session): session closed for user root Nov 04 12:29:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-acce45ec-8c17-4033-9f1a-c04d37e08531 tempest-CreateVolumesFromImageTest-1307702323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f7ec54c2-88da-4a5c-850f-b5965e8a2385" returned: 0 in 0.248s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:29:16 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-acce45ec-8c17-4033-9f1a-c04d37e08531 tempest-CreateVolumesFromImageTest-1307702323 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:29:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-acce45ec-8c17-4033-9f1a-c04d37e08531 tempest-CreateVolumesFromImageTest-1307702323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:29:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-794fee81-9e9d-4559-9ff8-79fc307d252d tempest-CreateVolumesFromImageTest-1307702323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.229s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:29:16 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-794fee81-9e9d-4559-9ff8-79fc307d252d tempest-CreateVolumesFromImageTest-1307702323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:29:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1447835780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf796f7a-6195-48ce-b926-3402c8c441c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfdd2987cfc54c8cada13d0fd81e6576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:29:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:29:15Z,use_quota=True,user_id='9c42e46276b04672aa091da2c6975303',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:29:16 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-794fee81-9e9d-4559-9ff8-79fc307d252d tempest-CreateVolumesFromImageTest-1307702323 None] Creating volume cf796f7a-6195-48ce-b926-3402c8c441c0 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:29:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-794fee81-9e9d-4559-9ff8-79fc307d252d tempest-CreateVolumesFromImageTest-1307702323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:29:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-794fee81-9e9d-4559-9ff8-79fc307d252d tempest-CreateVolumesFromImageTest-1307702323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:29:16 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-794fee81-9e9d-4559-9ff8-79fc307d252d tempest-CreateVolumesFromImageTest-1307702323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:29:16 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-794fee81-9e9d-4559-9ff8-79fc307d252d tempest-CreateVolumesFromImageTest-1307702323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:29:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-794fee81-9e9d-4559-9ff8-79fc307d252d tempest-CreateVolumesFromImageTest-1307702323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:29:16 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-794fee81-9e9d-4559-9ff8-79fc307d252d tempest-CreateVolumesFromImageTest-1307702323 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:29:16 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-794fee81-9e9d-4559-9ff8-79fc307d252d tempest-CreateVolumesFromImageTest-1307702323 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:29:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-794fee81-9e9d-4559-9ff8-79fc307d252d tempest-CreateVolumesFromImageTest-1307702323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf796f7a-6195-48ce-b926-3402c8c441c0 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:29:16 devstack sudo[106261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf796f7a-6195-48ce-b926-3402c8c441c0 1073741824 Nov 04 12:29:16 devstack sudo[106261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:29:16 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-acce45ec-8c17-4033-9f1a-c04d37e08531 tempest-CreateVolumesFromImageTest-1307702323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f53617c-90d1-4290-8b2f-59346aee8b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7ec54c2-88da-4a5c-850f-b5965e8a2385', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:29:16 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-acce45ec-8c17-4033-9f1a-c04d37e08531 tempest-CreateVolumesFromImageTest-1307702323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d91f23f-78a2-436d-99fd-ddecf3e97d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:29:16 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-acce45ec-8c17-4033-9f1a-c04d37e08531 tempest-CreateVolumesFromImageTest-1307702323 None] Volume volume-f7ec54c2-88da-4a5c-850f-b5965e8a2385 (f7ec54c2-88da-4a5c-850f-b5965e8a2385): created successfully Nov 04 12:29:16 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-acce45ec-8c17-4033-9f1a-c04d37e08531 tempest-CreateVolumesFromImageTest-1307702323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d91f23f-78a2-436d-99fd-ddecf3e97d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:29:16 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-acce45ec-8c17-4033-9f1a-c04d37e08531 tempest-CreateVolumesFromImageTest-1307702323 None] Flow 'volume_create_manager' (62d569bc-c048-4b28-858b-9ecc5df762b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:29:16 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-acce45ec-8c17-4033-9f1a-c04d37e08531 tempest-CreateVolumesFromImageTest-1307702323 None] Created volume successfully. Nov 04 12:29:16 devstack sudo[106261]: pam_unix(sudo:session): session closed for user root Nov 04 12:29:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-794fee81-9e9d-4559-9ff8-79fc307d252d tempest-CreateVolumesFromImageTest-1307702323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf796f7a-6195-48ce-b926-3402c8c441c0 1073741824" returned: 0 in 0.407s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:29:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-794fee81-9e9d-4559-9ff8-79fc307d252d tempest-CreateVolumesFromImageTest-1307702323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf796f7a-6195-48ce-b926-3402c8c441c0 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:29:16 devstack sudo[106267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf796f7a-6195-48ce-b926-3402c8c441c0 Nov 04 12:29:16 devstack sudo[106267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:29:16 devstack sudo[106267]: pam_unix(sudo:session): session closed for user root Nov 04 12:29:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-794fee81-9e9d-4559-9ff8-79fc307d252d tempest-CreateVolumesFromImageTest-1307702323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf796f7a-6195-48ce-b926-3402c8c441c0" returned: 0 in 0.239s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:29:16 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-794fee81-9e9d-4559-9ff8-79fc307d252d tempest-CreateVolumesFromImageTest-1307702323 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:29:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-794fee81-9e9d-4559-9ff8-79fc307d252d tempest-CreateVolumesFromImageTest-1307702323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:29:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cc04eeae-8ef6-4f16-afd7-dde6df426f2b tempest-CreateVolumesFromImageTest-1307702323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.577s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:29:16 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-cc04eeae-8ef6-4f16-afd7-dde6df426f2b tempest-CreateVolumesFromImageTest-1307702323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:29:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1467117889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6b45192-4362-491c-bfea-06cfc339bdc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfdd2987cfc54c8cada13d0fd81e6576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:29:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:29:15Z,use_quota=True,user_id='9c42e46276b04672aa091da2c6975303',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:29:16 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-cc04eeae-8ef6-4f16-afd7-dde6df426f2b tempest-CreateVolumesFromImageTest-1307702323 None] Creating volume e6b45192-4362-491c-bfea-06cfc339bdc0 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:29:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cc04eeae-8ef6-4f16-afd7-dde6df426f2b tempest-CreateVolumesFromImageTest-1307702323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:29:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cc04eeae-8ef6-4f16-afd7-dde6df426f2b tempest-CreateVolumesFromImageTest-1307702323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:29:16 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-cc04eeae-8ef6-4f16-afd7-dde6df426f2b tempest-CreateVolumesFromImageTest-1307702323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:29:16 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-cc04eeae-8ef6-4f16-afd7-dde6df426f2b tempest-CreateVolumesFromImageTest-1307702323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:29:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cc04eeae-8ef6-4f16-afd7-dde6df426f2b tempest-CreateVolumesFromImageTest-1307702323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:29:16 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-cc04eeae-8ef6-4f16-afd7-dde6df426f2b tempest-CreateVolumesFromImageTest-1307702323 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:29:16 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-cc04eeae-8ef6-4f16-afd7-dde6df426f2b tempest-CreateVolumesFromImageTest-1307702323 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:29:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cc04eeae-8ef6-4f16-afd7-dde6df426f2b tempest-CreateVolumesFromImageTest-1307702323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-e6b45192-4362-491c-bfea-06cfc339bdc0 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:29:16 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-794fee81-9e9d-4559-9ff8-79fc307d252d tempest-CreateVolumesFromImageTest-1307702323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b8726ba-247d-4d05-a9cc-e8723bcde67f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf796f7a-6195-48ce-b926-3402c8c441c0', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:29:16 devstack sudo[106270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-e6b45192-4362-491c-bfea-06cfc339bdc0 1073741824 Nov 04 12:29:16 devstack sudo[106270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:29:16 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-794fee81-9e9d-4559-9ff8-79fc307d252d tempest-CreateVolumesFromImageTest-1307702323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e2c2b96-d350-4022-a96e-4d56faad97c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:29:16 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-794fee81-9e9d-4559-9ff8-79fc307d252d tempest-CreateVolumesFromImageTest-1307702323 None] Volume volume-cf796f7a-6195-48ce-b926-3402c8c441c0 (cf796f7a-6195-48ce-b926-3402c8c441c0): created successfully Nov 04 12:29:16 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-794fee81-9e9d-4559-9ff8-79fc307d252d tempest-CreateVolumesFromImageTest-1307702323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e2c2b96-d350-4022-a96e-4d56faad97c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:29:16 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-794fee81-9e9d-4559-9ff8-79fc307d252d tempest-CreateVolumesFromImageTest-1307702323 None] Flow 'volume_create_manager' (c101692f-77cd-42c2-aefd-297d6ec6af58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:29:16 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-794fee81-9e9d-4559-9ff8-79fc307d252d tempest-CreateVolumesFromImageTest-1307702323 None] Created volume successfully. Nov 04 12:29:17 devstack sudo[106270]: pam_unix(sudo:session): session closed for user root Nov 04 12:29:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cc04eeae-8ef6-4f16-afd7-dde6df426f2b tempest-CreateVolumesFromImageTest-1307702323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-e6b45192-4362-491c-bfea-06cfc339bdc0 1073741824" returned: 0 in 0.426s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:29:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cc04eeae-8ef6-4f16-afd7-dde6df426f2b tempest-CreateVolumesFromImageTest-1307702323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-e6b45192-4362-491c-bfea-06cfc339bdc0 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:29:17 devstack sudo[106275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-e6b45192-4362-491c-bfea-06cfc339bdc0 Nov 04 12:29:17 devstack sudo[106275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:29:17 devstack sudo[106275]: pam_unix(sudo:session): session closed for user root Nov 04 12:29:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cc04eeae-8ef6-4f16-afd7-dde6df426f2b tempest-CreateVolumesFromImageTest-1307702323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-e6b45192-4362-491c-bfea-06cfc339bdc0" returned: 0 in 0.245s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:29:17 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-cc04eeae-8ef6-4f16-afd7-dde6df426f2b tempest-CreateVolumesFromImageTest-1307702323 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:29:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cc04eeae-8ef6-4f16-afd7-dde6df426f2b tempest-CreateVolumesFromImageTest-1307702323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:29:17 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cc04eeae-8ef6-4f16-afd7-dde6df426f2b tempest-CreateVolumesFromImageTest-1307702323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de0a5b60-4630-43c9-a04f-af406c126028) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6b45192-4362-491c-bfea-06cfc339bdc0', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:29:17 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cc04eeae-8ef6-4f16-afd7-dde6df426f2b tempest-CreateVolumesFromImageTest-1307702323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (182872fb-c39f-4ec1-a530-9d095c947dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:29:17 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-cc04eeae-8ef6-4f16-afd7-dde6df426f2b tempest-CreateVolumesFromImageTest-1307702323 None] Volume volume-e6b45192-4362-491c-bfea-06cfc339bdc0 (e6b45192-4362-491c-bfea-06cfc339bdc0): created successfully Nov 04 12:29:17 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cc04eeae-8ef6-4f16-afd7-dde6df426f2b tempest-CreateVolumesFromImageTest-1307702323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (182872fb-c39f-4ec1-a530-9d095c947dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:29:17 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cc04eeae-8ef6-4f16-afd7-dde6df426f2b tempest-CreateVolumesFromImageTest-1307702323 None] Flow 'volume_create_manager' (c1d512de-a90c-4b6e-96e5-02bc4325b0da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:29:17 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-cc04eeae-8ef6-4f16-afd7-dde6df426f2b tempest-CreateVolumesFromImageTest-1307702323 None] Created volume successfully. Nov 04 12:29:18 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-5a603dab-63a7-4e52-ba9c-c22b07164935 tempest-CreateVolumesFromImageTest-1307702323 None] Acquiring lock "cinder-e6b45192-4362-491c-bfea-06cfc339bdc0-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:29:18 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-5a603dab-63a7-4e52-ba9c-c22b07164935 tempest-CreateVolumesFromImageTest-1307702323 None] Lock "cinder-e6b45192-4362-491c-bfea-06cfc339bdc0-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:29:18 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-5a603dab-63a7-4e52-ba9c-c22b07164935 tempest-CreateVolumesFromImageTest-1307702323 None] Acquiring lock "cinder-quobyte-e6b45192-4362-491c-bfea-06cfc339bdc0" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:29:18 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-5a603dab-63a7-4e52-ba9c-c22b07164935 tempest-CreateVolumesFromImageTest-1307702323 None] Lock "cinder-quobyte-e6b45192-4362-491c-bfea-06cfc339bdc0" acquired by "delete_volume" :: waited 0.017s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:29:18 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c77695-d02f-4e5b-9a18-19fb6edad083]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:29:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5a603dab-63a7-4e52-ba9c-c22b07164935 tempest-CreateVolumesFromImageTest-1307702323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-e6b45192-4362-491c-bfea-06cfc339bdc0 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:29:18 devstack sudo[106280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-e6b45192-4362-491c-bfea-06cfc339bdc0 Nov 04 12:29:18 devstack sudo[106280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:29:18 devstack sudo[106280]: pam_unix(sudo:session): session closed for user root Nov 04 12:29:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5a603dab-63a7-4e52-ba9c-c22b07164935 tempest-CreateVolumesFromImageTest-1307702323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-e6b45192-4362-491c-bfea-06cfc339bdc0" returned: 0 in 0.366s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:29:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5a603dab-63a7-4e52-ba9c-c22b07164935 tempest-CreateVolumesFromImageTest-1307702323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-e6b45192-4362-491c-bfea-06cfc339bdc0 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:29:18 devstack sudo[106285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-e6b45192-4362-491c-bfea-06cfc339bdc0 Nov 04 12:29:18 devstack sudo[106285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:29:19 devstack sudo[106285]: pam_unix(sudo:session): session closed for user root Nov 04 12:29:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5a603dab-63a7-4e52-ba9c-c22b07164935 tempest-CreateVolumesFromImageTest-1307702323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-e6b45192-4362-491c-bfea-06cfc339bdc0" returned: 0 in 0.238s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:29:19 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-5a603dab-63a7-4e52-ba9c-c22b07164935 tempest-CreateVolumesFromImageTest-1307702323 None] Lock "cinder-quobyte-e6b45192-4362-491c-bfea-06cfc339bdc0" released by "delete_volume" :: held 0.642s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:29:19 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-5a603dab-63a7-4e52-ba9c-c22b07164935 tempest-CreateVolumesFromImageTest-1307702323 None] Created reservations ['2bb42dce-2e46-4a67-ab77-46c228ee72e9', 'a3728874-fda6-41fc-a293-6492fc9aba63', '43daf661-bf15-4443-8627-da80617f070f', 'bab2612c-bd8f-487d-a021-8826ce9c4f9b'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:29:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5a603dab-63a7-4e52-ba9c-c22b07164935 tempest-CreateVolumesFromImageTest-1307702323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:29:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5a603dab-63a7-4e52-ba9c-c22b07164935 tempest-CreateVolumesFromImageTest-1307702323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:29:19 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-5a603dab-63a7-4e52-ba9c-c22b07164935 tempest-CreateVolumesFromImageTest-1307702323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:29:19 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-5a603dab-63a7-4e52-ba9c-c22b07164935 tempest-CreateVolumesFromImageTest-1307702323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:29:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5a603dab-63a7-4e52-ba9c-c22b07164935 tempest-CreateVolumesFromImageTest-1307702323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:29:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5a603dab-63a7-4e52-ba9c-c22b07164935 tempest-CreateVolumesFromImageTest-1307702323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:29:19 devstack sudo[106288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:29:19 devstack sudo[106288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:29:19 devstack sudo[106288]: pam_unix(sudo:session): session closed for user root Nov 04 12:29:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5a603dab-63a7-4e52-ba9c-c22b07164935 tempest-CreateVolumesFromImageTest-1307702323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.249s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:29:19 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-5a603dab-63a7-4e52-ba9c-c22b07164935 tempest-CreateVolumesFromImageTest-1307702323 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:29:19 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-5a603dab-63a7-4e52-ba9c-c22b07164935 tempest-CreateVolumesFromImageTest-1307702323 None] Deleted volume successfully. Nov 04 12:29:19 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-5a603dab-63a7-4e52-ba9c-c22b07164935 tempest-CreateVolumesFromImageTest-1307702323 None] Lock "cinder-e6b45192-4362-491c-bfea-06cfc339bdc0-delete_volume" released by "delete_volume" :: held 1.076s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:29:19 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-cae53f2b-028b-4b23-b54d-e0f8b9b7d9cf tempest-CreateVolumesFromImageTest-1307702323 None] Acquiring lock "cinder-cf796f7a-6195-48ce-b926-3402c8c441c0-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:29:19 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-cae53f2b-028b-4b23-b54d-e0f8b9b7d9cf tempest-CreateVolumesFromImageTest-1307702323 None] Lock "cinder-cf796f7a-6195-48ce-b926-3402c8c441c0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:29:19 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-cae53f2b-028b-4b23-b54d-e0f8b9b7d9cf tempest-CreateVolumesFromImageTest-1307702323 None] Acquiring lock "cinder-quobyte-cf796f7a-6195-48ce-b926-3402c8c441c0" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:29:19 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-cae53f2b-028b-4b23-b54d-e0f8b9b7d9cf tempest-CreateVolumesFromImageTest-1307702323 None] Lock "cinder-quobyte-cf796f7a-6195-48ce-b926-3402c8c441c0" acquired by "delete_volume" :: waited 0.013s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:29:19 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[659f8359-94e3-4af7-b88c-aa926e329733]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:29:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cae53f2b-028b-4b23-b54d-e0f8b9b7d9cf tempest-CreateVolumesFromImageTest-1307702323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf796f7a-6195-48ce-b926-3402c8c441c0 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:29:19 devstack sudo[106291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf796f7a-6195-48ce-b926-3402c8c441c0 Nov 04 12:29:19 devstack sudo[106291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:29:20 devstack sudo[106291]: pam_unix(sudo:session): session closed for user root Nov 04 12:29:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cae53f2b-028b-4b23-b54d-e0f8b9b7d9cf tempest-CreateVolumesFromImageTest-1307702323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf796f7a-6195-48ce-b926-3402c8c441c0" returned: 0 in 0.337s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:29:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cae53f2b-028b-4b23-b54d-e0f8b9b7d9cf tempest-CreateVolumesFromImageTest-1307702323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf796f7a-6195-48ce-b926-3402c8c441c0 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:29:20 devstack sudo[106296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf796f7a-6195-48ce-b926-3402c8c441c0 Nov 04 12:29:20 devstack sudo[106296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:29:20 devstack sudo[106296]: pam_unix(sudo:session): session closed for user root Nov 04 12:29:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cae53f2b-028b-4b23-b54d-e0f8b9b7d9cf tempest-CreateVolumesFromImageTest-1307702323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-cf796f7a-6195-48ce-b926-3402c8c441c0" returned: 0 in 0.238s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:29:20 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-cae53f2b-028b-4b23-b54d-e0f8b9b7d9cf tempest-CreateVolumesFromImageTest-1307702323 None] Lock "cinder-quobyte-cf796f7a-6195-48ce-b926-3402c8c441c0" released by "delete_volume" :: held 0.618s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:29:20 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-cae53f2b-028b-4b23-b54d-e0f8b9b7d9cf tempest-CreateVolumesFromImageTest-1307702323 None] Created reservations ['ff29bd6f-fa8b-4943-9ce7-dab10186e29c', 'c853470c-9ed1-433d-82d3-f53f7d70649d', '48c5b6ff-fd25-4ac9-9de7-51cc4059bf5f', '84435815-c55f-40f2-9756-e22d1cbf5077'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:29:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cae53f2b-028b-4b23-b54d-e0f8b9b7d9cf tempest-CreateVolumesFromImageTest-1307702323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:29:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cae53f2b-028b-4b23-b54d-e0f8b9b7d9cf tempest-CreateVolumesFromImageTest-1307702323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:29:20 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-cae53f2b-028b-4b23-b54d-e0f8b9b7d9cf tempest-CreateVolumesFromImageTest-1307702323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:29:20 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-cae53f2b-028b-4b23-b54d-e0f8b9b7d9cf tempest-CreateVolumesFromImageTest-1307702323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:29:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cae53f2b-028b-4b23-b54d-e0f8b9b7d9cf tempest-CreateVolumesFromImageTest-1307702323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:29:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cae53f2b-028b-4b23-b54d-e0f8b9b7d9cf tempest-CreateVolumesFromImageTest-1307702323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:29:20 devstack sudo[106299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:29:20 devstack sudo[106299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:29:20 devstack sudo[106299]: pam_unix(sudo:session): session closed for user root Nov 04 12:29:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cae53f2b-028b-4b23-b54d-e0f8b9b7d9cf tempest-CreateVolumesFromImageTest-1307702323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.238s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:29:20 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-cae53f2b-028b-4b23-b54d-e0f8b9b7d9cf tempest-CreateVolumesFromImageTest-1307702323 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:29:20 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-cae53f2b-028b-4b23-b54d-e0f8b9b7d9cf tempest-CreateVolumesFromImageTest-1307702323 None] Deleted volume successfully. Nov 04 12:29:20 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-cae53f2b-028b-4b23-b54d-e0f8b9b7d9cf tempest-CreateVolumesFromImageTest-1307702323 None] Lock "cinder-cf796f7a-6195-48ce-b926-3402c8c441c0-delete_volume" released by "delete_volume" :: held 1.031s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:29:20 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-5b5d21d7-55ab-47da-97f7-c7d4000eb737 tempest-CreateVolumesFromImageTest-1307702323 None] Acquiring lock "cinder-f7ec54c2-88da-4a5c-850f-b5965e8a2385-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:29:20 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-5b5d21d7-55ab-47da-97f7-c7d4000eb737 tempest-CreateVolumesFromImageTest-1307702323 None] Lock "cinder-f7ec54c2-88da-4a5c-850f-b5965e8a2385-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:29:20 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-5b5d21d7-55ab-47da-97f7-c7d4000eb737 tempest-CreateVolumesFromImageTest-1307702323 None] Acquiring lock "cinder-quobyte-f7ec54c2-88da-4a5c-850f-b5965e8a2385" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:29:20 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-5b5d21d7-55ab-47da-97f7-c7d4000eb737 tempest-CreateVolumesFromImageTest-1307702323 None] Lock "cinder-quobyte-f7ec54c2-88da-4a5c-850f-b5965e8a2385" acquired by "delete_volume" :: waited 0.012s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:29:20 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9ac656-2b95-4ac9-823e-3246ad552716]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:29:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5b5d21d7-55ab-47da-97f7-c7d4000eb737 tempest-CreateVolumesFromImageTest-1307702323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f7ec54c2-88da-4a5c-850f-b5965e8a2385 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:29:20 devstack sudo[106302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f7ec54c2-88da-4a5c-850f-b5965e8a2385 Nov 04 12:29:20 devstack sudo[106302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:29:21 devstack sudo[106302]: pam_unix(sudo:session): session closed for user root Nov 04 12:29:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5b5d21d7-55ab-47da-97f7-c7d4000eb737 tempest-CreateVolumesFromImageTest-1307702323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f7ec54c2-88da-4a5c-850f-b5965e8a2385" returned: 0 in 0.340s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:29:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5b5d21d7-55ab-47da-97f7-c7d4000eb737 tempest-CreateVolumesFromImageTest-1307702323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f7ec54c2-88da-4a5c-850f-b5965e8a2385 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:29:21 devstack sudo[106307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f7ec54c2-88da-4a5c-850f-b5965e8a2385 Nov 04 12:29:21 devstack sudo[106307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:29:21 devstack sudo[106307]: pam_unix(sudo:session): session closed for user root Nov 04 12:29:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5b5d21d7-55ab-47da-97f7-c7d4000eb737 tempest-CreateVolumesFromImageTest-1307702323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f7ec54c2-88da-4a5c-850f-b5965e8a2385" returned: 0 in 0.235s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:29:21 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-5b5d21d7-55ab-47da-97f7-c7d4000eb737 tempest-CreateVolumesFromImageTest-1307702323 None] Lock "cinder-quobyte-f7ec54c2-88da-4a5c-850f-b5965e8a2385" released by "delete_volume" :: held 0.615s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:29:21 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-5b5d21d7-55ab-47da-97f7-c7d4000eb737 tempest-CreateVolumesFromImageTest-1307702323 None] Created reservations ['597bb67a-0b75-47f9-886c-afdf848d2e67', '3106f52e-89d2-434a-85ed-52bc1a7927ae', '07c22e8a-e5f4-4a21-b0f4-3c57d08fd6fe', 'c100d957-aa06-4317-8e7e-21ccbcdbc474'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:29:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5b5d21d7-55ab-47da-97f7-c7d4000eb737 tempest-CreateVolumesFromImageTest-1307702323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:29:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5b5d21d7-55ab-47da-97f7-c7d4000eb737 tempest-CreateVolumesFromImageTest-1307702323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:29:21 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-5b5d21d7-55ab-47da-97f7-c7d4000eb737 tempest-CreateVolumesFromImageTest-1307702323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:29:21 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-5b5d21d7-55ab-47da-97f7-c7d4000eb737 tempest-CreateVolumesFromImageTest-1307702323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:29:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5b5d21d7-55ab-47da-97f7-c7d4000eb737 tempest-CreateVolumesFromImageTest-1307702323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:29:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5b5d21d7-55ab-47da-97f7-c7d4000eb737 tempest-CreateVolumesFromImageTest-1307702323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:29:21 devstack sudo[106310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:29:21 devstack sudo[106310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:29:21 devstack sudo[106310]: pam_unix(sudo:session): session closed for user root Nov 04 12:29:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5b5d21d7-55ab-47da-97f7-c7d4000eb737 tempest-CreateVolumesFromImageTest-1307702323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.240s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:29:21 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-5b5d21d7-55ab-47da-97f7-c7d4000eb737 tempest-CreateVolumesFromImageTest-1307702323 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:29:21 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-5b5d21d7-55ab-47da-97f7-c7d4000eb737 tempest-CreateVolumesFromImageTest-1307702323 None] Deleted volume successfully. Nov 04 12:29:21 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-5b5d21d7-55ab-47da-97f7-c7d4000eb737 tempest-CreateVolumesFromImageTest-1307702323 None] Lock "cinder-f7ec54c2-88da-4a5c-850f-b5965e8a2385-delete_volume" released by "delete_volume" :: held 1.047s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:29:21 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a718e5c2-8e55-40fb-a479-7798ce80616a tempest-CreateVolumesFromImageTest-1307702323 None] Acquiring lock "cinder-708968b8-2cea-4f55-8e87-89e6eb90bdc6-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:29:21 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a718e5c2-8e55-40fb-a479-7798ce80616a tempest-CreateVolumesFromImageTest-1307702323 None] Lock "cinder-708968b8-2cea-4f55-8e87-89e6eb90bdc6-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:29:22 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a718e5c2-8e55-40fb-a479-7798ce80616a tempest-CreateVolumesFromImageTest-1307702323 None] Acquiring lock "cinder-quobyte-708968b8-2cea-4f55-8e87-89e6eb90bdc6" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:29:22 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a718e5c2-8e55-40fb-a479-7798ce80616a tempest-CreateVolumesFromImageTest-1307702323 None] Lock "cinder-quobyte-708968b8-2cea-4f55-8e87-89e6eb90bdc6" acquired by "delete_volume" :: waited 0.013s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:29:22 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0713643b-e999-429c-8ffb-d87c3174c750]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:29:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a718e5c2-8e55-40fb-a479-7798ce80616a tempest-CreateVolumesFromImageTest-1307702323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-708968b8-2cea-4f55-8e87-89e6eb90bdc6 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:29:22 devstack sudo[106313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-708968b8-2cea-4f55-8e87-89e6eb90bdc6 Nov 04 12:29:22 devstack sudo[106313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:29:22 devstack sudo[106313]: pam_unix(sudo:session): session closed for user root Nov 04 12:29:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a718e5c2-8e55-40fb-a479-7798ce80616a tempest-CreateVolumesFromImageTest-1307702323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-708968b8-2cea-4f55-8e87-89e6eb90bdc6" returned: 0 in 0.342s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:29:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a718e5c2-8e55-40fb-a479-7798ce80616a tempest-CreateVolumesFromImageTest-1307702323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-708968b8-2cea-4f55-8e87-89e6eb90bdc6 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:29:22 devstack sudo[106318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-708968b8-2cea-4f55-8e87-89e6eb90bdc6 Nov 04 12:29:22 devstack sudo[106318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:29:22 devstack sudo[106318]: pam_unix(sudo:session): session closed for user root Nov 04 12:29:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a718e5c2-8e55-40fb-a479-7798ce80616a tempest-CreateVolumesFromImageTest-1307702323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-708968b8-2cea-4f55-8e87-89e6eb90bdc6" returned: 0 in 0.231s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:29:22 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a718e5c2-8e55-40fb-a479-7798ce80616a tempest-CreateVolumesFromImageTest-1307702323 None] Lock "cinder-quobyte-708968b8-2cea-4f55-8e87-89e6eb90bdc6" released by "delete_volume" :: held 0.610s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:29:22 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-a718e5c2-8e55-40fb-a479-7798ce80616a tempest-CreateVolumesFromImageTest-1307702323 None] Created reservations ['1ce76787-f4ff-474b-987a-706cdcddf57b', '63b89f51-2879-48b9-a11e-1997c68b7dda', 'ef3e0ebb-d6eb-4b20-a08d-43322f1e120e', '14199ed4-d2f9-4284-a82c-fc2a647032e2'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:29:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a718e5c2-8e55-40fb-a479-7798ce80616a tempest-CreateVolumesFromImageTest-1307702323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:29:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a718e5c2-8e55-40fb-a479-7798ce80616a tempest-CreateVolumesFromImageTest-1307702323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:29:22 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a718e5c2-8e55-40fb-a479-7798ce80616a tempest-CreateVolumesFromImageTest-1307702323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:29:22 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a718e5c2-8e55-40fb-a479-7798ce80616a tempest-CreateVolumesFromImageTest-1307702323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:29:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a718e5c2-8e55-40fb-a479-7798ce80616a tempest-CreateVolumesFromImageTest-1307702323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:29:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a718e5c2-8e55-40fb-a479-7798ce80616a tempest-CreateVolumesFromImageTest-1307702323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:29:22 devstack sudo[106321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:29:22 devstack sudo[106321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:29:22 devstack sudo[106321]: pam_unix(sudo:session): session closed for user root Nov 04 12:29:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a718e5c2-8e55-40fb-a479-7798ce80616a tempest-CreateVolumesFromImageTest-1307702323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.238s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:29:22 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-a718e5c2-8e55-40fb-a479-7798ce80616a tempest-CreateVolumesFromImageTest-1307702323 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:29:22 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-a718e5c2-8e55-40fb-a479-7798ce80616a tempest-CreateVolumesFromImageTest-1307702323 None] Deleted volume successfully. Nov 04 12:29:23 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a718e5c2-8e55-40fb-a479-7798ce80616a tempest-CreateVolumesFromImageTest-1307702323 None] Lock "cinder-708968b8-2cea-4f55-8e87-89e6eb90bdc6-delete_volume" released by "delete_volume" :: held 1.026s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:29:23 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-4c767c81-19d8-4e77-8bbf-b6d52e45742b tempest-CreateVolumesFromImageTest-1307702323 None] Acquiring lock "cinder-88ff9d34-a895-4cbe-ac8d-fbbef3034e16-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:29:23 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-4c767c81-19d8-4e77-8bbf-b6d52e45742b tempest-CreateVolumesFromImageTest-1307702323 None] Lock "cinder-88ff9d34-a895-4cbe-ac8d-fbbef3034e16-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:29:23 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-4c767c81-19d8-4e77-8bbf-b6d52e45742b tempest-CreateVolumesFromImageTest-1307702323 None] Acquiring lock "cinder-quobyte-88ff9d34-a895-4cbe-ac8d-fbbef3034e16" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:29:23 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-4c767c81-19d8-4e77-8bbf-b6d52e45742b tempest-CreateVolumesFromImageTest-1307702323 None] Lock "cinder-quobyte-88ff9d34-a895-4cbe-ac8d-fbbef3034e16" acquired by "delete_volume" :: waited 0.014s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:29:23 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1c9ee8-466c-4506-a52d-2a943c8ba48e]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:29:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4c767c81-19d8-4e77-8bbf-b6d52e45742b tempest-CreateVolumesFromImageTest-1307702323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-88ff9d34-a895-4cbe-ac8d-fbbef3034e16 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:29:23 devstack sudo[106324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-88ff9d34-a895-4cbe-ac8d-fbbef3034e16 Nov 04 12:29:23 devstack sudo[106324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:29:23 devstack sudo[106324]: pam_unix(sudo:session): session closed for user root Nov 04 12:29:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4c767c81-19d8-4e77-8bbf-b6d52e45742b tempest-CreateVolumesFromImageTest-1307702323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-88ff9d34-a895-4cbe-ac8d-fbbef3034e16" returned: 0 in 0.346s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:29:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4c767c81-19d8-4e77-8bbf-b6d52e45742b tempest-CreateVolumesFromImageTest-1307702323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-88ff9d34-a895-4cbe-ac8d-fbbef3034e16 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:29:23 devstack sudo[106330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-88ff9d34-a895-4cbe-ac8d-fbbef3034e16 Nov 04 12:29:23 devstack sudo[106330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:29:23 devstack sudo[106330]: pam_unix(sudo:session): session closed for user root Nov 04 12:29:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4c767c81-19d8-4e77-8bbf-b6d52e45742b tempest-CreateVolumesFromImageTest-1307702323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-88ff9d34-a895-4cbe-ac8d-fbbef3034e16" returned: 0 in 0.235s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:29:23 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-4c767c81-19d8-4e77-8bbf-b6d52e45742b tempest-CreateVolumesFromImageTest-1307702323 None] Lock "cinder-quobyte-88ff9d34-a895-4cbe-ac8d-fbbef3034e16" released by "delete_volume" :: held 0.617s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:29:23 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-4c767c81-19d8-4e77-8bbf-b6d52e45742b tempest-CreateVolumesFromImageTest-1307702323 None] Created reservations ['5e74f358-49ee-4120-acc7-6b0f583f6af3', '6bfbaa37-bbab-4cba-9fcc-da340cc7acc9', '222b9c24-f2b5-4159-ad5e-256fc0a7c0b5', '92b47a1a-589d-4131-afa9-d19fba81c3e4'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:29:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4c767c81-19d8-4e77-8bbf-b6d52e45742b tempest-CreateVolumesFromImageTest-1307702323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:29:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4c767c81-19d8-4e77-8bbf-b6d52e45742b tempest-CreateVolumesFromImageTest-1307702323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:29:23 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4c767c81-19d8-4e77-8bbf-b6d52e45742b tempest-CreateVolumesFromImageTest-1307702323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:29:23 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4c767c81-19d8-4e77-8bbf-b6d52e45742b tempest-CreateVolumesFromImageTest-1307702323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:29:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4c767c81-19d8-4e77-8bbf-b6d52e45742b tempest-CreateVolumesFromImageTest-1307702323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:29:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4c767c81-19d8-4e77-8bbf-b6d52e45742b tempest-CreateVolumesFromImageTest-1307702323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:29:23 devstack sudo[106333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:29:23 devstack sudo[106333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:29:24 devstack sudo[106333]: pam_unix(sudo:session): session closed for user root Nov 04 12:29:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4c767c81-19d8-4e77-8bbf-b6d52e45742b tempest-CreateVolumesFromImageTest-1307702323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.233s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:29:24 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-4c767c81-19d8-4e77-8bbf-b6d52e45742b tempest-CreateVolumesFromImageTest-1307702323 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:29:24 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-4c767c81-19d8-4e77-8bbf-b6d52e45742b tempest-CreateVolumesFromImageTest-1307702323 None] Deleted volume successfully. Nov 04 12:29:24 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-4c767c81-19d8-4e77-8bbf-b6d52e45742b tempest-CreateVolumesFromImageTest-1307702323 None] Lock "cinder-88ff9d34-a895-4cbe-ac8d-fbbef3034e16-delete_volume" released by "delete_volume" :: held 1.029s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:29:34 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:UPDATE=154,cinder:SELECT=94,cinder:INSERT=37,cinder:DELETE=15 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 12:29:35 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=115,cinder:UPDATE=130,cinder:INSERT=32,cinder:DELETE=10 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 12:29:45 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-e24be99c-2739-4c2d-8a65-5b9e2cf88ef0 tempest-SnapshotDependencyTests-810240526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:29:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e24be99c-2739-4c2d-8a65-5b9e2cf88ef0 tempest-SnapshotDependencyTests-810240526 None] Flow 'volume_create_manager' (a24c8332-e664-4237-b284-f97aa49e228f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:29:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e24be99c-2739-4c2d-8a65-5b9e2cf88ef0 tempest-SnapshotDependencyTests-810240526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5976675a-b6ce-41ec-8ee6-6d2594aaa01e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:29:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e24be99c-2739-4c2d-8a65-5b9e2cf88ef0 tempest-SnapshotDependencyTests-810240526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5976675a-b6ce-41ec-8ee6-6d2594aaa01e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:29:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-147678248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30cb0adf-f403-470c-a0a0-14c993a315c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b06f148ef6b44f2bb01c778a8e376a61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:29:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:29:46Z,use_quota=True,user_id='974be15ee12c4ca4acbde0cae63a3680',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:29:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e24be99c-2739-4c2d-8a65-5b9e2cf88ef0 tempest-SnapshotDependencyTests-810240526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (030ff94e-e7a9-49a1-9f8d-3204808c331c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:29:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e24be99c-2739-4c2d-8a65-5b9e2cf88ef0 tempest-SnapshotDependencyTests-810240526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (030ff94e-e7a9-49a1-9f8d-3204808c331c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:29:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e24be99c-2739-4c2d-8a65-5b9e2cf88ef0 tempest-SnapshotDependencyTests-810240526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b01ba09-71bf-4ded-897f-c5d493366295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:29:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e24be99c-2739-4c2d-8a65-5b9e2cf88ef0 tempest-SnapshotDependencyTests-810240526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b01ba09-71bf-4ded-897f-c5d493366295) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30cb0adf-f403-470c-a0a0-14c993a315c5', 'volume_name': 'volume-30cb0adf-f403-470c-a0a0-14c993a315c5', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:29:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e24be99c-2739-4c2d-8a65-5b9e2cf88ef0 tempest-SnapshotDependencyTests-810240526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7658a886-e175-42e1-a8c8-848f8742e109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:29:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e24be99c-2739-4c2d-8a65-5b9e2cf88ef0 tempest-SnapshotDependencyTests-810240526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7658a886-e175-42e1-a8c8-848f8742e109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:29:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e24be99c-2739-4c2d-8a65-5b9e2cf88ef0 tempest-SnapshotDependencyTests-810240526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63c4e087-e29f-4038-b5f2-27e1d98b6a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:29:45 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-e24be99c-2739-4c2d-8a65-5b9e2cf88ef0 tempest-SnapshotDependencyTests-810240526 None] Volume 30cb0adf-f403-470c-a0a0-14c993a315c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30cb0adf-f403-470c-a0a0-14c993a315c5', 'volume_size': 1} Nov 04 12:29:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e24be99c-2739-4c2d-8a65-5b9e2cf88ef0 tempest-SnapshotDependencyTests-810240526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:29:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e24be99c-2739-4c2d-8a65-5b9e2cf88ef0 tempest-SnapshotDependencyTests-810240526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:29:45 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e24be99c-2739-4c2d-8a65-5b9e2cf88ef0 tempest-SnapshotDependencyTests-810240526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:29:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-147678248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30cb0adf-f403-470c-a0a0-14c993a315c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b06f148ef6b44f2bb01c778a8e376a61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:29:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:29:46Z,use_quota=True,user_id='974be15ee12c4ca4acbde0cae63a3680',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:29:45 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-e24be99c-2739-4c2d-8a65-5b9e2cf88ef0 tempest-SnapshotDependencyTests-810240526 None] Creating volume 30cb0adf-f403-470c-a0a0-14c993a315c5 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:29:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e24be99c-2739-4c2d-8a65-5b9e2cf88ef0 tempest-SnapshotDependencyTests-810240526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:29:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e24be99c-2739-4c2d-8a65-5b9e2cf88ef0 tempest-SnapshotDependencyTests-810240526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:29:45 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e24be99c-2739-4c2d-8a65-5b9e2cf88ef0 tempest-SnapshotDependencyTests-810240526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:29:45 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e24be99c-2739-4c2d-8a65-5b9e2cf88ef0 tempest-SnapshotDependencyTests-810240526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:29:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e24be99c-2739-4c2d-8a65-5b9e2cf88ef0 tempest-SnapshotDependencyTests-810240526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:29:45 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e24be99c-2739-4c2d-8a65-5b9e2cf88ef0 tempest-SnapshotDependencyTests-810240526 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:29:45 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-e24be99c-2739-4c2d-8a65-5b9e2cf88ef0 tempest-SnapshotDependencyTests-810240526 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:29:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e24be99c-2739-4c2d-8a65-5b9e2cf88ef0 tempest-SnapshotDependencyTests-810240526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-30cb0adf-f403-470c-a0a0-14c993a315c5 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:29:45 devstack sudo[106382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-30cb0adf-f403-470c-a0a0-14c993a315c5 1073741824 Nov 04 12:29:45 devstack sudo[106382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:29:46 devstack sudo[106382]: pam_unix(sudo:session): session closed for user root Nov 04 12:29:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e24be99c-2739-4c2d-8a65-5b9e2cf88ef0 tempest-SnapshotDependencyTests-810240526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-30cb0adf-f403-470c-a0a0-14c993a315c5 1073741824" returned: 0 in 0.403s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:29:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e24be99c-2739-4c2d-8a65-5b9e2cf88ef0 tempest-SnapshotDependencyTests-810240526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-30cb0adf-f403-470c-a0a0-14c993a315c5 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:29:46 devstack sudo[106387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-30cb0adf-f403-470c-a0a0-14c993a315c5 Nov 04 12:29:46 devstack sudo[106387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:29:46 devstack sudo[106387]: pam_unix(sudo:session): session closed for user root Nov 04 12:29:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e24be99c-2739-4c2d-8a65-5b9e2cf88ef0 tempest-SnapshotDependencyTests-810240526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-30cb0adf-f403-470c-a0a0-14c993a315c5" returned: 0 in 0.246s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:29:46 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e24be99c-2739-4c2d-8a65-5b9e2cf88ef0 tempest-SnapshotDependencyTests-810240526 None] <== create_volume: return (690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:29:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e24be99c-2739-4c2d-8a65-5b9e2cf88ef0 tempest-SnapshotDependencyTests-810240526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:29:46 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e24be99c-2739-4c2d-8a65-5b9e2cf88ef0 tempest-SnapshotDependencyTests-810240526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63c4e087-e29f-4038-b5f2-27e1d98b6a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30cb0adf-f403-470c-a0a0-14c993a315c5', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:29:46 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e24be99c-2739-4c2d-8a65-5b9e2cf88ef0 tempest-SnapshotDependencyTests-810240526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (499b8dbf-5093-4af7-b5a9-b9ce527c0ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:29:46 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-e24be99c-2739-4c2d-8a65-5b9e2cf88ef0 tempest-SnapshotDependencyTests-810240526 None] Volume volume-30cb0adf-f403-470c-a0a0-14c993a315c5 (30cb0adf-f403-470c-a0a0-14c993a315c5): created successfully Nov 04 12:29:46 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e24be99c-2739-4c2d-8a65-5b9e2cf88ef0 tempest-SnapshotDependencyTests-810240526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (499b8dbf-5093-4af7-b5a9-b9ce527c0ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:29:46 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e24be99c-2739-4c2d-8a65-5b9e2cf88ef0 tempest-SnapshotDependencyTests-810240526 None] Flow 'volume_create_manager' (a24c8332-e664-4237-b284-f97aa49e228f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:29:46 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-e24be99c-2739-4c2d-8a65-5b9e2cf88ef0 tempest-SnapshotDependencyTests-810240526 None] Created volume successfully. Nov 04 12:29:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-75632973-b4cb-412d-88e5-3ca4711346a4 tempest-SnapshotDependencyTests-810240526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:29:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-75632973-b4cb-412d-88e5-3ca4711346a4 tempest-SnapshotDependencyTests-810240526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:29:46 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-75632973-b4cb-412d-88e5-3ca4711346a4 tempest-SnapshotDependencyTests-810240526 None] Creating offline snapshot 6daf4a57-a23a-4095-b911-0801c3a9d2eb of volume 30cb0adf-f403-470c-a0a0-14c993a315c5 {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 12:29:46 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[364d1da1-14db-4a8a-8a8a-8db5157596c7]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:29:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-75632973-b4cb-412d-88e5-3ca4711346a4 tempest-SnapshotDependencyTests-810240526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-30cb0adf-f403-470c-a0a0-14c993a315c5 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:29:47 devstack sudo[106390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-30cb0adf-f403-470c-a0a0-14c993a315c5 Nov 04 12:29:47 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:29:47 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root Nov 04 12:29:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-75632973-b4cb-412d-88e5-3ca4711346a4 tempest-SnapshotDependencyTests-810240526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-30cb0adf-f403-470c-a0a0-14c993a315c5" returned: 0 in 0.343s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:29:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-75632973-b4cb-412d-88e5-3ca4711346a4 tempest-SnapshotDependencyTests-810240526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-30cb0adf-f403-470c-a0a0-14c993a315c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-30cb0adf-f403-470c-a0a0-14c993a315c5.6daf4a57-a23a-4095-b911-0801c3a9d2eb 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:29:47 devstack sudo[106395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-30cb0adf-f403-470c-a0a0-14c993a315c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-30cb0adf-f403-470c-a0a0-14c993a315c5.6daf4a57-a23a-4095-b911-0801c3a9d2eb 1G Nov 04 12:29:47 devstack sudo[106395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:29:47 devstack sudo[106395]: pam_unix(sudo:session): session closed for user root Nov 04 12:29:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-75632973-b4cb-412d-88e5-3ca4711346a4 tempest-SnapshotDependencyTests-810240526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-30cb0adf-f403-470c-a0a0-14c993a315c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-30cb0adf-f403-470c-a0a0-14c993a315c5.6daf4a57-a23a-4095-b911-0801c3a9d2eb 1G" returned: 0 in 0.384s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:29:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-75632973-b4cb-412d-88e5-3ca4711346a4 tempest-SnapshotDependencyTests-810240526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30cb0adf-f403-470c-a0a0-14c993a315c5 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-30cb0adf-f403-470c-a0a0-14c993a315c5.6daf4a57-a23a-4095-b911-0801c3a9d2eb {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:29:47 devstack sudo[106400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30cb0adf-f403-470c-a0a0-14c993a315c5 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-30cb0adf-f403-470c-a0a0-14c993a315c5.6daf4a57-a23a-4095-b911-0801c3a9d2eb Nov 04 12:29:47 devstack sudo[106400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:29:47 devstack sudo[106400]: pam_unix(sudo:session): session closed for user root Nov 04 12:29:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-75632973-b4cb-412d-88e5-3ca4711346a4 tempest-SnapshotDependencyTests-810240526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30cb0adf-f403-470c-a0a0-14c993a315c5 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-30cb0adf-f403-470c-a0a0-14c993a315c5.6daf4a57-a23a-4095-b911-0801c3a9d2eb" returned: 0 in 0.309s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:29:47 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-75632973-b4cb-412d-88e5-3ca4711346a4 tempest-SnapshotDependencyTests-810240526 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-30cb0adf-f403-470c-a0a0-14c993a315c5.6daf4a57-a23a-4095-b911-0801c3a9d2eb is being set with open permissions: ugo+rw Nov 04 12:29:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-75632973-b4cb-412d-88e5-3ca4711346a4 tempest-SnapshotDependencyTests-810240526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-30cb0adf-f403-470c-a0a0-14c993a315c5.6daf4a57-a23a-4095-b911-0801c3a9d2eb {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:29:47 devstack sudo[106406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-30cb0adf-f403-470c-a0a0-14c993a315c5.6daf4a57-a23a-4095-b911-0801c3a9d2eb Nov 04 12:29:47 devstack sudo[106406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:29:48 devstack sudo[106406]: pam_unix(sudo:session): session closed for user root Nov 04 12:29:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-75632973-b4cb-412d-88e5-3ca4711346a4 tempest-SnapshotDependencyTests-810240526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-30cb0adf-f403-470c-a0a0-14c993a315c5.6daf4a57-a23a-4095-b911-0801c3a9d2eb" returned: 0 in 0.237s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:29:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-75632973-b4cb-412d-88e5-3ca4711346a4 tempest-SnapshotDependencyTests-810240526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-30cb0adf-f403-470c-a0a0-14c993a315c5.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:29:48 devstack sudo[106409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-30cb0adf-f403-470c-a0a0-14c993a315c5.info Nov 04 12:29:48 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:29:48 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root Nov 04 12:29:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-75632973-b4cb-412d-88e5-3ca4711346a4 tempest-SnapshotDependencyTests-810240526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-30cb0adf-f403-470c-a0a0-14c993a315c5.info" returned: 0 in 0.240s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:29:48 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-75632973-b4cb-412d-88e5-3ca4711346a4 tempest-SnapshotDependencyTests-810240526 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-30cb0adf-f403-470c-a0a0-14c993a315c5.info is being set with open permissions: ugo+rw Nov 04 12:29:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-75632973-b4cb-412d-88e5-3ca4711346a4 tempest-SnapshotDependencyTests-810240526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-30cb0adf-f403-470c-a0a0-14c993a315c5.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:29:48 devstack sudo[106412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-30cb0adf-f403-470c-a0a0-14c993a315c5.info Nov 04 12:29:48 devstack sudo[106412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:29:48 devstack sudo[106412]: pam_unix(sudo:session): session closed for user root Nov 04 12:29:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-75632973-b4cb-412d-88e5-3ca4711346a4 tempest-SnapshotDependencyTests-810240526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-30cb0adf-f403-470c-a0a0-14c993a315c5.info" returned: 0 in 0.233s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:29:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-75632973-b4cb-412d-88e5-3ca4711346a4 tempest-SnapshotDependencyTests-810240526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.830s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:29:48 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-75632973-b4cb-412d-88e5-3ca4711346a4 tempest-SnapshotDependencyTests-810240526 None] Create snapshot completed successfully Nov 04 12:29:49 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab490196-de2f-4805-a759-cc3a49cbe513 tempest-SnapshotDependencyTests-810240526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:29:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ab490196-de2f-4805-a759-cc3a49cbe513 tempest-SnapshotDependencyTests-810240526 None] Flow 'volume_create_manager' (e477a936-2b9e-4d0d-b35c-a1a180e75064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:29:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ab490196-de2f-4805-a759-cc3a49cbe513 tempest-SnapshotDependencyTests-810240526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a5311b2-3339-46c3-a34e-17359e4e7b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:29:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ab490196-de2f-4805-a759-cc3a49cbe513 tempest-SnapshotDependencyTests-810240526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a5311b2-3339-46c3-a34e-17359e4e7b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:29:49Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f77b039b-55fa-4808-a147-5722f17d8656,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b06f148ef6b44f2bb01c778a8e376a61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:29:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6daf4a57-a23a-4095-b911-0801c3a9d2eb,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:29:49Z,use_quota=True,user_id='974be15ee12c4ca4acbde0cae63a3680',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:29:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ab490196-de2f-4805-a759-cc3a49cbe513 tempest-SnapshotDependencyTests-810240526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d92c872-6cda-4984-ab05-ffa0f29b08ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:29:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ab490196-de2f-4805-a759-cc3a49cbe513 tempest-SnapshotDependencyTests-810240526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d92c872-6cda-4984-ab05-ffa0f29b08ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:29:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ab490196-de2f-4805-a759-cc3a49cbe513 tempest-SnapshotDependencyTests-810240526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92b4bfd6-4def-46af-9460-2c183ace1aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:29:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ab490196-de2f-4805-a759-cc3a49cbe513 tempest-SnapshotDependencyTests-810240526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92b4bfd6-4def-46af-9460-2c183ace1aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f77b039b-55fa-4808-a147-5722f17d8656', 'volume_name': 'volume-f77b039b-55fa-4808-a147-5722f17d8656', 'volume_size': 1, 'snapshot_id': '6daf4a57-a23a-4095-b911-0801c3a9d2eb'}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:29:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ab490196-de2f-4805-a759-cc3a49cbe513 tempest-SnapshotDependencyTests-810240526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba7bb942-00c2-49a2-beab-8665fbe6497e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:29:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ab490196-de2f-4805-a759-cc3a49cbe513 tempest-SnapshotDependencyTests-810240526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba7bb942-00c2-49a2-beab-8665fbe6497e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:29:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ab490196-de2f-4805-a759-cc3a49cbe513 tempest-SnapshotDependencyTests-810240526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31867ecb-418f-43e4-b173-f64d68e125a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:29:49 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-ab490196-de2f-4805-a759-cc3a49cbe513 tempest-SnapshotDependencyTests-810240526 None] Volume f77b039b-55fa-4808-a147-5722f17d8656: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f77b039b-55fa-4808-a147-5722f17d8656', 'volume_size': 1, 'snapshot_id': '6daf4a57-a23a-4095-b911-0801c3a9d2eb'} Nov 04 12:29:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ab490196-de2f-4805-a759-cc3a49cbe513 tempest-SnapshotDependencyTests-810240526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:29:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ab490196-de2f-4805-a759-cc3a49cbe513 tempest-SnapshotDependencyTests-810240526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:29:49 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ab490196-de2f-4805-a759-cc3a49cbe513 tempest-SnapshotDependencyTests-810240526 None] Acquiring lock "cinder-quobyte-6daf4a57-a23a-4095-b911-0801c3a9d2eb-f77b039b-55fa-4808-a147-5722f17d8656" by "_create_volume_from_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:29:49 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ab490196-de2f-4805-a759-cc3a49cbe513 tempest-SnapshotDependencyTests-810240526 None] Lock "cinder-quobyte-6daf4a57-a23a-4095-b911-0801c3a9d2eb-f77b039b-55fa-4808-a147-5722f17d8656" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:29:49 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ab490196-de2f-4805-a759-cc3a49cbe513 tempest-SnapshotDependencyTests-810240526 None] Creating volume f77b039b-55fa-4808-a147-5722f17d8656 from snapshot 6daf4a57-a23a-4095-b911-0801c3a9d2eb {{(pid=87095) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 04 12:29:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ab490196-de2f-4805-a759-cc3a49cbe513 tempest-SnapshotDependencyTests-810240526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:29:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ab490196-de2f-4805-a759-cc3a49cbe513 tempest-SnapshotDependencyTests-810240526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:29:49 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ab490196-de2f-4805-a759-cc3a49cbe513 tempest-SnapshotDependencyTests-810240526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:29:49 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ab490196-de2f-4805-a759-cc3a49cbe513 tempest-SnapshotDependencyTests-810240526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:29:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ab490196-de2f-4805-a759-cc3a49cbe513 tempest-SnapshotDependencyTests-810240526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:29:49 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ab490196-de2f-4805-a759-cc3a49cbe513 tempest-SnapshotDependencyTests-810240526 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:29:49 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ab490196-de2f-4805-a759-cc3a49cbe513 tempest-SnapshotDependencyTests-810240526 None] Acquiring lock "cinder-quobyte-f77b039b-55fa-4808-a147-5722f17d8656" by "_copy_volume_from_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:29:49 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ab490196-de2f-4805-a759-cc3a49cbe513 tempest-SnapshotDependencyTests-810240526 None] Lock "cinder-quobyte-f77b039b-55fa-4808-a147-5722f17d8656" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:29:49 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ab490196-de2f-4805-a759-cc3a49cbe513 tempest-SnapshotDependencyTests-810240526 None] snapshot: 6daf4a57-a23a-4095-b911-0801c3a9d2eb, volume: f77b039b-55fa-4808-a147-5722f17d8656, {{(pid=87095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 12:29:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ab490196-de2f-4805-a759-cc3a49cbe513 tempest-SnapshotDependencyTests-810240526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:29:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ab490196-de2f-4805-a759-cc3a49cbe513 tempest-SnapshotDependencyTests-810240526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:29:49 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ab490196-de2f-4805-a759-cc3a49cbe513 tempest-SnapshotDependencyTests-810240526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:29:49 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ab490196-de2f-4805-a759-cc3a49cbe513 tempest-SnapshotDependencyTests-810240526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:29:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ab490196-de2f-4805-a759-cc3a49cbe513 tempest-SnapshotDependencyTests-810240526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:29:49 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca95a08a-c966-40d9-8f03-cb7cd7f9f1a7]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:29:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ab490196-de2f-4805-a759-cc3a49cbe513 tempest-SnapshotDependencyTests-810240526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-30cb0adf-f403-470c-a0a0-14c993a315c5.6daf4a57-a23a-4095-b911-0801c3a9d2eb {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:29:49 devstack sudo[106415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-30cb0adf-f403-470c-a0a0-14c993a315c5.6daf4a57-a23a-4095-b911-0801c3a9d2eb Nov 04 12:29:49 devstack sudo[106415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:29:50 devstack sudo[106415]: pam_unix(sudo:session): session closed for user root Nov 04 12:29:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ab490196-de2f-4805-a759-cc3a49cbe513 tempest-SnapshotDependencyTests-810240526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-30cb0adf-f403-470c-a0a0-14c993a315c5.6daf4a57-a23a-4095-b911-0801c3a9d2eb" returned: 0 in 0.367s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:29:50 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-ab490196-de2f-4805-a759-cc3a49cbe513 tempest-SnapshotDependencyTests-810240526 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30cb0adf-f403-470c-a0a0-14c993a315c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 12:29:50 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e400c75c-0a6f-4464-95e7-ced92b54ac9b]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:29:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ab490196-de2f-4805-a759-cc3a49cbe513 tempest-SnapshotDependencyTests-810240526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-30cb0adf-f403-470c-a0a0-14c993a315c5 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:29:50 devstack sudo[106420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-30cb0adf-f403-470c-a0a0-14c993a315c5 Nov 04 12:29:50 devstack sudo[106420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:29:50 devstack sudo[106420]: pam_unix(sudo:session): session closed for user root Nov 04 12:29:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ab490196-de2f-4805-a759-cc3a49cbe513 tempest-SnapshotDependencyTests-810240526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-30cb0adf-f403-470c-a0a0-14c993a315c5" returned: 0 in 0.370s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:29:50 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ab490196-de2f-4805-a759-cc3a49cbe513 tempest-SnapshotDependencyTests-810240526 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-30cb0adf-f403-470c-a0a0-14c993a315c5 {{(pid=87095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 12:29:50 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ab490196-de2f-4805-a759-cc3a49cbe513 tempest-SnapshotDependencyTests-810240526 None] Creating direct copy from snapshot {{(pid=87095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 12:29:50 devstack cinder-volume[87095]: DEBUG cinder.utils [None req-ab490196-de2f-4805-a759-cc3a49cbe513 tempest-SnapshotDependencyTests-810240526 None] Path /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f77b039b-55fa-4808-a147-5722f17d8656 not found in is_blk_device check {{(pid=87095) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 04 12:29:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ab490196-de2f-4805-a759-cc3a49cbe513 tempest-SnapshotDependencyTests-810240526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-30cb0adf-f403-470c-a0a0-14c993a315c5 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f77b039b-55fa-4808-a147-5722f17d8656 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:29:50 devstack sudo[106425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-30cb0adf-f403-470c-a0a0-14c993a315c5 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f77b039b-55fa-4808-a147-5722f17d8656 Nov 04 12:29:50 devstack sudo[106425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:29:56 devstack sudo[106425]: pam_unix(sudo:session): session closed for user root Nov 04 12:29:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ab490196-de2f-4805-a759-cc3a49cbe513 tempest-SnapshotDependencyTests-810240526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-30cb0adf-f403-470c-a0a0-14c993a315c5 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f77b039b-55fa-4808-a147-5722f17d8656" returned: 0 in 5.726s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:29:56 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-ab490196-de2f-4805-a759-cc3a49cbe513 tempest-SnapshotDependencyTests-810240526 None] Image conversion details: src /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-30cb0adf-f403-470c-a0a0-14c993a315c5, size 1024.00 MB, duration 5.73 sec, destination /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f77b039b-55fa-4808-a147-5722f17d8656 {{(pid=87095) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 12:29:56 devstack cinder-volume[87095]: INFO cinder.image.image_utils [None req-ab490196-de2f-4805-a759-cc3a49cbe513 tempest-SnapshotDependencyTests-810240526 None] Converted 1024.00 MB image at 178.79 MB/s Nov 04 12:29:56 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-ab490196-de2f-4805-a759-cc3a49cbe513 tempest-SnapshotDependencyTests-810240526 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f77b039b-55fa-4808-a147-5722f17d8656 is being set with open permissions: ugo+rw Nov 04 12:29:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ab490196-de2f-4805-a759-cc3a49cbe513 tempest-SnapshotDependencyTests-810240526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f77b039b-55fa-4808-a147-5722f17d8656 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:29:56 devstack sudo[106441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f77b039b-55fa-4808-a147-5722f17d8656 Nov 04 12:29:56 devstack sudo[106441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:29:56 devstack sudo[106441]: pam_unix(sudo:session): session closed for user root Nov 04 12:29:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ab490196-de2f-4805-a759-cc3a49cbe513 tempest-SnapshotDependencyTests-810240526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f77b039b-55fa-4808-a147-5722f17d8656" returned: 0 in 0.232s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:29:56 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ab490196-de2f-4805-a759-cc3a49cbe513 tempest-SnapshotDependencyTests-810240526 None] Lock "cinder-quobyte-f77b039b-55fa-4808-a147-5722f17d8656" released by "_copy_volume_from_snapshot" :: held 6.779s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:29:56 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ab490196-de2f-4805-a759-cc3a49cbe513 tempest-SnapshotDependencyTests-810240526 None] Lock "cinder-quobyte-6daf4a57-a23a-4095-b911-0801c3a9d2eb-f77b039b-55fa-4808-a147-5722f17d8656" released by "_create_volume_from_snapshot" :: held 6.838s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:29:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ab490196-de2f-4805-a759-cc3a49cbe513 tempest-SnapshotDependencyTests-810240526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.853s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:29:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ab490196-de2f-4805-a759-cc3a49cbe513 tempest-SnapshotDependencyTests-810240526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31867ecb-418f-43e4-b173-f64d68e125a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f77b039b-55fa-4808-a147-5722f17d8656', 'volume_size': 1, 'snapshot_id': '6daf4a57-a23a-4095-b911-0801c3a9d2eb'}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:29:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ab490196-de2f-4805-a759-cc3a49cbe513 tempest-SnapshotDependencyTests-810240526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c228cd0f-f4f6-4c96-9306-9d3a778cdb73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:29:56 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-ab490196-de2f-4805-a759-cc3a49cbe513 tempest-SnapshotDependencyTests-810240526 None] Volume volume-f77b039b-55fa-4808-a147-5722f17d8656 (f77b039b-55fa-4808-a147-5722f17d8656): created successfully Nov 04 12:29:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ab490196-de2f-4805-a759-cc3a49cbe513 tempest-SnapshotDependencyTests-810240526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c228cd0f-f4f6-4c96-9306-9d3a778cdb73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:29:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ab490196-de2f-4805-a759-cc3a49cbe513 tempest-SnapshotDependencyTests-810240526 None] Flow 'volume_create_manager' (e477a936-2b9e-4d0d-b35c-a1a180e75064) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:29:56 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-ab490196-de2f-4805-a759-cc3a49cbe513 tempest-SnapshotDependencyTests-810240526 None] Created volume successfully. Nov 04 12:29:57 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-4d09b4c0-6a2d-4c2e-84ae-d2ad48a2caa7 tempest-SnapshotDependencyTests-810240526 None] Acquiring lock "cinder-6daf4a57-a23a-4095-b911-0801c3a9d2eb-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:29:57 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-4d09b4c0-6a2d-4c2e-84ae-d2ad48a2caa7 tempest-SnapshotDependencyTests-810240526 None] Lock "cinder-6daf4a57-a23a-4095-b911-0801c3a9d2eb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:29:57 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-4d09b4c0-6a2d-4c2e-84ae-d2ad48a2caa7 tempest-SnapshotDependencyTests-810240526 None] Acquiring lock "cinder-quobyte-30cb0adf-f403-470c-a0a0-14c993a315c5" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:29:57 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-4d09b4c0-6a2d-4c2e-84ae-d2ad48a2caa7 tempest-SnapshotDependencyTests-810240526 None] Lock "cinder-quobyte-30cb0adf-f403-470c-a0a0-14c993a315c5" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:29:57 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-4d09b4c0-6a2d-4c2e-84ae-d2ad48a2caa7 tempest-SnapshotDependencyTests-810240526 None] Acquiring lock "cinder-quobyte-6daf4a57-a23a-4095-b911-0801c3a9d2eb" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:29:57 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-4d09b4c0-6a2d-4c2e-84ae-d2ad48a2caa7 tempest-SnapshotDependencyTests-810240526 None] Lock "cinder-quobyte-6daf4a57-a23a-4095-b911-0801c3a9d2eb" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:29:57 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-4d09b4c0-6a2d-4c2e-84ae-d2ad48a2caa7 tempest-SnapshotDependencyTests-810240526 None] Deleting offline snapshot 6daf4a57-a23a-4095-b911-0801c3a9d2eb of volume 30cb0adf-f403-470c-a0a0-14c993a315c5 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 12:29:57 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-4d09b4c0-6a2d-4c2e-84ae-d2ad48a2caa7 tempest-SnapshotDependencyTests-810240526 None] snapshot_file for this snap is: volume-30cb0adf-f403-470c-a0a0-14c993a315c5.6daf4a57-a23a-4095-b911-0801c3a9d2eb {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 12:29:57 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2070627-acdb-4179-a033-daea0692ba6c]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:29:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4d09b4c0-6a2d-4c2e-84ae-d2ad48a2caa7 tempest-SnapshotDependencyTests-810240526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-30cb0adf-f403-470c-a0a0-14c993a315c5.6daf4a57-a23a-4095-b911-0801c3a9d2eb {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:29:57 devstack sudo[106444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-30cb0adf-f403-470c-a0a0-14c993a315c5.6daf4a57-a23a-4095-b911-0801c3a9d2eb Nov 04 12:29:57 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:29:57 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root Nov 04 12:29:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4d09b4c0-6a2d-4c2e-84ae-d2ad48a2caa7 tempest-SnapshotDependencyTests-810240526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-30cb0adf-f403-470c-a0a0-14c993a315c5.6daf4a57-a23a-4095-b911-0801c3a9d2eb" returned: 0 in 0.338s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:29:57 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-4d09b4c0-6a2d-4c2e-84ae-d2ad48a2caa7 tempest-SnapshotDependencyTests-810240526 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30cb0adf-f403-470c-a0a0-14c993a315c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 12:29:57 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f08977-ba40-412d-8d0a-57b0c60af539]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:29:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4d09b4c0-6a2d-4c2e-84ae-d2ad48a2caa7 tempest-SnapshotDependencyTests-810240526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-30cb0adf-f403-470c-a0a0-14c993a315c5 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:29:57 devstack sudo[106449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-30cb0adf-f403-470c-a0a0-14c993a315c5 Nov 04 12:29:57 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:29:58 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root Nov 04 12:29:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4d09b4c0-6a2d-4c2e-84ae-d2ad48a2caa7 tempest-SnapshotDependencyTests-810240526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-30cb0adf-f403-470c-a0a0-14c993a315c5" returned: 0 in 0.502s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:29:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4d09b4c0-6a2d-4c2e-84ae-d2ad48a2caa7 tempest-SnapshotDependencyTests-810240526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-30cb0adf-f403-470c-a0a0-14c993a315c5.6daf4a57-a23a-4095-b911-0801c3a9d2eb {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:29:58 devstack sudo[106454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-30cb0adf-f403-470c-a0a0-14c993a315c5.6daf4a57-a23a-4095-b911-0801c3a9d2eb Nov 04 12:29:58 devstack sudo[106454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:29:58 devstack sudo[106454]: pam_unix(sudo:session): session closed for user root Nov 04 12:29:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4d09b4c0-6a2d-4c2e-84ae-d2ad48a2caa7 tempest-SnapshotDependencyTests-810240526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-30cb0adf-f403-470c-a0a0-14c993a315c5.6daf4a57-a23a-4095-b911-0801c3a9d2eb" returned: 0 in 0.307s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:29:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4d09b4c0-6a2d-4c2e-84ae-d2ad48a2caa7 tempest-SnapshotDependencyTests-810240526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-30cb0adf-f403-470c-a0a0-14c993a315c5.6daf4a57-a23a-4095-b911-0801c3a9d2eb {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:29:58 devstack sudo[106459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-30cb0adf-f403-470c-a0a0-14c993a315c5.6daf4a57-a23a-4095-b911-0801c3a9d2eb Nov 04 12:29:58 devstack sudo[106459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:29:58 devstack sudo[106459]: pam_unix(sudo:session): session closed for user root Nov 04 12:29:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4d09b4c0-6a2d-4c2e-84ae-d2ad48a2caa7 tempest-SnapshotDependencyTests-810240526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-30cb0adf-f403-470c-a0a0-14c993a315c5.6daf4a57-a23a-4095-b911-0801c3a9d2eb" returned: 0 in 0.242s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:29:58 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-4d09b4c0-6a2d-4c2e-84ae-d2ad48a2caa7 tempest-SnapshotDependencyTests-810240526 None] Lock "cinder-quobyte-6daf4a57-a23a-4095-b911-0801c3a9d2eb" released by "_delete_snapshot" :: held 1.501s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:29:58 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-4d09b4c0-6a2d-4c2e-84ae-d2ad48a2caa7 tempest-SnapshotDependencyTests-810240526 None] Lock "cinder-quobyte-30cb0adf-f403-470c-a0a0-14c993a315c5" released by "delete_snapshot" :: held 1.522s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:29:58 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-4d09b4c0-6a2d-4c2e-84ae-d2ad48a2caa7 tempest-SnapshotDependencyTests-810240526 None] Created reservations ['f6743c20-786a-4c62-87e9-bf370ec4c1dc', 'd481d76b-4bee-4405-a8ea-eb6c09ea726f', '70f701be-35c4-494c-9534-4dd6c6679380', 'c35efb07-96dc-49b8-b1a2-3f1bec1714c3'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:29:58 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-4d09b4c0-6a2d-4c2e-84ae-d2ad48a2caa7 tempest-SnapshotDependencyTests-810240526 None] Delete snapshot completed successfully. Nov 04 12:29:58 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-4d09b4c0-6a2d-4c2e-84ae-d2ad48a2caa7 tempest-SnapshotDependencyTests-810240526 None] Lock "cinder-6daf4a57-a23a-4095-b911-0801c3a9d2eb-delete_snapshot" released by "delete_snapshot" :: held 1.646s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:29:59 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-cb976a44-984a-42d7-85f0-b560f94a10f6 tempest-SnapshotDependencyTests-810240526 None] Acquiring lock "cinder-30cb0adf-f403-470c-a0a0-14c993a315c5-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:29:59 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-cb976a44-984a-42d7-85f0-b560f94a10f6 tempest-SnapshotDependencyTests-810240526 None] Lock "cinder-30cb0adf-f403-470c-a0a0-14c993a315c5-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:29:59 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-cb976a44-984a-42d7-85f0-b560f94a10f6 tempest-SnapshotDependencyTests-810240526 None] Acquiring lock "cinder-quobyte-30cb0adf-f403-470c-a0a0-14c993a315c5" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:29:59 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-cb976a44-984a-42d7-85f0-b560f94a10f6 tempest-SnapshotDependencyTests-810240526 None] Lock "cinder-quobyte-30cb0adf-f403-470c-a0a0-14c993a315c5" acquired by "delete_volume" :: waited 0.013s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:29:59 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[78986dea-98f2-4b3b-8eaf-841aeb8cc499]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:29:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cb976a44-984a-42d7-85f0-b560f94a10f6 tempest-SnapshotDependencyTests-810240526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-30cb0adf-f403-470c-a0a0-14c993a315c5 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:29:59 devstack sudo[106462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-30cb0adf-f403-470c-a0a0-14c993a315c5 Nov 04 12:29:59 devstack sudo[106462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:29:59 devstack sudo[106462]: pam_unix(sudo:session): session closed for user root Nov 04 12:29:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cb976a44-984a-42d7-85f0-b560f94a10f6 tempest-SnapshotDependencyTests-810240526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-30cb0adf-f403-470c-a0a0-14c993a315c5" returned: 0 in 0.362s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:29:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cb976a44-984a-42d7-85f0-b560f94a10f6 tempest-SnapshotDependencyTests-810240526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-30cb0adf-f403-470c-a0a0-14c993a315c5 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:29:59 devstack sudo[106467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-30cb0adf-f403-470c-a0a0-14c993a315c5 Nov 04 12:29:59 devstack sudo[106467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:29:59 devstack sudo[106467]: pam_unix(sudo:session): session closed for user root Nov 04 12:29:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cb976a44-984a-42d7-85f0-b560f94a10f6 tempest-SnapshotDependencyTests-810240526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-30cb0adf-f403-470c-a0a0-14c993a315c5" returned: 0 in 0.239s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:29:59 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-cb976a44-984a-42d7-85f0-b560f94a10f6 tempest-SnapshotDependencyTests-810240526 None] Lock "cinder-quobyte-30cb0adf-f403-470c-a0a0-14c993a315c5" released by "delete_volume" :: held 0.661s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:30:00 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-cb976a44-984a-42d7-85f0-b560f94a10f6 tempest-SnapshotDependencyTests-810240526 None] Created reservations ['63e12a79-803d-4070-8abe-5395543c9142', '9cfd1627-b5a2-4383-a5c6-d23bf1ff2f92', '71cc8f0d-1d21-4e4e-957f-73d369fc1c9f', 'e410e08e-d732-4eab-bbeb-c8f260b447a2'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:30:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cb976a44-984a-42d7-85f0-b560f94a10f6 tempest-SnapshotDependencyTests-810240526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:30:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cb976a44-984a-42d7-85f0-b560f94a10f6 tempest-SnapshotDependencyTests-810240526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:30:00 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-cb976a44-984a-42d7-85f0-b560f94a10f6 tempest-SnapshotDependencyTests-810240526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:30:00 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-cb976a44-984a-42d7-85f0-b560f94a10f6 tempest-SnapshotDependencyTests-810240526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:30:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cb976a44-984a-42d7-85f0-b560f94a10f6 tempest-SnapshotDependencyTests-810240526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:30:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cb976a44-984a-42d7-85f0-b560f94a10f6 tempest-SnapshotDependencyTests-810240526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:00 devstack sudo[106470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:30:00 devstack sudo[106470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:00 devstack sudo[106470]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cb976a44-984a-42d7-85f0-b560f94a10f6 tempest-SnapshotDependencyTests-810240526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.236s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:00 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-cb976a44-984a-42d7-85f0-b560f94a10f6 tempest-SnapshotDependencyTests-810240526 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:30:00 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-cb976a44-984a-42d7-85f0-b560f94a10f6 tempest-SnapshotDependencyTests-810240526 None] Deleted volume successfully. Nov 04 12:30:00 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-cb976a44-984a-42d7-85f0-b560f94a10f6 tempest-SnapshotDependencyTests-810240526 None] Lock "cinder-30cb0adf-f403-470c-a0a0-14c993a315c5-delete_volume" released by "delete_volume" :: held 1.070s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:30:00 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-dd4097b6-3c65-4771-9fde-75da4d679677 tempest-SnapshotDependencyTests-810240526 None] Acquiring lock "cinder-f77b039b-55fa-4808-a147-5722f17d8656-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:30:00 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-dd4097b6-3c65-4771-9fde-75da4d679677 tempest-SnapshotDependencyTests-810240526 None] Lock "cinder-f77b039b-55fa-4808-a147-5722f17d8656-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:30:00 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-dd4097b6-3c65-4771-9fde-75da4d679677 tempest-SnapshotDependencyTests-810240526 None] Acquiring lock "cinder-quobyte-f77b039b-55fa-4808-a147-5722f17d8656" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:30:00 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-dd4097b6-3c65-4771-9fde-75da4d679677 tempest-SnapshotDependencyTests-810240526 None] Lock "cinder-quobyte-f77b039b-55fa-4808-a147-5722f17d8656" acquired by "delete_volume" :: waited 0.016s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:30:00 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdca91af-3c0c-4053-96f2-6685787e82d0]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:30:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-dd4097b6-3c65-4771-9fde-75da4d679677 tempest-SnapshotDependencyTests-810240526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f77b039b-55fa-4808-a147-5722f17d8656 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:00 devstack sudo[106473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f77b039b-55fa-4808-a147-5722f17d8656 Nov 04 12:30:00 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:00 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-dd4097b6-3c65-4771-9fde-75da4d679677 tempest-SnapshotDependencyTests-810240526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f77b039b-55fa-4808-a147-5722f17d8656" returned: 0 in 0.347s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-dd4097b6-3c65-4771-9fde-75da4d679677 tempest-SnapshotDependencyTests-810240526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f77b039b-55fa-4808-a147-5722f17d8656 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:00 devstack sudo[106478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f77b039b-55fa-4808-a147-5722f17d8656 Nov 04 12:30:00 devstack sudo[106478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:01 devstack sudo[106478]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-dd4097b6-3c65-4771-9fde-75da4d679677 tempest-SnapshotDependencyTests-810240526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f77b039b-55fa-4808-a147-5722f17d8656" returned: 0 in 0.231s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-dd4097b6-3c65-4771-9fde-75da4d679677 tempest-SnapshotDependencyTests-810240526 None] Lock "cinder-quobyte-f77b039b-55fa-4808-a147-5722f17d8656" released by "delete_volume" :: held 0.620s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:30:01 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-dd4097b6-3c65-4771-9fde-75da4d679677 tempest-SnapshotDependencyTests-810240526 None] Created reservations ['2c2e59c8-6529-4a49-8d6a-6b64ed9fb6d5', 'bde645a3-1a09-4166-8c96-871921efded9', 'ce5ec81e-c7e7-4291-b2a9-a3a38eb19d2a', 'f01049a6-d7d0-4683-8f39-5533ec8df0b3'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:30:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-dd4097b6-3c65-4771-9fde-75da4d679677 tempest-SnapshotDependencyTests-810240526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:30:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-dd4097b6-3c65-4771-9fde-75da4d679677 tempest-SnapshotDependencyTests-810240526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:30:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-dd4097b6-3c65-4771-9fde-75da4d679677 tempest-SnapshotDependencyTests-810240526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:30:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-dd4097b6-3c65-4771-9fde-75da4d679677 tempest-SnapshotDependencyTests-810240526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:30:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-dd4097b6-3c65-4771-9fde-75da4d679677 tempest-SnapshotDependencyTests-810240526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:30:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-dd4097b6-3c65-4771-9fde-75da4d679677 tempest-SnapshotDependencyTests-810240526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:01 devstack sudo[106481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:30:01 devstack sudo[106481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:01 devstack sudo[106481]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-dd4097b6-3c65-4771-9fde-75da4d679677 tempest-SnapshotDependencyTests-810240526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.231s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:01 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-dd4097b6-3c65-4771-9fde-75da4d679677 tempest-SnapshotDependencyTests-810240526 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:30:01 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-dd4097b6-3c65-4771-9fde-75da4d679677 tempest-SnapshotDependencyTests-810240526 None] Deleted volume successfully. Nov 04 12:30:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-dd4097b6-3c65-4771-9fde-75da4d679677 tempest-SnapshotDependencyTests-810240526 None] Lock "cinder-f77b039b-55fa-4808-a147-5722f17d8656-delete_volume" released by "delete_volume" :: held 1.034s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:30:01 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 12:30:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:30:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:30:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:30:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:30:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:30:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:01 devstack sudo[106484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:30:01 devstack sudo[106484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:02 devstack sudo[106484]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.260s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:02 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:30:02 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Running periodic task VolumeManager._thread_info {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 12:30:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] thread count: 28 {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 12:30:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] thread info: [<_MainThread(MainThread, started 140610387472512)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 12:30:11 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=23,cinder:UPDATE=35,cinder:INSERT=7,cinder:DELETE=2 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 12:30:11 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=26,cinder:UPDATE=23,cinder:DELETE=3,cinder:INSERT=8 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 12:30:21 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-d93fa8b8-e28e-449f-b3a3-138e6ac360ab tempest-CreateVolumesFromImageTest-1806951304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:30:21 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d93fa8b8-e28e-449f-b3a3-138e6ac360ab tempest-CreateVolumesFromImageTest-1806951304 None] Flow 'volume_create_manager' (be9773dd-f661-4324-b138-1d5cf20116c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:30:21 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d93fa8b8-e28e-449f-b3a3-138e6ac360ab tempest-CreateVolumesFromImageTest-1806951304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4370ea6d-0a9b-4a41-b8d2-ed5b5231d6c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:21 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5071403-d90d-4ee4-a403-e6c5b4f6e089 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:30:21 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b5071403-d90d-4ee4-a403-e6c5b4f6e089 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Flow 'volume_create_manager' (af4ef856-17b1-4258-8e77-b8861d5fa1cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:30:21 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b5071403-d90d-4ee4-a403-e6c5b4f6e089 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc5d07d2-770b-4528-ad28-e54d250b0494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:21 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-f24a2192-9aaa-473a-9e3f-6749f5ad5305 tempest-CreateVolumesFromImageTest-1806951304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:30:21 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f24a2192-9aaa-473a-9e3f-6749f5ad5305 tempest-CreateVolumesFromImageTest-1806951304 None] Flow 'volume_create_manager' (1b03ecd6-0dc4-4328-864b-b6077c924968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:30:21 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f24a2192-9aaa-473a-9e3f-6749f5ad5305 tempest-CreateVolumesFromImageTest-1806951304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e30ff399-8fed-4b21-a5f0-92620387a3f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:21 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d93fa8b8-e28e-449f-b3a3-138e6ac360ab tempest-CreateVolumesFromImageTest-1806951304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4370ea6d-0a9b-4a41-b8d2-ed5b5231d6c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:30:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1606874214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=773e1eab-7f28-46fd-9242-c08b524701ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='497fc0dd22f84c2fb835a779884c0831',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:30:22Z,use_quota=True,user_id='cf77dd04f6714fc6a0603445b5be6e7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:21 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d93fa8b8-e28e-449f-b3a3-138e6ac360ab tempest-CreateVolumesFromImageTest-1806951304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f221e8d-fe79-42af-8749-ca8cc628ede8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:21 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d93fa8b8-e28e-449f-b3a3-138e6ac360ab tempest-CreateVolumesFromImageTest-1806951304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f221e8d-fe79-42af-8749-ca8cc628ede8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:21 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d93fa8b8-e28e-449f-b3a3-138e6ac360ab tempest-CreateVolumesFromImageTest-1806951304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fe8bc41-b7f1-42d6-8ed4-bc5cd2681fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:21 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d93fa8b8-e28e-449f-b3a3-138e6ac360ab tempest-CreateVolumesFromImageTest-1806951304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fe8bc41-b7f1-42d6-8ed4-bc5cd2681fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '773e1eab-7f28-46fd-9242-c08b524701ba', 'volume_name': 'volume-773e1eab-7f28-46fd-9242-c08b524701ba', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:21 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d93fa8b8-e28e-449f-b3a3-138e6ac360ab tempest-CreateVolumesFromImageTest-1806951304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fff75372-9501-468e-9904-3ca6c081ef6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:21 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d93fa8b8-e28e-449f-b3a3-138e6ac360ab tempest-CreateVolumesFromImageTest-1806951304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fff75372-9501-468e-9904-3ca6c081ef6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:21 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d93fa8b8-e28e-449f-b3a3-138e6ac360ab tempest-CreateVolumesFromImageTest-1806951304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3816eeeb-d3c8-43b2-bb24-2d645410f2f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:21 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-d93fa8b8-e28e-449f-b3a3-138e6ac360ab tempest-CreateVolumesFromImageTest-1806951304 None] Volume 773e1eab-7f28-46fd-9242-c08b524701ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-773e1eab-7f28-46fd-9242-c08b524701ba', 'volume_size': 1} Nov 04 12:30:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d93fa8b8-e28e-449f-b3a3-138e6ac360ab tempest-CreateVolumesFromImageTest-1806951304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:30:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d93fa8b8-e28e-449f-b3a3-138e6ac360ab tempest-CreateVolumesFromImageTest-1806951304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:30:21 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d93fa8b8-e28e-449f-b3a3-138e6ac360ab tempest-CreateVolumesFromImageTest-1806951304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:30:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1606874214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=773e1eab-7f28-46fd-9242-c08b524701ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='497fc0dd22f84c2fb835a779884c0831',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:30:22Z,use_quota=True,user_id='cf77dd04f6714fc6a0603445b5be6e7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:30:21 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-d93fa8b8-e28e-449f-b3a3-138e6ac360ab tempest-CreateVolumesFromImageTest-1806951304 None] Creating volume 773e1eab-7f28-46fd-9242-c08b524701ba {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:30:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d93fa8b8-e28e-449f-b3a3-138e6ac360ab tempest-CreateVolumesFromImageTest-1806951304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:30:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d93fa8b8-e28e-449f-b3a3-138e6ac360ab tempest-CreateVolumesFromImageTest-1806951304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:30:21 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d93fa8b8-e28e-449f-b3a3-138e6ac360ab tempest-CreateVolumesFromImageTest-1806951304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:30:21 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d93fa8b8-e28e-449f-b3a3-138e6ac360ab tempest-CreateVolumesFromImageTest-1806951304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:30:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d93fa8b8-e28e-449f-b3a3-138e6ac360ab tempest-CreateVolumesFromImageTest-1806951304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:30:21 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d93fa8b8-e28e-449f-b3a3-138e6ac360ab tempest-CreateVolumesFromImageTest-1806951304 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:30:21 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-d93fa8b8-e28e-449f-b3a3-138e6ac360ab tempest-CreateVolumesFromImageTest-1806951304 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:30:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d93fa8b8-e28e-449f-b3a3-138e6ac360ab tempest-CreateVolumesFromImageTest-1806951304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-773e1eab-7f28-46fd-9242-c08b524701ba 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:22 devstack sudo[106537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-773e1eab-7f28-46fd-9242-c08b524701ba 1073741824 Nov 04 12:30:22 devstack sudo[106537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:22 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b5071403-d90d-4ee4-a403-e6c5b4f6e089 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc5d07d2-770b-4528-ad28-e54d250b0494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:30:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1312994396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8216c52a-a5e7-4469-889c-e540cb326b1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f2ecbf4c26745aea61e77c646f1ae08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:30:22Z,use_quota=True,user_id='eb107a11aa25484bbb00b0017ec862ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:22 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b5071403-d90d-4ee4-a403-e6c5b4f6e089 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d15f5615-3ea3-49f7-bc23-7aa2c54d4769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:22 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b5071403-d90d-4ee4-a403-e6c5b4f6e089 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d15f5615-3ea3-49f7-bc23-7aa2c54d4769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:22 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b5071403-d90d-4ee4-a403-e6c5b4f6e089 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (428e66c5-0365-4d90-89a3-1fb04c5f7a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:22 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b5071403-d90d-4ee4-a403-e6c5b4f6e089 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (428e66c5-0365-4d90-89a3-1fb04c5f7a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8216c52a-a5e7-4469-889c-e540cb326b1b', 'volume_name': 'volume-8216c52a-a5e7-4469-889c-e540cb326b1b', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:22 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b5071403-d90d-4ee4-a403-e6c5b4f6e089 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7054d2ac-1f87-4fb3-a3e2-c55cb61e72b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:22 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b5071403-d90d-4ee4-a403-e6c5b4f6e089 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7054d2ac-1f87-4fb3-a3e2-c55cb61e72b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:22 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b5071403-d90d-4ee4-a403-e6c5b4f6e089 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9edd66d3-2106-491d-93e8-018d09d6c594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:22 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-b5071403-d90d-4ee4-a403-e6c5b4f6e089 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Volume 8216c52a-a5e7-4469-889c-e540cb326b1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8216c52a-a5e7-4469-889c-e540cb326b1b', 'volume_size': 1} Nov 04 12:30:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b5071403-d90d-4ee4-a403-e6c5b4f6e089 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:30:22 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f24a2192-9aaa-473a-9e3f-6749f5ad5305 tempest-CreateVolumesFromImageTest-1806951304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e30ff399-8fed-4b21-a5f0-92620387a3f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:30:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2096172548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7a3444f-06e0-4aed-867f-913f1e084a29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='497fc0dd22f84c2fb835a779884c0831',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:30:22Z,use_quota=True,user_id='cf77dd04f6714fc6a0603445b5be6e7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:22 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f24a2192-9aaa-473a-9e3f-6749f5ad5305 tempest-CreateVolumesFromImageTest-1806951304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (849746be-40eb-450d-bf2c-51c9b92f3338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:22 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f24a2192-9aaa-473a-9e3f-6749f5ad5305 tempest-CreateVolumesFromImageTest-1806951304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (849746be-40eb-450d-bf2c-51c9b92f3338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:22 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f24a2192-9aaa-473a-9e3f-6749f5ad5305 tempest-CreateVolumesFromImageTest-1806951304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5039b71b-898d-4971-a94d-25a8c5ee2aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:22 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f24a2192-9aaa-473a-9e3f-6749f5ad5305 tempest-CreateVolumesFromImageTest-1806951304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5039b71b-898d-4971-a94d-25a8c5ee2aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7a3444f-06e0-4aed-867f-913f1e084a29', 'volume_name': 'volume-b7a3444f-06e0-4aed-867f-913f1e084a29', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:22 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f24a2192-9aaa-473a-9e3f-6749f5ad5305 tempest-CreateVolumesFromImageTest-1806951304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd836704-23a5-4a55-b124-a42300083e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:22 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f24a2192-9aaa-473a-9e3f-6749f5ad5305 tempest-CreateVolumesFromImageTest-1806951304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd836704-23a5-4a55-b124-a42300083e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:22 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f24a2192-9aaa-473a-9e3f-6749f5ad5305 tempest-CreateVolumesFromImageTest-1806951304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6b2551c-8056-458b-87ea-4eb49c46cf8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:22 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-f24a2192-9aaa-473a-9e3f-6749f5ad5305 tempest-CreateVolumesFromImageTest-1806951304 None] Volume b7a3444f-06e0-4aed-867f-913f1e084a29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7a3444f-06e0-4aed-867f-913f1e084a29', 'volume_size': 1} Nov 04 12:30:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f24a2192-9aaa-473a-9e3f-6749f5ad5305 tempest-CreateVolumesFromImageTest-1806951304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:30:22 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-5589c888-86bd-49e0-a317-4f59011d4081 tempest-CreateVolumesFromImageTest-1806951304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:30:22 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5589c888-86bd-49e0-a317-4f59011d4081 tempest-CreateVolumesFromImageTest-1806951304 None] Flow 'volume_create_manager' (c18741f2-c715-462d-a6a7-3962e41d3b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:30:22 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5589c888-86bd-49e0-a317-4f59011d4081 tempest-CreateVolumesFromImageTest-1806951304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a554fd9-a299-42b9-9e10-e5be8af306e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:22 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5589c888-86bd-49e0-a317-4f59011d4081 tempest-CreateVolumesFromImageTest-1806951304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a554fd9-a299-42b9-9e10-e5be8af306e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:30:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1802330561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6da2df96-061d-4112-9b53-7e37721aa751,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='497fc0dd22f84c2fb835a779884c0831',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:30:22Z,use_quota=True,user_id='cf77dd04f6714fc6a0603445b5be6e7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:22 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5589c888-86bd-49e0-a317-4f59011d4081 tempest-CreateVolumesFromImageTest-1806951304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (781bfe65-e5b3-4544-baab-9e4e6deb6a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:22 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5589c888-86bd-49e0-a317-4f59011d4081 tempest-CreateVolumesFromImageTest-1806951304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (781bfe65-e5b3-4544-baab-9e4e6deb6a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:22 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5589c888-86bd-49e0-a317-4f59011d4081 tempest-CreateVolumesFromImageTest-1806951304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7d44777-9a13-4743-8340-db157169079a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:22 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5589c888-86bd-49e0-a317-4f59011d4081 tempest-CreateVolumesFromImageTest-1806951304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7d44777-9a13-4743-8340-db157169079a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6da2df96-061d-4112-9b53-7e37721aa751', 'volume_name': 'volume-6da2df96-061d-4112-9b53-7e37721aa751', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:22 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5589c888-86bd-49e0-a317-4f59011d4081 tempest-CreateVolumesFromImageTest-1806951304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13d6937d-2e70-4b5a-9c60-0f0cad9196ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:22 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5589c888-86bd-49e0-a317-4f59011d4081 tempest-CreateVolumesFromImageTest-1806951304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13d6937d-2e70-4b5a-9c60-0f0cad9196ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:22 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5589c888-86bd-49e0-a317-4f59011d4081 tempest-CreateVolumesFromImageTest-1806951304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (853a7754-fb59-446f-b965-b82acd197bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:22 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-5589c888-86bd-49e0-a317-4f59011d4081 tempest-CreateVolumesFromImageTest-1806951304 None] Volume 6da2df96-061d-4112-9b53-7e37721aa751: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6da2df96-061d-4112-9b53-7e37721aa751', 'volume_size': 1} Nov 04 12:30:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5589c888-86bd-49e0-a317-4f59011d4081 tempest-CreateVolumesFromImageTest-1806951304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:30:22 devstack sudo[106537]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d93fa8b8-e28e-449f-b3a3-138e6ac360ab tempest-CreateVolumesFromImageTest-1806951304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-773e1eab-7f28-46fd-9242-c08b524701ba 1073741824" returned: 0 in 0.664s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:22 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-e610bc06-acbe-4137-ba10-31743abe9c3d tempest-CreateVolumesFromImageTest-1806951304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:30:22 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e610bc06-acbe-4137-ba10-31743abe9c3d tempest-CreateVolumesFromImageTest-1806951304 None] Flow 'volume_create_manager' (67ba9b89-5248-4fae-b315-15cd2163fb29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:30:22 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e610bc06-acbe-4137-ba10-31743abe9c3d tempest-CreateVolumesFromImageTest-1806951304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce5d96b0-df5a-4b52-a357-17817aa7ba44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:22 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e610bc06-acbe-4137-ba10-31743abe9c3d tempest-CreateVolumesFromImageTest-1806951304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce5d96b0-df5a-4b52-a357-17817aa7ba44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:30:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1980181442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4de58ef2-08f6-49ba-b34c-27d2b381a921,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='497fc0dd22f84c2fb835a779884c0831',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:30:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:30:23Z,use_quota=True,user_id='cf77dd04f6714fc6a0603445b5be6e7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:22 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e610bc06-acbe-4137-ba10-31743abe9c3d tempest-CreateVolumesFromImageTest-1806951304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79411b9e-3b2a-4f3a-a783-17ef50c335c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:22 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e610bc06-acbe-4137-ba10-31743abe9c3d tempest-CreateVolumesFromImageTest-1806951304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79411b9e-3b2a-4f3a-a783-17ef50c335c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:22 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e610bc06-acbe-4137-ba10-31743abe9c3d tempest-CreateVolumesFromImageTest-1806951304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43e4fd47-a285-4b9a-88e9-99d5791f9ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:22 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e610bc06-acbe-4137-ba10-31743abe9c3d tempest-CreateVolumesFromImageTest-1806951304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43e4fd47-a285-4b9a-88e9-99d5791f9ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4de58ef2-08f6-49ba-b34c-27d2b381a921', 'volume_name': 'volume-4de58ef2-08f6-49ba-b34c-27d2b381a921', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:22 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e610bc06-acbe-4137-ba10-31743abe9c3d tempest-CreateVolumesFromImageTest-1806951304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d187b15-9f43-4597-aaf7-9c459ea61870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:22 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e610bc06-acbe-4137-ba10-31743abe9c3d tempest-CreateVolumesFromImageTest-1806951304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d187b15-9f43-4597-aaf7-9c459ea61870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:22 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e610bc06-acbe-4137-ba10-31743abe9c3d tempest-CreateVolumesFromImageTest-1806951304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73851f26-c4ec-49ef-ae0b-a7dcf686b33e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:22 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-e610bc06-acbe-4137-ba10-31743abe9c3d tempest-CreateVolumesFromImageTest-1806951304 None] Volume 4de58ef2-08f6-49ba-b34c-27d2b381a921: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4de58ef2-08f6-49ba-b34c-27d2b381a921', 'volume_size': 1} Nov 04 12:30:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e610bc06-acbe-4137-ba10-31743abe9c3d tempest-CreateVolumesFromImageTest-1806951304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:30:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d93fa8b8-e28e-449f-b3a3-138e6ac360ab tempest-CreateVolumesFromImageTest-1806951304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-773e1eab-7f28-46fd-9242-c08b524701ba {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:22 devstack sudo[106543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-773e1eab-7f28-46fd-9242-c08b524701ba Nov 04 12:30:22 devstack sudo[106543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:23 devstack sudo[106543]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d93fa8b8-e28e-449f-b3a3-138e6ac360ab tempest-CreateVolumesFromImageTest-1806951304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-773e1eab-7f28-46fd-9242-c08b524701ba" returned: 0 in 0.295s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:23 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d93fa8b8-e28e-449f-b3a3-138e6ac360ab tempest-CreateVolumesFromImageTest-1806951304 None] <== create_volume: return (1159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:30:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d93fa8b8-e28e-449f-b3a3-138e6ac360ab tempest-CreateVolumesFromImageTest-1806951304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.161s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:30:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b5071403-d90d-4ee4-a403-e6c5b4f6e089 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.943s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:30:23 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b5071403-d90d-4ee4-a403-e6c5b4f6e089 tempest-CreateVolumesFromSnapshotTest-1515403536 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:30:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1312994396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8216c52a-a5e7-4469-889c-e540cb326b1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f2ecbf4c26745aea61e77c646f1ae08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:30:22Z,use_quota=True,user_id='eb107a11aa25484bbb00b0017ec862ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:30:23 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-b5071403-d90d-4ee4-a403-e6c5b4f6e089 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Creating volume 8216c52a-a5e7-4469-889c-e540cb326b1b {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:30:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b5071403-d90d-4ee4-a403-e6c5b4f6e089 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:30:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b5071403-d90d-4ee4-a403-e6c5b4f6e089 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:30:23 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b5071403-d90d-4ee4-a403-e6c5b4f6e089 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:30:23 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b5071403-d90d-4ee4-a403-e6c5b4f6e089 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:30:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b5071403-d90d-4ee4-a403-e6c5b4f6e089 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:30:23 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b5071403-d90d-4ee4-a403-e6c5b4f6e089 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:30:23 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-b5071403-d90d-4ee4-a403-e6c5b4f6e089 tempest-CreateVolumesFromSnapshotTest-1515403536 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:30:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b5071403-d90d-4ee4-a403-e6c5b4f6e089 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8216c52a-a5e7-4469-889c-e540cb326b1b 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:23 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d93fa8b8-e28e-449f-b3a3-138e6ac360ab tempest-CreateVolumesFromImageTest-1806951304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3816eeeb-d3c8-43b2-bb24-2d645410f2f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-773e1eab-7f28-46fd-9242-c08b524701ba', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:23 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d93fa8b8-e28e-449f-b3a3-138e6ac360ab tempest-CreateVolumesFromImageTest-1806951304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ef4882b-b8bb-4b06-8e27-7cc0ae80c9a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:23 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfa5c6e3-1959-466c-b14f-dc732469decd tempest-CreateVolumesFromImageTest-1806951304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:30:23 devstack sudo[106546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8216c52a-a5e7-4469-889c-e540cb326b1b 1073741824 Nov 04 12:30:23 devstack sudo[106546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:23 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dfa5c6e3-1959-466c-b14f-dc732469decd tempest-CreateVolumesFromImageTest-1806951304 None] Flow 'volume_create_manager' (e4aa3336-0154-4d7d-9e54-45dc3aa96e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:30:23 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dfa5c6e3-1959-466c-b14f-dc732469decd tempest-CreateVolumesFromImageTest-1806951304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f59746b-159e-4790-9dd4-1916f1043da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:23 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-d93fa8b8-e28e-449f-b3a3-138e6ac360ab tempest-CreateVolumesFromImageTest-1806951304 None] Volume volume-773e1eab-7f28-46fd-9242-c08b524701ba (773e1eab-7f28-46fd-9242-c08b524701ba): created successfully Nov 04 12:30:23 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d93fa8b8-e28e-449f-b3a3-138e6ac360ab tempest-CreateVolumesFromImageTest-1806951304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ef4882b-b8bb-4b06-8e27-7cc0ae80c9a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:23 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d93fa8b8-e28e-449f-b3a3-138e6ac360ab tempest-CreateVolumesFromImageTest-1806951304 None] Flow 'volume_create_manager' (be9773dd-f661-4324-b138-1d5cf20116c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:30:23 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dfa5c6e3-1959-466c-b14f-dc732469decd tempest-CreateVolumesFromImageTest-1806951304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f59746b-159e-4790-9dd4-1916f1043da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:30:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1197008605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d22a390f-d238-4fd1-9094-27cf04762f03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='497fc0dd22f84c2fb835a779884c0831',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:30:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:30:23Z,use_quota=True,user_id='cf77dd04f6714fc6a0603445b5be6e7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:23 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dfa5c6e3-1959-466c-b14f-dc732469decd tempest-CreateVolumesFromImageTest-1806951304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c12e5f5-ccfe-4a49-be1c-752989c43ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:23 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dfa5c6e3-1959-466c-b14f-dc732469decd tempest-CreateVolumesFromImageTest-1806951304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c12e5f5-ccfe-4a49-be1c-752989c43ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:23 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dfa5c6e3-1959-466c-b14f-dc732469decd tempest-CreateVolumesFromImageTest-1806951304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5872ec57-e649-4fc1-8fee-3d96551ad4af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:23 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dfa5c6e3-1959-466c-b14f-dc732469decd tempest-CreateVolumesFromImageTest-1806951304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5872ec57-e649-4fc1-8fee-3d96551ad4af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd22a390f-d238-4fd1-9094-27cf04762f03', 'volume_name': 'volume-d22a390f-d238-4fd1-9094-27cf04762f03', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:23 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dfa5c6e3-1959-466c-b14f-dc732469decd tempest-CreateVolumesFromImageTest-1806951304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e608122-2cef-4ac1-88cd-293d632dffa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:23 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dfa5c6e3-1959-466c-b14f-dc732469decd tempest-CreateVolumesFromImageTest-1806951304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e608122-2cef-4ac1-88cd-293d632dffa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:23 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dfa5c6e3-1959-466c-b14f-dc732469decd tempest-CreateVolumesFromImageTest-1806951304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24bb3121-d910-49b0-b29b-d4bd2596d172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:23 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-dfa5c6e3-1959-466c-b14f-dc732469decd tempest-CreateVolumesFromImageTest-1806951304 None] Volume d22a390f-d238-4fd1-9094-27cf04762f03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d22a390f-d238-4fd1-9094-27cf04762f03', 'volume_size': 1} Nov 04 12:30:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-dfa5c6e3-1959-466c-b14f-dc732469decd tempest-CreateVolumesFromImageTest-1806951304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:30:23 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-d93fa8b8-e28e-449f-b3a3-138e6ac360ab tempest-CreateVolumesFromImageTest-1806951304 None] Created volume successfully. Nov 04 12:30:23 devstack sudo[106546]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b5071403-d90d-4ee4-a403-e6c5b4f6e089 tempest-CreateVolumesFromSnapshotTest-1515403536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8216c52a-a5e7-4469-889c-e540cb326b1b 1073741824" returned: 0 in 0.584s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b5071403-d90d-4ee4-a403-e6c5b4f6e089 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8216c52a-a5e7-4469-889c-e540cb326b1b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:23 devstack sudo[106553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8216c52a-a5e7-4469-889c-e540cb326b1b Nov 04 12:30:23 devstack sudo[106553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:24 devstack sudo[106553]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b5071403-d90d-4ee4-a403-e6c5b4f6e089 tempest-CreateVolumesFromSnapshotTest-1515403536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8216c52a-a5e7-4469-889c-e540cb326b1b" returned: 0 in 0.272s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:24 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b5071403-d90d-4ee4-a403-e6c5b4f6e089 tempest-CreateVolumesFromSnapshotTest-1515403536 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:30:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b5071403-d90d-4ee4-a403-e6c5b4f6e089 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:30:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f24a2192-9aaa-473a-9e3f-6749f5ad5305 tempest-CreateVolumesFromImageTest-1806951304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.824s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:30:24 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f24a2192-9aaa-473a-9e3f-6749f5ad5305 tempest-CreateVolumesFromImageTest-1806951304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:30:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2096172548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7a3444f-06e0-4aed-867f-913f1e084a29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='497fc0dd22f84c2fb835a779884c0831',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:30:22Z,use_quota=True,user_id='cf77dd04f6714fc6a0603445b5be6e7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:30:24 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-f24a2192-9aaa-473a-9e3f-6749f5ad5305 tempest-CreateVolumesFromImageTest-1806951304 None] Creating volume b7a3444f-06e0-4aed-867f-913f1e084a29 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:30:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f24a2192-9aaa-473a-9e3f-6749f5ad5305 tempest-CreateVolumesFromImageTest-1806951304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:30:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f24a2192-9aaa-473a-9e3f-6749f5ad5305 tempest-CreateVolumesFromImageTest-1806951304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:30:24 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f24a2192-9aaa-473a-9e3f-6749f5ad5305 tempest-CreateVolumesFromImageTest-1806951304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:30:24 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f24a2192-9aaa-473a-9e3f-6749f5ad5305 tempest-CreateVolumesFromImageTest-1806951304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:30:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f24a2192-9aaa-473a-9e3f-6749f5ad5305 tempest-CreateVolumesFromImageTest-1806951304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:30:24 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f24a2192-9aaa-473a-9e3f-6749f5ad5305 tempest-CreateVolumesFromImageTest-1806951304 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:30:24 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-f24a2192-9aaa-473a-9e3f-6749f5ad5305 tempest-CreateVolumesFromImageTest-1806951304 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:30:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f24a2192-9aaa-473a-9e3f-6749f5ad5305 tempest-CreateVolumesFromImageTest-1806951304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b7a3444f-06e0-4aed-867f-913f1e084a29 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b5071403-d90d-4ee4-a403-e6c5b4f6e089 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9edd66d3-2106-491d-93e8-018d09d6c594) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8216c52a-a5e7-4469-889c-e540cb326b1b', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:24 devstack sudo[106556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b7a3444f-06e0-4aed-867f-913f1e084a29 1073741824 Nov 04 12:30:24 devstack sudo[106556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b5071403-d90d-4ee4-a403-e6c5b4f6e089 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1151019-3a3d-4a9c-9b36-57d7fe38575d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:24 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-b5071403-d90d-4ee4-a403-e6c5b4f6e089 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Volume volume-8216c52a-a5e7-4469-889c-e540cb326b1b (8216c52a-a5e7-4469-889c-e540cb326b1b): created successfully Nov 04 12:30:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b5071403-d90d-4ee4-a403-e6c5b4f6e089 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1151019-3a3d-4a9c-9b36-57d7fe38575d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b5071403-d90d-4ee4-a403-e6c5b4f6e089 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Flow 'volume_create_manager' (af4ef856-17b1-4258-8e77-b8861d5fa1cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:30:24 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-b5071403-d90d-4ee4-a403-e6c5b4f6e089 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Created volume successfully. Nov 04 12:30:24 devstack sudo[106556]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f24a2192-9aaa-473a-9e3f-6749f5ad5305 tempest-CreateVolumesFromImageTest-1806951304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b7a3444f-06e0-4aed-867f-913f1e084a29 1073741824" returned: 0 in 0.631s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:24 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f1fa9ff-0b48-446c-bbdc-acbbd06501b7 tempest-VolumeImageDependencyTests-694567839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:30:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5f1fa9ff-0b48-446c-bbdc-acbbd06501b7 tempest-VolumeImageDependencyTests-694567839 None] Flow 'volume_create_manager' (5556c419-9b35-409a-9c11-3c89378986b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:30:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5f1fa9ff-0b48-446c-bbdc-acbbd06501b7 tempest-VolumeImageDependencyTests-694567839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ea24789-5f9d-48ad-841f-d44f7e45d8ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f24a2192-9aaa-473a-9e3f-6749f5ad5305 tempest-CreateVolumesFromImageTest-1806951304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b7a3444f-06e0-4aed-867f-913f1e084a29 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5f1fa9ff-0b48-446c-bbdc-acbbd06501b7 tempest-VolumeImageDependencyTests-694567839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ea24789-5f9d-48ad-841f-d44f7e45d8ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:30:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65f11fc9-f4f5-4a22-a890-f11aa337f2f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d282670ed0a348df8455e012eded36bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:30:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:30:25Z,use_quota=True,user_id='1b604c9af1344a13a00813b43f41d6fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:24 devstack sudo[106562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b7a3444f-06e0-4aed-867f-913f1e084a29 Nov 04 12:30:24 devstack sudo[106562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5f1fa9ff-0b48-446c-bbdc-acbbd06501b7 tempest-VolumeImageDependencyTests-694567839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d6e89cc-0f58-4290-bb1a-733f007aa410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5f1fa9ff-0b48-446c-bbdc-acbbd06501b7 tempest-VolumeImageDependencyTests-694567839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d6e89cc-0f58-4290-bb1a-733f007aa410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5f1fa9ff-0b48-446c-bbdc-acbbd06501b7 tempest-VolumeImageDependencyTests-694567839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bef31af-c559-49c8-a4cb-f1cddd4e9dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:24 devstack cinder-volume[87095]: DEBUG cinder.image.glance [None req-5f1fa9ff-0b48-446c-bbdc-acbbd06501b7 tempest-VolumeImageDependencyTests-694567839 None] Creating Keystone auth plugin from conf {{(pid=87095) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 04 12:30:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6cf32837-8daf-48ad-8b11-5960018eb62d tempest-CreateVolumesFromSnapshotTest-1515403536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:30:25 devstack sudo[106562]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f24a2192-9aaa-473a-9e3f-6749f5ad5305 tempest-CreateVolumesFromImageTest-1806951304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b7a3444f-06e0-4aed-867f-913f1e084a29" returned: 0 in 0.309s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:25 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f24a2192-9aaa-473a-9e3f-6749f5ad5305 tempest-CreateVolumesFromImageTest-1806951304 None] <== create_volume: return (1046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:30:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f24a2192-9aaa-473a-9e3f-6749f5ad5305 tempest-CreateVolumesFromImageTest-1806951304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:30:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5589c888-86bd-49e0-a317-4f59011d4081 tempest-CreateVolumesFromImageTest-1806951304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.669s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:30:25 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-5589c888-86bd-49e0-a317-4f59011d4081 tempest-CreateVolumesFromImageTest-1806951304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:30:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1802330561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6da2df96-061d-4112-9b53-7e37721aa751,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='497fc0dd22f84c2fb835a779884c0831',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:30:22Z,use_quota=True,user_id='cf77dd04f6714fc6a0603445b5be6e7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:30:25 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-5589c888-86bd-49e0-a317-4f59011d4081 tempest-CreateVolumesFromImageTest-1806951304 None] Creating volume 6da2df96-061d-4112-9b53-7e37721aa751 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:30:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5589c888-86bd-49e0-a317-4f59011d4081 tempest-CreateVolumesFromImageTest-1806951304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:30:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5589c888-86bd-49e0-a317-4f59011d4081 tempest-CreateVolumesFromImageTest-1806951304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:30:25 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-5589c888-86bd-49e0-a317-4f59011d4081 tempest-CreateVolumesFromImageTest-1806951304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:30:25 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-5589c888-86bd-49e0-a317-4f59011d4081 tempest-CreateVolumesFromImageTest-1806951304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:30:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5589c888-86bd-49e0-a317-4f59011d4081 tempest-CreateVolumesFromImageTest-1806951304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:30:25 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-5589c888-86bd-49e0-a317-4f59011d4081 tempest-CreateVolumesFromImageTest-1806951304 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:30:25 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-5589c888-86bd-49e0-a317-4f59011d4081 tempest-CreateVolumesFromImageTest-1806951304 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:30:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5589c888-86bd-49e0-a317-4f59011d4081 tempest-CreateVolumesFromImageTest-1806951304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6da2df96-061d-4112-9b53-7e37721aa751 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f24a2192-9aaa-473a-9e3f-6749f5ad5305 tempest-CreateVolumesFromImageTest-1806951304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6b2551c-8056-458b-87ea-4eb49c46cf8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7a3444f-06e0-4aed-867f-913f1e084a29', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:25 devstack sudo[106565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6da2df96-061d-4112-9b53-7e37721aa751 1073741824 Nov 04 12:30:25 devstack sudo[106565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f24a2192-9aaa-473a-9e3f-6749f5ad5305 tempest-CreateVolumesFromImageTest-1806951304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bba765dd-f618-41db-9e1b-8e37a752609d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:25 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-f24a2192-9aaa-473a-9e3f-6749f5ad5305 tempest-CreateVolumesFromImageTest-1806951304 None] Volume volume-b7a3444f-06e0-4aed-867f-913f1e084a29 (b7a3444f-06e0-4aed-867f-913f1e084a29): created successfully Nov 04 12:30:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f24a2192-9aaa-473a-9e3f-6749f5ad5305 tempest-CreateVolumesFromImageTest-1806951304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bba765dd-f618-41db-9e1b-8e37a752609d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f24a2192-9aaa-473a-9e3f-6749f5ad5305 tempest-CreateVolumesFromImageTest-1806951304 None] Flow 'volume_create_manager' (1b03ecd6-0dc4-4328-864b-b6077c924968) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:30:25 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-f24a2192-9aaa-473a-9e3f-6749f5ad5305 tempest-CreateVolumesFromImageTest-1806951304 None] Created volume successfully. Nov 04 12:30:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5f1fa9ff-0b48-446c-bbdc-acbbd06501b7 tempest-VolumeImageDependencyTests-694567839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bef31af-c559-49c8-a4cb-f1cddd4e9dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '65f11fc9-f4f5-4a22-a890-f11aa337f2f7', 'volume_name': 'volume-65f11fc9-f4f5-4a22-a890-f11aa337f2f7', 'volume_size': 1, 'image_id': '09e5adda-2550-49b3-8d93-eb73d166227f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/09e5adda-2550-49b3-8d93-eb73d166227f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '27350da453c1c641f5e6880dfaaef566', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd282670ed0a348df8455e012eded36bd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '24b635a42ee547880068c33982bdb3335011c66c3ef7b0ba2b6446da0e6b5dcf6acabd43398bae0666d69deef2d3923e04bbbcc82add4194862697768cd3dd7f', 'id': '09e5adda-2550-49b3-8d93-eb73d166227f', 'created_at': datetime.datetime(2026, 11, 4, 11, 30, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 11, 30, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/09e5adda-2550-49b3-8d93-eb73d166227f/file', 'properties': {}}, 'image_service': }' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5f1fa9ff-0b48-446c-bbdc-acbbd06501b7 tempest-VolumeImageDependencyTests-694567839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a04a35bb-cc04-41e8-a9e8-f5ac24f7bca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5f1fa9ff-0b48-446c-bbdc-acbbd06501b7 tempest-VolumeImageDependencyTests-694567839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a04a35bb-cc04-41e8-a9e8-f5ac24f7bca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5f1fa9ff-0b48-446c-bbdc-acbbd06501b7 tempest-VolumeImageDependencyTests-694567839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (227668c8-7394-4f3a-afbe-52073185fb2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:25 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-5f1fa9ff-0b48-446c-bbdc-acbbd06501b7 tempest-VolumeImageDependencyTests-694567839 None] Volume 65f11fc9-f4f5-4a22-a890-f11aa337f2f7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-65f11fc9-f4f5-4a22-a890-f11aa337f2f7', 'volume_size': 1, 'image_id': '09e5adda-2550-49b3-8d93-eb73d166227f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/09e5adda-2550-49b3-8d93-eb73d166227f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '27350da453c1c641f5e6880dfaaef566', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd282670ed0a348df8455e012eded36bd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '24b635a42ee547880068c33982bdb3335011c66c3ef7b0ba2b6446da0e6b5dcf6acabd43398bae0666d69deef2d3923e04bbbcc82add4194862697768cd3dd7f', 'id': '09e5adda-2550-49b3-8d93-eb73d166227f', 'created_at': datetime.datetime(2026, 11, 4, 11, 30, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 11, 30, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/09e5adda-2550-49b3-8d93-eb73d166227f/file', 'properties': {}}, 'image_service': } Nov 04 12:30:25 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f1fa9ff-0b48-446c-bbdc-acbbd06501b7 tempest-VolumeImageDependencyTests-694567839 None] Trying to clone 65f11fc9-f4f5-4a22-a890-f11aa337f2f7 from image 09e5adda-2550-49b3-8d93-eb73d166227f at location (None, [{'url': 'file:///opt/stack/data/glance/images/09e5adda-2550-49b3-8d93-eb73d166227f', 'metadata': {}}]). {{(pid=87095) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 04 12:30:25 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-5f1fa9ff-0b48-446c-bbdc-acbbd06501b7 tempest-VolumeImageDependencyTests-694567839 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_09e5adda-2550-49b3-8d93-eb73d166227f_ww7r9lzrdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87095) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 04 12:30:25 devstack cinder-volume[87095]: INFO cinder.image.image_utils [None req-5f1fa9ff-0b48-446c-bbdc-acbbd06501b7 tempest-VolumeImageDependencyTests-694567839 None] Image download 0.00 MB at 0.00 MB/s Nov 04 12:30:25 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bfbf6d4-ed19-4035-b26e-65330167e2eb]: (4, 'raw') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:30:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5f1fa9ff-0b48-446c-bbdc-acbbd06501b7 tempest-VolumeImageDependencyTests-694567839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_09e5adda-2550-49b3-8d93-eb73d166227f_ww7r9lzrdevstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:25 devstack sudo[106570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_09e5adda-2550-49b3-8d93-eb73d166227f_ww7r9lzrdevstack@QuobyteHD Nov 04 12:30:25 devstack sudo[106570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:25 devstack sudo[106565]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5589c888-86bd-49e0-a317-4f59011d4081 tempest-CreateVolumesFromImageTest-1806951304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6da2df96-061d-4112-9b53-7e37721aa751 1073741824" returned: 0 in 0.599s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5589c888-86bd-49e0-a317-4f59011d4081 tempest-CreateVolumesFromImageTest-1806951304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6da2df96-061d-4112-9b53-7e37721aa751 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:25 devstack sudo[106573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6da2df96-061d-4112-9b53-7e37721aa751 Nov 04 12:30:25 devstack sudo[106573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:25 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7b21314-d1c0-4cb7-b28c-6f9f65b80f3c tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:30:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a7b21314-d1c0-4cb7-b28c-6f9f65b80f3c tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] Flow 'volume_create_manager' (e2da63fd-952b-444e-99b8-5f8618fb87eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:30:25 devstack sudo[106570]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a7b21314-d1c0-4cb7-b28c-6f9f65b80f3c tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea229a01-ffc9-4c96-beeb-ffe49740f748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5f1fa9ff-0b48-446c-bbdc-acbbd06501b7 tempest-VolumeImageDependencyTests-694567839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_09e5adda-2550-49b3-8d93-eb73d166227f_ww7r9lzrdevstack@QuobyteHD" returned: 0 in 0.416s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5f1fa9ff-0b48-446c-bbdc-acbbd06501b7 tempest-VolumeImageDependencyTests-694567839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09e5adda-2550-49b3-8d93-eb73d166227f_ww7r9lzrdevstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a7b21314-d1c0-4cb7-b28c-6f9f65b80f3c tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea229a01-ffc9-4c96-beeb-ffe49740f748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:30:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20886fcc-1863-4aaa-a99a-32d57266e559,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddc2d9129e8649d8b839d775c44a35fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:30:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:30:26Z,use_quota=True,user_id='90a8f52e11024fd38fbf524653d0de63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(752015eb-fa37-43e6-8496-29fdb307ea60),volume_type_id=752015eb-fa37-43e6-8496-29fdb307ea60)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a7b21314-d1c0-4cb7-b28c-6f9f65b80f3c tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8114a29-090b-4e61-a3bf-4f34ecbc371f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a7b21314-d1c0-4cb7-b28c-6f9f65b80f3c tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8114a29-090b-4e61-a3bf-4f34ecbc371f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a7b21314-d1c0-4cb7-b28c-6f9f65b80f3c tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (223c5c8d-3707-466b-8dbd-78f3005ce3ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:25 devstack cinder-volume[87095]: DEBUG cinder.image.glance [None req-a7b21314-d1c0-4cb7-b28c-6f9f65b80f3c tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] Creating Keystone auth plugin from conf {{(pid=87095) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 04 12:30:25 devstack sudo[106577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09e5adda-2550-49b3-8d93-eb73d166227f_ww7r9lzrdevstack@QuobyteHD Nov 04 12:30:25 devstack sudo[106577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:26 devstack sudo[106573]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5589c888-86bd-49e0-a317-4f59011d4081 tempest-CreateVolumesFromImageTest-1806951304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6da2df96-061d-4112-9b53-7e37721aa751" returned: 0 in 0.273s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:26 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-5589c888-86bd-49e0-a317-4f59011d4081 tempest-CreateVolumesFromImageTest-1806951304 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:30:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5589c888-86bd-49e0-a317-4f59011d4081 tempest-CreateVolumesFromImageTest-1806951304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:30:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e610bc06-acbe-4137-ba10-31743abe9c3d tempest-CreateVolumesFromImageTest-1806951304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.245s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:30:26 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e610bc06-acbe-4137-ba10-31743abe9c3d tempest-CreateVolumesFromImageTest-1806951304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:30:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1980181442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4de58ef2-08f6-49ba-b34c-27d2b381a921,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='497fc0dd22f84c2fb835a779884c0831',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:30:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:30:23Z,use_quota=True,user_id='cf77dd04f6714fc6a0603445b5be6e7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:30:26 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-e610bc06-acbe-4137-ba10-31743abe9c3d tempest-CreateVolumesFromImageTest-1806951304 None] Creating volume 4de58ef2-08f6-49ba-b34c-27d2b381a921 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:30:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e610bc06-acbe-4137-ba10-31743abe9c3d tempest-CreateVolumesFromImageTest-1806951304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:30:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e610bc06-acbe-4137-ba10-31743abe9c3d tempest-CreateVolumesFromImageTest-1806951304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:30:26 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e610bc06-acbe-4137-ba10-31743abe9c3d tempest-CreateVolumesFromImageTest-1806951304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:30:26 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e610bc06-acbe-4137-ba10-31743abe9c3d tempest-CreateVolumesFromImageTest-1806951304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:30:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e610bc06-acbe-4137-ba10-31743abe9c3d tempest-CreateVolumesFromImageTest-1806951304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:30:26 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e610bc06-acbe-4137-ba10-31743abe9c3d tempest-CreateVolumesFromImageTest-1806951304 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:30:26 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-e610bc06-acbe-4137-ba10-31743abe9c3d tempest-CreateVolumesFromImageTest-1806951304 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:30:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e610bc06-acbe-4137-ba10-31743abe9c3d tempest-CreateVolumesFromImageTest-1806951304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4de58ef2-08f6-49ba-b34c-27d2b381a921 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:26 devstack sudo[106580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4de58ef2-08f6-49ba-b34c-27d2b381a921 1073741824 Nov 04 12:30:26 devstack sudo[106580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:26 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5589c888-86bd-49e0-a317-4f59011d4081 tempest-CreateVolumesFromImageTest-1806951304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (853a7754-fb59-446f-b965-b82acd197bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6da2df96-061d-4112-9b53-7e37721aa751', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:26 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5589c888-86bd-49e0-a317-4f59011d4081 tempest-CreateVolumesFromImageTest-1806951304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba63e342-1144-426e-93ca-927666f5beef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:26 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-5589c888-86bd-49e0-a317-4f59011d4081 tempest-CreateVolumesFromImageTest-1806951304 None] Volume volume-6da2df96-061d-4112-9b53-7e37721aa751 (6da2df96-061d-4112-9b53-7e37721aa751): created successfully Nov 04 12:30:26 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5589c888-86bd-49e0-a317-4f59011d4081 tempest-CreateVolumesFromImageTest-1806951304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba63e342-1144-426e-93ca-927666f5beef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:26 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5589c888-86bd-49e0-a317-4f59011d4081 tempest-CreateVolumesFromImageTest-1806951304 None] Flow 'volume_create_manager' (c18741f2-c715-462d-a6a7-3962e41d3b5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:30:26 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a7b21314-d1c0-4cb7-b28c-6f9f65b80f3c tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (223c5c8d-3707-466b-8dbd-78f3005ce3ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '20886fcc-1863-4aaa-a99a-32d57266e559', 'volume_name': 'volume-20886fcc-1863-4aaa-a99a-32d57266e559', 'volume_size': 1, 'image_id': 'c2ef1e01-a023-431b-a859-fc925c801dd8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c2ef1e01-a023-431b-a859-fc925c801dd8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e652724012bf7386748b8f39b6da270e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ddc2d9129e8649d8b839d775c44a35fa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5d62f0fd60a33b4f522b613c76da30d6d72e7837ab5d4b62c43d628f385263c2ffe73acdd2a9efcf7e915d1ac892e54e2b2737083c47db1116b39532234fcc06', 'id': 'c2ef1e01-a023-431b-a859-fc925c801dd8', 'created_at': datetime.datetime(2026, 11, 4, 11, 30, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 11, 30, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c2ef1e01-a023-431b-a859-fc925c801dd8/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:26 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a7b21314-d1c0-4cb7-b28c-6f9f65b80f3c tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7888926-0f08-43ba-ad5a-afd47cdd1e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:26 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a7b21314-d1c0-4cb7-b28c-6f9f65b80f3c tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7888926-0f08-43ba-ad5a-afd47cdd1e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:26 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a7b21314-d1c0-4cb7-b28c-6f9f65b80f3c tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ea6f41c-45fb-4e99-ad4f-d55a20a2bc5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:26 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-a7b21314-d1c0-4cb7-b28c-6f9f65b80f3c tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] Volume 20886fcc-1863-4aaa-a99a-32d57266e559: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-20886fcc-1863-4aaa-a99a-32d57266e559', 'volume_size': 1, 'image_id': 'c2ef1e01-a023-431b-a859-fc925c801dd8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c2ef1e01-a023-431b-a859-fc925c801dd8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e652724012bf7386748b8f39b6da270e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ddc2d9129e8649d8b839d775c44a35fa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5d62f0fd60a33b4f522b613c76da30d6d72e7837ab5d4b62c43d628f385263c2ffe73acdd2a9efcf7e915d1ac892e54e2b2737083c47db1116b39532234fcc06', 'id': 'c2ef1e01-a023-431b-a859-fc925c801dd8', 'created_at': datetime.datetime(2026, 11, 4, 11, 30, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 11, 30, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c2ef1e01-a023-431b-a859-fc925c801dd8/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 04 12:30:26 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7b21314-d1c0-4cb7-b28c-6f9f65b80f3c tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] Trying to clone 20886fcc-1863-4aaa-a99a-32d57266e559 from image c2ef1e01-a023-431b-a859-fc925c801dd8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c2ef1e01-a023-431b-a859-fc925c801dd8', 'metadata': {}}]). {{(pid=87095) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 04 12:30:26 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-5589c888-86bd-49e0-a317-4f59011d4081 tempest-CreateVolumesFromImageTest-1806951304 None] Created volume successfully. Nov 04 12:30:26 devstack sudo[106577]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5f1fa9ff-0b48-446c-bbdc-acbbd06501b7 tempest-VolumeImageDependencyTests-694567839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09e5adda-2550-49b3-8d93-eb73d166227f_ww7r9lzrdevstack@QuobyteHD" returned: 1 in 0.371s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5f1fa9ff-0b48-446c-bbdc-acbbd06501b7 tempest-VolumeImageDependencyTests-694567839 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09e5adda-2550-49b3-8d93-eb73d166227f_ww7r9lzrdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 12:30:26 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-5f1fa9ff-0b48-446c-bbdc-acbbd06501b7 tempest-VolumeImageDependencyTests-694567839 None] Temporary image 09e5adda-2550-49b3-8d93-eb73d166227f is fetched for user 1b604c9af1344a13a00813b43f41d6fb. {{(pid=87095) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 04 12:30:26 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4bc9f84-0915-4a65-b5aa-1bda85da5712]: (4, 'raw') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:30:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5f1fa9ff-0b48-446c-bbdc-acbbd06501b7 tempest-VolumeImageDependencyTests-694567839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_09e5adda-2550-49b3-8d93-eb73d166227f_ww7r9lzrdevstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:26 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-a7b21314-d1c0-4cb7-b28c-6f9f65b80f3c tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c2ef1e01-a023-431b-a859-fc925c801dd8_glt6duyodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87095) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 04 12:30:26 devstack cinder-volume[87095]: INFO cinder.image.image_utils [None req-a7b21314-d1c0-4cb7-b28c-6f9f65b80f3c tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] Image download 0.00 MB at 0.00 MB/s Nov 04 12:30:26 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd5e9b60-c865-4b37-8f7c-093940fc85bd]: (4, 'raw') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:30:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a7b21314-d1c0-4cb7-b28c-6f9f65b80f3c tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c2ef1e01-a023-431b-a859-fc925c801dd8_glt6duyodevstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:26 devstack sudo[106587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_09e5adda-2550-49b3-8d93-eb73d166227f_ww7r9lzrdevstack@QuobyteHD Nov 04 12:30:26 devstack sudo[106587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:26 devstack sudo[106589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c2ef1e01-a023-431b-a859-fc925c801dd8_glt6duyodevstack@QuobyteHD Nov 04 12:30:26 devstack sudo[106589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:26 devstack sudo[106580]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e610bc06-acbe-4137-ba10-31743abe9c3d tempest-CreateVolumesFromImageTest-1806951304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4de58ef2-08f6-49ba-b34c-27d2b381a921 1073741824" returned: 0 in 0.503s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e610bc06-acbe-4137-ba10-31743abe9c3d tempest-CreateVolumesFromImageTest-1806951304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4de58ef2-08f6-49ba-b34c-27d2b381a921 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:26 devstack sudo[106593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4de58ef2-08f6-49ba-b34c-27d2b381a921 Nov 04 12:30:26 devstack sudo[106593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:26 devstack sudo[106587]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5f1fa9ff-0b48-446c-bbdc-acbbd06501b7 tempest-VolumeImageDependencyTests-694567839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_09e5adda-2550-49b3-8d93-eb73d166227f_ww7r9lzrdevstack@QuobyteHD" returned: 0 in 0.397s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5f1fa9ff-0b48-446c-bbdc-acbbd06501b7 tempest-VolumeImageDependencyTests-694567839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09e5adda-2550-49b3-8d93-eb73d166227f_ww7r9lzrdevstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:26 devstack sudo[106589]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a7b21314-d1c0-4cb7-b28c-6f9f65b80f3c tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c2ef1e01-a023-431b-a859-fc925c801dd8_glt6duyodevstack@QuobyteHD" returned: 0 in 0.403s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a7b21314-d1c0-4cb7-b28c-6f9f65b80f3c tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c2ef1e01-a023-431b-a859-fc925c801dd8_glt6duyodevstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:26 devstack sudo[106597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09e5adda-2550-49b3-8d93-eb73d166227f_ww7r9lzrdevstack@QuobyteHD Nov 04 12:30:26 devstack sudo[106597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:26 devstack sudo[106593]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e610bc06-acbe-4137-ba10-31743abe9c3d tempest-CreateVolumesFromImageTest-1806951304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4de58ef2-08f6-49ba-b34c-27d2b381a921" returned: 0 in 0.306s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:26 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e610bc06-acbe-4137-ba10-31743abe9c3d tempest-CreateVolumesFromImageTest-1806951304 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:30:26 devstack sudo[106600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c2ef1e01-a023-431b-a859-fc925c801dd8_glt6duyodevstack@QuobyteHD Nov 04 12:30:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e610bc06-acbe-4137-ba10-31743abe9c3d tempest-CreateVolumesFromImageTest-1806951304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:30:26 devstack sudo[106600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-dfa5c6e3-1959-466c-b14f-dc732469decd tempest-CreateVolumesFromImageTest-1806951304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.606s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:30:26 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-dfa5c6e3-1959-466c-b14f-dc732469decd tempest-CreateVolumesFromImageTest-1806951304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:30:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1197008605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d22a390f-d238-4fd1-9094-27cf04762f03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='497fc0dd22f84c2fb835a779884c0831',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:30:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:30:23Z,use_quota=True,user_id='cf77dd04f6714fc6a0603445b5be6e7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:30:26 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-dfa5c6e3-1959-466c-b14f-dc732469decd tempest-CreateVolumesFromImageTest-1806951304 None] Creating volume d22a390f-d238-4fd1-9094-27cf04762f03 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:30:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-dfa5c6e3-1959-466c-b14f-dc732469decd tempest-CreateVolumesFromImageTest-1806951304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:30:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-dfa5c6e3-1959-466c-b14f-dc732469decd tempest-CreateVolumesFromImageTest-1806951304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:30:26 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-dfa5c6e3-1959-466c-b14f-dc732469decd tempest-CreateVolumesFromImageTest-1806951304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:30:26 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-dfa5c6e3-1959-466c-b14f-dc732469decd tempest-CreateVolumesFromImageTest-1806951304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:30:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-dfa5c6e3-1959-466c-b14f-dc732469decd tempest-CreateVolumesFromImageTest-1806951304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:30:26 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-dfa5c6e3-1959-466c-b14f-dc732469decd tempest-CreateVolumesFromImageTest-1806951304 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:30:26 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-dfa5c6e3-1959-466c-b14f-dc732469decd tempest-CreateVolumesFromImageTest-1806951304 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:30:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-dfa5c6e3-1959-466c-b14f-dc732469decd tempest-CreateVolumesFromImageTest-1806951304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d22a390f-d238-4fd1-9094-27cf04762f03 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:26 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e610bc06-acbe-4137-ba10-31743abe9c3d tempest-CreateVolumesFromImageTest-1806951304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73851f26-c4ec-49ef-ae0b-a7dcf686b33e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4de58ef2-08f6-49ba-b34c-27d2b381a921', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:26 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e610bc06-acbe-4137-ba10-31743abe9c3d tempest-CreateVolumesFromImageTest-1806951304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93d7abf6-1970-4895-9bc6-3ff45cbc184d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:26 devstack sudo[106604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d22a390f-d238-4fd1-9094-27cf04762f03 1073741824 Nov 04 12:30:26 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:26 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-e610bc06-acbe-4137-ba10-31743abe9c3d tempest-CreateVolumesFromImageTest-1806951304 None] Volume volume-4de58ef2-08f6-49ba-b34c-27d2b381a921 (4de58ef2-08f6-49ba-b34c-27d2b381a921): created successfully Nov 04 12:30:26 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e610bc06-acbe-4137-ba10-31743abe9c3d tempest-CreateVolumesFromImageTest-1806951304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93d7abf6-1970-4895-9bc6-3ff45cbc184d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:26 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e610bc06-acbe-4137-ba10-31743abe9c3d tempest-CreateVolumesFromImageTest-1806951304 None] Flow 'volume_create_manager' (67ba9b89-5248-4fae-b315-15cd2163fb29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:30:26 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-e610bc06-acbe-4137-ba10-31743abe9c3d tempest-CreateVolumesFromImageTest-1806951304 None] Created volume successfully. Nov 04 12:30:27 devstack sudo[106597]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5f1fa9ff-0b48-446c-bbdc-acbbd06501b7 tempest-VolumeImageDependencyTests-694567839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09e5adda-2550-49b3-8d93-eb73d166227f_ww7r9lzrdevstack@QuobyteHD" returned: 1 in 0.361s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5f1fa9ff-0b48-446c-bbdc-acbbd06501b7 tempest-VolumeImageDependencyTests-694567839 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09e5adda-2550-49b3-8d93-eb73d166227f_ww7r9lzrdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 12:30:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5f1fa9ff-0b48-446c-bbdc-acbbd06501b7 tempest-VolumeImageDependencyTests-694567839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:30:27 devstack sudo[106600]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a7b21314-d1c0-4cb7-b28c-6f9f65b80f3c tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c2ef1e01-a023-431b-a859-fc925c801dd8_glt6duyodevstack@QuobyteHD" returned: 1 in 0.355s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a7b21314-d1c0-4cb7-b28c-6f9f65b80f3c tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c2ef1e01-a023-431b-a859-fc925c801dd8_glt6duyodevstack@QuobyteHD' failed. Not Retrying. {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 12:30:27 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-a7b21314-d1c0-4cb7-b28c-6f9f65b80f3c tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] Temporary image c2ef1e01-a023-431b-a859-fc925c801dd8 is fetched for user 90a8f52e11024fd38fbf524653d0de63. {{(pid=87095) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 04 12:30:27 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fcbb543-9547-4303-b178-4ca6af2d3bba]: (4, 'raw') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:30:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a7b21314-d1c0-4cb7-b28c-6f9f65b80f3c tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c2ef1e01-a023-431b-a859-fc925c801dd8_glt6duyodevstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:27 devstack sudo[106615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c2ef1e01-a023-431b-a859-fc925c801dd8_glt6duyodevstack@QuobyteHD Nov 04 12:30:27 devstack sudo[106615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:27 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-dfa5c6e3-1959-466c-b14f-dc732469decd tempest-CreateVolumesFromImageTest-1806951304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d22a390f-d238-4fd1-9094-27cf04762f03 1073741824" returned: 0 in 0.424s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-dfa5c6e3-1959-466c-b14f-dc732469decd tempest-CreateVolumesFromImageTest-1806951304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d22a390f-d238-4fd1-9094-27cf04762f03 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:27 devstack sudo[106618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d22a390f-d238-4fd1-9094-27cf04762f03 Nov 04 12:30:27 devstack sudo[106618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:27 devstack sudo[106615]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a7b21314-d1c0-4cb7-b28c-6f9f65b80f3c tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c2ef1e01-a023-431b-a859-fc925c801dd8_glt6duyodevstack@QuobyteHD" returned: 0 in 0.345s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a7b21314-d1c0-4cb7-b28c-6f9f65b80f3c tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c2ef1e01-a023-431b-a859-fc925c801dd8_glt6duyodevstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:27 devstack sudo[106618]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-dfa5c6e3-1959-466c-b14f-dc732469decd tempest-CreateVolumesFromImageTest-1806951304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d22a390f-d238-4fd1-9094-27cf04762f03" returned: 0 in 0.257s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:27 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-dfa5c6e3-1959-466c-b14f-dc732469decd tempest-CreateVolumesFromImageTest-1806951304 None] <== create_volume: return (725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:30:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-dfa5c6e3-1959-466c-b14f-dc732469decd tempest-CreateVolumesFromImageTest-1806951304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.728s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:30:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6cf32837-8daf-48ad-8b11-5960018eb62d tempest-CreateVolumesFromSnapshotTest-1515403536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.782s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:30:27 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-6cf32837-8daf-48ad-8b11-5960018eb62d tempest-CreateVolumesFromSnapshotTest-1515403536 None] Creating offline snapshot 4bf03d0d-2ab2-4e2a-a2ba-1f61179d318e of volume 8216c52a-a5e7-4469-889c-e540cb326b1b {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 12:30:27 devstack sudo[106622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c2ef1e01-a023-431b-a859-fc925c801dd8_glt6duyodevstack@QuobyteHD Nov 04 12:30:27 devstack sudo[106622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dfa5c6e3-1959-466c-b14f-dc732469decd tempest-CreateVolumesFromImageTest-1806951304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24bb3121-d910-49b0-b29b-d4bd2596d172) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d22a390f-d238-4fd1-9094-27cf04762f03', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dfa5c6e3-1959-466c-b14f-dc732469decd tempest-CreateVolumesFromImageTest-1806951304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24d1cfb5-3665-49b0-add2-e6bf0e791a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:27 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebbb38a4-9ef0-4293-8b4c-c2d79d0ffe91]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:30:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6cf32837-8daf-48ad-8b11-5960018eb62d tempest-CreateVolumesFromSnapshotTest-1515403536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8216c52a-a5e7-4469-889c-e540cb326b1b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:27 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-dfa5c6e3-1959-466c-b14f-dc732469decd tempest-CreateVolumesFromImageTest-1806951304 None] Volume volume-d22a390f-d238-4fd1-9094-27cf04762f03 (d22a390f-d238-4fd1-9094-27cf04762f03): created successfully Nov 04 12:30:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dfa5c6e3-1959-466c-b14f-dc732469decd tempest-CreateVolumesFromImageTest-1806951304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24d1cfb5-3665-49b0-add2-e6bf0e791a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dfa5c6e3-1959-466c-b14f-dc732469decd tempest-CreateVolumesFromImageTest-1806951304 None] Flow 'volume_create_manager' (e4aa3336-0154-4d7d-9e54-45dc3aa96e3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:30:27 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-dfa5c6e3-1959-466c-b14f-dc732469decd tempest-CreateVolumesFromImageTest-1806951304 None] Created volume successfully. Nov 04 12:30:27 devstack sudo[106625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8216c52a-a5e7-4469-889c-e540cb326b1b Nov 04 12:30:27 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:27 devstack sudo[106622]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a7b21314-d1c0-4cb7-b28c-6f9f65b80f3c tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c2ef1e01-a023-431b-a859-fc925c801dd8_glt6duyodevstack@QuobyteHD" returned: 1 in 0.341s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a7b21314-d1c0-4cb7-b28c-6f9f65b80f3c tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c2ef1e01-a023-431b-a859-fc925c801dd8_glt6duyodevstack@QuobyteHD' failed. Not Retrying. {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 12:30:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a7b21314-d1c0-4cb7-b28c-6f9f65b80f3c tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:30:28 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6cf32837-8daf-48ad-8b11-5960018eb62d tempest-CreateVolumesFromSnapshotTest-1515403536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8216c52a-a5e7-4469-889c-e540cb326b1b" returned: 0 in 0.368s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6cf32837-8daf-48ad-8b11-5960018eb62d tempest-CreateVolumesFromSnapshotTest-1515403536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8216c52a-a5e7-4469-889c-e540cb326b1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8216c52a-a5e7-4469-889c-e540cb326b1b.4bf03d0d-2ab2-4e2a-a2ba-1f61179d318e 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:28 devstack sudo[106633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8216c52a-a5e7-4469-889c-e540cb326b1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8216c52a-a5e7-4469-889c-e540cb326b1b.4bf03d0d-2ab2-4e2a-a2ba-1f61179d318e 1G Nov 04 12:30:28 devstack sudo[106633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:28 devstack sudo[106633]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6cf32837-8daf-48ad-8b11-5960018eb62d tempest-CreateVolumesFromSnapshotTest-1515403536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8216c52a-a5e7-4469-889c-e540cb326b1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8216c52a-a5e7-4469-889c-e540cb326b1b.4bf03d0d-2ab2-4e2a-a2ba-1f61179d318e 1G" returned: 0 in 0.378s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6cf32837-8daf-48ad-8b11-5960018eb62d tempest-CreateVolumesFromSnapshotTest-1515403536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8216c52a-a5e7-4469-889c-e540cb326b1b -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8216c52a-a5e7-4469-889c-e540cb326b1b.4bf03d0d-2ab2-4e2a-a2ba-1f61179d318e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:28 devstack sudo[106639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8216c52a-a5e7-4469-889c-e540cb326b1b -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8216c52a-a5e7-4469-889c-e540cb326b1b.4bf03d0d-2ab2-4e2a-a2ba-1f61179d318e Nov 04 12:30:28 devstack sudo[106639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:28 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-527de2a2-7324-4d9f-b160-9bf5c59c4945 tempest-CreateVolumesFromImageTest-1806951304 None] Acquiring lock "cinder-d22a390f-d238-4fd1-9094-27cf04762f03-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:30:28 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-527de2a2-7324-4d9f-b160-9bf5c59c4945 tempest-CreateVolumesFromImageTest-1806951304 None] Lock "cinder-d22a390f-d238-4fd1-9094-27cf04762f03-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:30:28 devstack sudo[106639]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6cf32837-8daf-48ad-8b11-5960018eb62d tempest-CreateVolumesFromSnapshotTest-1515403536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8216c52a-a5e7-4469-889c-e540cb326b1b -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8216c52a-a5e7-4469-889c-e540cb326b1b.4bf03d0d-2ab2-4e2a-a2ba-1f61179d318e" returned: 0 in 0.311s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:28 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-6cf32837-8daf-48ad-8b11-5960018eb62d tempest-CreateVolumesFromSnapshotTest-1515403536 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8216c52a-a5e7-4469-889c-e540cb326b1b.4bf03d0d-2ab2-4e2a-a2ba-1f61179d318e is being set with open permissions: ugo+rw Nov 04 12:30:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6cf32837-8daf-48ad-8b11-5960018eb62d tempest-CreateVolumesFromSnapshotTest-1515403536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8216c52a-a5e7-4469-889c-e540cb326b1b.4bf03d0d-2ab2-4e2a-a2ba-1f61179d318e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:28 devstack sudo[106650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8216c52a-a5e7-4469-889c-e540cb326b1b.4bf03d0d-2ab2-4e2a-a2ba-1f61179d318e Nov 04 12:30:28 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-527de2a2-7324-4d9f-b160-9bf5c59c4945 tempest-CreateVolumesFromImageTest-1806951304 None] Acquiring lock "cinder-quobyte-d22a390f-d238-4fd1-9094-27cf04762f03" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:30:28 devstack sudo[106650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:28 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-527de2a2-7324-4d9f-b160-9bf5c59c4945 tempest-CreateVolumesFromImageTest-1806951304 None] Lock "cinder-quobyte-d22a390f-d238-4fd1-9094-27cf04762f03" acquired by "delete_volume" :: waited 0.020s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:30:28 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c927ff-35f9-4c8a-8449-d38d0bb97e79]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:30:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-527de2a2-7324-4d9f-b160-9bf5c59c4945 tempest-CreateVolumesFromImageTest-1806951304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d22a390f-d238-4fd1-9094-27cf04762f03 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:28 devstack sudo[106652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d22a390f-d238-4fd1-9094-27cf04762f03 Nov 04 12:30:28 devstack sudo[106652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:29 devstack sudo[106650]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6cf32837-8daf-48ad-8b11-5960018eb62d tempest-CreateVolumesFromSnapshotTest-1515403536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8216c52a-a5e7-4469-889c-e540cb326b1b.4bf03d0d-2ab2-4e2a-a2ba-1f61179d318e" returned: 0 in 0.263s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6cf32837-8daf-48ad-8b11-5960018eb62d tempest-CreateVolumesFromSnapshotTest-1515403536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8216c52a-a5e7-4469-889c-e540cb326b1b.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:29 devstack sudo[106655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8216c52a-a5e7-4469-889c-e540cb326b1b.info Nov 04 12:30:29 devstack sudo[106655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:29 devstack sudo[106652]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-527de2a2-7324-4d9f-b160-9bf5c59c4945 tempest-CreateVolumesFromImageTest-1806951304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d22a390f-d238-4fd1-9094-27cf04762f03" returned: 0 in 0.403s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-527de2a2-7324-4d9f-b160-9bf5c59c4945 tempest-CreateVolumesFromImageTest-1806951304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d22a390f-d238-4fd1-9094-27cf04762f03 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:29 devstack sudo[106660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d22a390f-d238-4fd1-9094-27cf04762f03 Nov 04 12:30:29 devstack sudo[106660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:29 devstack sudo[106655]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6cf32837-8daf-48ad-8b11-5960018eb62d tempest-CreateVolumesFromSnapshotTest-1515403536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8216c52a-a5e7-4469-889c-e540cb326b1b.info" returned: 0 in 0.254s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:29 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-6cf32837-8daf-48ad-8b11-5960018eb62d tempest-CreateVolumesFromSnapshotTest-1515403536 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8216c52a-a5e7-4469-889c-e540cb326b1b.info is being set with open permissions: ugo+rw Nov 04 12:30:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6cf32837-8daf-48ad-8b11-5960018eb62d tempest-CreateVolumesFromSnapshotTest-1515403536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8216c52a-a5e7-4469-889c-e540cb326b1b.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:29 devstack sudo[106663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8216c52a-a5e7-4469-889c-e540cb326b1b.info Nov 04 12:30:29 devstack sudo[106663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:29 devstack sudo[106660]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-527de2a2-7324-4d9f-b160-9bf5c59c4945 tempest-CreateVolumesFromImageTest-1806951304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-d22a390f-d238-4fd1-9094-27cf04762f03" returned: 0 in 0.259s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:29 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-527de2a2-7324-4d9f-b160-9bf5c59c4945 tempest-CreateVolumesFromImageTest-1806951304 None] Lock "cinder-quobyte-d22a390f-d238-4fd1-9094-27cf04762f03" released by "delete_volume" :: held 0.713s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:30:29 devstack sudo[106663]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6cf32837-8daf-48ad-8b11-5960018eb62d tempest-CreateVolumesFromSnapshotTest-1515403536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8216c52a-a5e7-4469-889c-e540cb326b1b.info" returned: 0 in 0.252s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6cf32837-8daf-48ad-8b11-5960018eb62d tempest-CreateVolumesFromSnapshotTest-1515403536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.922s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:30:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5f1fa9ff-0b48-446c-bbdc-acbbd06501b7 tempest-VolumeImageDependencyTests-694567839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.502s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:30:29 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-5f1fa9ff-0b48-446c-bbdc-acbbd06501b7 tempest-VolumeImageDependencyTests-694567839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:30:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65f11fc9-f4f5-4a22-a890-f11aa337f2f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d282670ed0a348df8455e012eded36bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:30:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:30:25Z,use_quota=True,user_id='1b604c9af1344a13a00813b43f41d6fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:30:29 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-5f1fa9ff-0b48-446c-bbdc-acbbd06501b7 tempest-VolumeImageDependencyTests-694567839 None] Creating volume 65f11fc9-f4f5-4a22-a890-f11aa337f2f7 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:30:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5f1fa9ff-0b48-446c-bbdc-acbbd06501b7 tempest-VolumeImageDependencyTests-694567839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:30:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5f1fa9ff-0b48-446c-bbdc-acbbd06501b7 tempest-VolumeImageDependencyTests-694567839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:30:29 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-5f1fa9ff-0b48-446c-bbdc-acbbd06501b7 tempest-VolumeImageDependencyTests-694567839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:30:29 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-5f1fa9ff-0b48-446c-bbdc-acbbd06501b7 tempest-VolumeImageDependencyTests-694567839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:30:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5f1fa9ff-0b48-446c-bbdc-acbbd06501b7 tempest-VolumeImageDependencyTests-694567839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:30:29 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-5f1fa9ff-0b48-446c-bbdc-acbbd06501b7 tempest-VolumeImageDependencyTests-694567839 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:30:29 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-5f1fa9ff-0b48-446c-bbdc-acbbd06501b7 tempest-VolumeImageDependencyTests-694567839 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:30:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5f1fa9ff-0b48-446c-bbdc-acbbd06501b7 tempest-VolumeImageDependencyTests-694567839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-65f11fc9-f4f5-4a22-a890-f11aa337f2f7 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:29 devstack sudo[106667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-65f11fc9-f4f5-4a22-a890-f11aa337f2f7 1073741824 Nov 04 12:30:29 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:29 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-527de2a2-7324-4d9f-b160-9bf5c59c4945 tempest-CreateVolumesFromImageTest-1806951304 None] Created reservations ['dce8cae0-7d5b-40f5-b1fb-81be54a6321b', '4c7260e5-d479-4b36-8c0c-a5d436552c6b', '52cd9c44-2690-43c4-b8cb-46cd4413a557', '40e4ec56-7cd9-4d5a-b4db-866cded37a2b'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:30:29 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-6cf32837-8daf-48ad-8b11-5960018eb62d tempest-CreateVolumesFromSnapshotTest-1515403536 None] Create snapshot completed successfully Nov 04 12:30:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-527de2a2-7324-4d9f-b160-9bf5c59c4945 tempest-CreateVolumesFromImageTest-1806951304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:30:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-527de2a2-7324-4d9f-b160-9bf5c59c4945 tempest-CreateVolumesFromImageTest-1806951304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:30:29 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-527de2a2-7324-4d9f-b160-9bf5c59c4945 tempest-CreateVolumesFromImageTest-1806951304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:30:29 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-527de2a2-7324-4d9f-b160-9bf5c59c4945 tempest-CreateVolumesFromImageTest-1806951304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:30:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-527de2a2-7324-4d9f-b160-9bf5c59c4945 tempest-CreateVolumesFromImageTest-1806951304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:30:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-527de2a2-7324-4d9f-b160-9bf5c59c4945 tempest-CreateVolumesFromImageTest-1806951304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:29 devstack sudo[106669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:30:29 devstack sudo[106669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:29 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3498c2a7-b8b7-4941-9c86-6a9e6f742049 tempest-CreateVolumesFromImageTest-1806951304 None] Acquiring lock "cinder-4de58ef2-08f6-49ba-b34c-27d2b381a921-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:30:29 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3498c2a7-b8b7-4941-9c86-6a9e6f742049 tempest-CreateVolumesFromImageTest-1806951304 None] Lock "cinder-4de58ef2-08f6-49ba-b34c-27d2b381a921-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:30:29 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3498c2a7-b8b7-4941-9c86-6a9e6f742049 tempest-CreateVolumesFromImageTest-1806951304 None] Acquiring lock "cinder-quobyte-4de58ef2-08f6-49ba-b34c-27d2b381a921" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:30:30 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3498c2a7-b8b7-4941-9c86-6a9e6f742049 tempest-CreateVolumesFromImageTest-1806951304 None] Lock "cinder-quobyte-4de58ef2-08f6-49ba-b34c-27d2b381a921" acquired by "delete_volume" :: waited 0.020s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:30:30 devstack sudo[106669]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-527de2a2-7324-4d9f-b160-9bf5c59c4945 tempest-CreateVolumesFromImageTest-1806951304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.341s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:30 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-527de2a2-7324-4d9f-b160-9bf5c59c4945 tempest-CreateVolumesFromImageTest-1806951304 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:30:30 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2318fd0-0810-4a2f-aa49-d25a9d8242ce]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:30:30 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-527de2a2-7324-4d9f-b160-9bf5c59c4945 tempest-CreateVolumesFromImageTest-1806951304 None] Deleted volume successfully. Nov 04 12:30:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3498c2a7-b8b7-4941-9c86-6a9e6f742049 tempest-CreateVolumesFromImageTest-1806951304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4de58ef2-08f6-49ba-b34c-27d2b381a921 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:30 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-527de2a2-7324-4d9f-b160-9bf5c59c4945 tempest-CreateVolumesFromImageTest-1806951304 None] Lock "cinder-d22a390f-d238-4fd1-9094-27cf04762f03-delete_volume" released by "delete_volume" :: held 1.359s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:30:30 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5f1fa9ff-0b48-446c-bbdc-acbbd06501b7 tempest-VolumeImageDependencyTests-694567839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-65f11fc9-f4f5-4a22-a890-f11aa337f2f7 1073741824" returned: 0 in 0.581s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:30 devstack sudo[106676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4de58ef2-08f6-49ba-b34c-27d2b381a921 Nov 04 12:30:30 devstack sudo[106676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5f1fa9ff-0b48-446c-bbdc-acbbd06501b7 tempest-VolumeImageDependencyTests-694567839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-65f11fc9-f4f5-4a22-a890-f11aa337f2f7 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:30 devstack sudo[106678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-65f11fc9-f4f5-4a22-a890-f11aa337f2f7 Nov 04 12:30:30 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:30 devstack sudo[106676]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3498c2a7-b8b7-4941-9c86-6a9e6f742049 tempest-CreateVolumesFromImageTest-1806951304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4de58ef2-08f6-49ba-b34c-27d2b381a921" returned: 0 in 0.436s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3498c2a7-b8b7-4941-9c86-6a9e6f742049 tempest-CreateVolumesFromImageTest-1806951304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4de58ef2-08f6-49ba-b34c-27d2b381a921 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:30 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5f1fa9ff-0b48-446c-bbdc-acbbd06501b7 tempest-VolumeImageDependencyTests-694567839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-65f11fc9-f4f5-4a22-a890-f11aa337f2f7" returned: 0 in 0.299s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:30 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-5f1fa9ff-0b48-446c-bbdc-acbbd06501b7 tempest-VolumeImageDependencyTests-694567839 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:30:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5f1fa9ff-0b48-446c-bbdc-acbbd06501b7 tempest-VolumeImageDependencyTests-694567839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:30:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a7b21314-d1c0-4cb7-b28c-6f9f65b80f3c tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.599s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:30:30 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a7b21314-d1c0-4cb7-b28c-6f9f65b80f3c tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:30:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20886fcc-1863-4aaa-a99a-32d57266e559,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddc2d9129e8649d8b839d775c44a35fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:30:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:30:26Z,use_quota=True,user_id='90a8f52e11024fd38fbf524653d0de63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(752015eb-fa37-43e6-8496-29fdb307ea60),volume_type_id=752015eb-fa37-43e6-8496-29fdb307ea60)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:30:30 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-a7b21314-d1c0-4cb7-b28c-6f9f65b80f3c tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] Creating volume 20886fcc-1863-4aaa-a99a-32d57266e559 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:30:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a7b21314-d1c0-4cb7-b28c-6f9f65b80f3c tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:30:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a7b21314-d1c0-4cb7-b28c-6f9f65b80f3c tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:30:30 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a7b21314-d1c0-4cb7-b28c-6f9f65b80f3c tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:30:30 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a7b21314-d1c0-4cb7-b28c-6f9f65b80f3c tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:30:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a7b21314-d1c0-4cb7-b28c-6f9f65b80f3c tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:30:30 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a7b21314-d1c0-4cb7-b28c-6f9f65b80f3c tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:30:30 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-a7b21314-d1c0-4cb7-b28c-6f9f65b80f3c tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:30:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a7b21314-d1c0-4cb7-b28c-6f9f65b80f3c tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-20886fcc-1863-4aaa-a99a-32d57266e559 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:30 devstack sudo[106684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4de58ef2-08f6-49ba-b34c-27d2b381a921 Nov 04 12:30:30 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:30 devstack sudo[106686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-20886fcc-1863-4aaa-a99a-32d57266e559 1073741824 Nov 04 12:30:30 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:30 devstack cinder-volume[87095]: DEBUG cinder.volume.volume_utils [None req-5f1fa9ff-0b48-446c-bbdc-acbbd06501b7 tempest-VolumeImageDependencyTests-694567839 None] Attempting download of 09e5adda-2550-49b3-8d93-eb73d166227f ((None, [{'url': 'file:///opt/stack/data/glance/images/09e5adda-2550-49b3-8d93-eb73d166227f', 'metadata': {}}])) to volume 65f11fc9-f4f5-4a22-a890-f11aa337f2f7. {{(pid=87095) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 04 12:30:30 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d9a0301-6171-4f2b-bdfa-1f77fcede5d0 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:30:30 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4d9a0301-6171-4f2b-bdfa-1f77fcede5d0 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Flow 'volume_create_manager' (e4648d25-cde1-4a53-aa31-d97d0f401a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:30:30 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4d9a0301-6171-4f2b-bdfa-1f77fcede5d0 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e53dc14-f9c3-4619-a335-cc06e48a18b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:30 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[615bc2cb-701e-402d-9206-50f150945a50]: (4, 'raw') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:30:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5f1fa9ff-0b48-446c-bbdc-acbbd06501b7 tempest-VolumeImageDependencyTests-694567839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_09e5adda-2550-49b3-8d93-eb73d166227f_32yex746 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:30 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4d9a0301-6171-4f2b-bdfa-1f77fcede5d0 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e53dc14-f9c3-4619-a335-cc06e48a18b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:30:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2040298456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=576775b2-df3e-4e47-9def-c575173abb85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f2ecbf4c26745aea61e77c646f1ae08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:30:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:30:31Z,use_quota=True,user_id='eb107a11aa25484bbb00b0017ec862ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:30 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4d9a0301-6171-4f2b-bdfa-1f77fcede5d0 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4ee8ed5-1c10-4864-a4e0-8d7b417d98ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:30 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4d9a0301-6171-4f2b-bdfa-1f77fcede5d0 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4ee8ed5-1c10-4864-a4e0-8d7b417d98ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:30 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4d9a0301-6171-4f2b-bdfa-1f77fcede5d0 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cc259b9-5c53-4f36-9e5e-8deb60ac1acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:30 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4d9a0301-6171-4f2b-bdfa-1f77fcede5d0 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cc259b9-5c53-4f36-9e5e-8deb60ac1acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '576775b2-df3e-4e47-9def-c575173abb85', 'volume_name': 'volume-576775b2-df3e-4e47-9def-c575173abb85', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:30 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4d9a0301-6171-4f2b-bdfa-1f77fcede5d0 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc7406c3-9707-4889-a44f-bff1b73e0ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:30 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4d9a0301-6171-4f2b-bdfa-1f77fcede5d0 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc7406c3-9707-4889-a44f-bff1b73e0ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:30 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4d9a0301-6171-4f2b-bdfa-1f77fcede5d0 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (457a9594-7ef0-4a70-830b-00f72b1a6bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:30 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-4d9a0301-6171-4f2b-bdfa-1f77fcede5d0 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Volume 576775b2-df3e-4e47-9def-c575173abb85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-576775b2-df3e-4e47-9def-c575173abb85', 'volume_size': 1} Nov 04 12:30:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4d9a0301-6171-4f2b-bdfa-1f77fcede5d0 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:30:30 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3498c2a7-b8b7-4941-9c86-6a9e6f742049 tempest-CreateVolumesFromImageTest-1806951304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-4de58ef2-08f6-49ba-b34c-27d2b381a921" returned: 0 in 0.338s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:30 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3498c2a7-b8b7-4941-9c86-6a9e6f742049 tempest-CreateVolumesFromImageTest-1806951304 None] Lock "cinder-quobyte-4de58ef2-08f6-49ba-b34c-27d2b381a921" released by "delete_volume" :: held 0.835s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:30:30 devstack sudo[106688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_09e5adda-2550-49b3-8d93-eb73d166227f_32yex746 Nov 04 12:30:30 devstack sudo[106688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:30 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-3498c2a7-b8b7-4941-9c86-6a9e6f742049 tempest-CreateVolumesFromImageTest-1806951304 None] Created reservations ['4d9a0eb4-9960-4c8c-8a02-5d0eac527748', '72560082-739b-4677-8e89-b851dd2239b9', '04f1f28f-54cf-4bee-9884-ed76583c1d2a', 'dec14e28-95fb-4d51-9a16-2e98046f3501'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:30:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3498c2a7-b8b7-4941-9c86-6a9e6f742049 tempest-CreateVolumesFromImageTest-1806951304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:30:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3498c2a7-b8b7-4941-9c86-6a9e6f742049 tempest-CreateVolumesFromImageTest-1806951304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:30:31 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3498c2a7-b8b7-4941-9c86-6a9e6f742049 tempest-CreateVolumesFromImageTest-1806951304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:30:31 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3498c2a7-b8b7-4941-9c86-6a9e6f742049 tempest-CreateVolumesFromImageTest-1806951304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:30:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3498c2a7-b8b7-4941-9c86-6a9e6f742049 tempest-CreateVolumesFromImageTest-1806951304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:30:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3498c2a7-b8b7-4941-9c86-6a9e6f742049 tempest-CreateVolumesFromImageTest-1806951304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:31 devstack sudo[106694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:30:31 devstack sudo[106694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:31 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-2b2886e5-7a3c-45f5-836b-c598a6734094 tempest-CreateVolumesFromImageTest-1806951304 None] Acquiring lock "cinder-6da2df96-061d-4112-9b53-7e37721aa751-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:30:31 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:31 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-d05de525-8380-4b49-8ed9-57c3faac0922 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:30:31 devstack sudo[106688]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d05de525-8380-4b49-8ed9-57c3faac0922 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Flow 'volume_create_manager' (6c28bc12-d069-472f-8a84-6102a206a279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:30:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d05de525-8380-4b49-8ed9-57c3faac0922 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f88fbf55-d945-47f9-8860-84a5acb1706f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:31 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-2b2886e5-7a3c-45f5-836b-c598a6734094 tempest-CreateVolumesFromImageTest-1806951304 None] Lock "cinder-6da2df96-061d-4112-9b53-7e37721aa751-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:30:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5f1fa9ff-0b48-446c-bbdc-acbbd06501b7 tempest-VolumeImageDependencyTests-694567839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_09e5adda-2550-49b3-8d93-eb73d166227f_32yex746" returned: 0 in 0.716s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a7b21314-d1c0-4cb7-b28c-6f9f65b80f3c tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-20886fcc-1863-4aaa-a99a-32d57266e559 1073741824" returned: 0 in 0.889s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5f1fa9ff-0b48-446c-bbdc-acbbd06501b7 tempest-VolumeImageDependencyTests-694567839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_09e5adda-2550-49b3-8d93-eb73d166227f_32yex746 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d05de525-8380-4b49-8ed9-57c3faac0922 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f88fbf55-d945-47f9-8860-84a5acb1706f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:30:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1500876540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6574580a-ea02-4fee-aaf9-4cd633641e72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f2ecbf4c26745aea61e77c646f1ae08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:30:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:30:31Z,use_quota=True,user_id='eb107a11aa25484bbb00b0017ec862ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d05de525-8380-4b49-8ed9-57c3faac0922 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42f8bf2f-6e53-45c8-9fea-026ac5b923b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d05de525-8380-4b49-8ed9-57c3faac0922 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42f8bf2f-6e53-45c8-9fea-026ac5b923b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:31 devstack sudo[106694]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d05de525-8380-4b49-8ed9-57c3faac0922 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e14cd83-8319-4630-b07c-2b59694658b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d05de525-8380-4b49-8ed9-57c3faac0922 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e14cd83-8319-4630-b07c-2b59694658b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6574580a-ea02-4fee-aaf9-4cd633641e72', 'volume_name': 'volume-6574580a-ea02-4fee-aaf9-4cd633641e72', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d05de525-8380-4b49-8ed9-57c3faac0922 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fda47251-a467-4106-ac22-61c3d44e89a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d05de525-8380-4b49-8ed9-57c3faac0922 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fda47251-a467-4106-ac22-61c3d44e89a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d05de525-8380-4b49-8ed9-57c3faac0922 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2d80c18-5eb5-406f-b1e7-04a3bdd85375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:31 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-d05de525-8380-4b49-8ed9-57c3faac0922 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Volume 6574580a-ea02-4fee-aaf9-4cd633641e72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6574580a-ea02-4fee-aaf9-4cd633641e72', 'volume_size': 1} Nov 04 12:30:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d05de525-8380-4b49-8ed9-57c3faac0922 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:30:31 devstack sudo[106732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_09e5adda-2550-49b3-8d93-eb73d166227f_32yex746 Nov 04 12:30:31 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3498c2a7-b8b7-4941-9c86-6a9e6f742049 tempest-CreateVolumesFromImageTest-1806951304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.599s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:31 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-3498c2a7-b8b7-4941-9c86-6a9e6f742049 tempest-CreateVolumesFromImageTest-1806951304 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:30:31 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-3498c2a7-b8b7-4941-9c86-6a9e6f742049 tempest-CreateVolumesFromImageTest-1806951304 None] Deleted volume successfully. Nov 04 12:30:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a7b21314-d1c0-4cb7-b28c-6f9f65b80f3c tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-20886fcc-1863-4aaa-a99a-32d57266e559 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:31 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-2b2886e5-7a3c-45f5-836b-c598a6734094 tempest-CreateVolumesFromImageTest-1806951304 None] Acquiring lock "cinder-quobyte-6da2df96-061d-4112-9b53-7e37721aa751" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:30:31 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3498c2a7-b8b7-4941-9c86-6a9e6f742049 tempest-CreateVolumesFromImageTest-1806951304 None] Lock "cinder-4de58ef2-08f6-49ba-b34c-27d2b381a921-delete_volume" released by "delete_volume" :: held 1.752s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:30:31 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-2b2886e5-7a3c-45f5-836b-c598a6734094 tempest-CreateVolumesFromImageTest-1806951304 None] Lock "cinder-quobyte-6da2df96-061d-4112-9b53-7e37721aa751" acquired by "delete_volume" :: waited 0.029s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:30:31 devstack sudo[106735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-20886fcc-1863-4aaa-a99a-32d57266e559 Nov 04 12:30:31 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:31 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[be5af3f4-928a-494f-8cca-930f1742d4b6]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:30:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2b2886e5-7a3c-45f5-836b-c598a6734094 tempest-CreateVolumesFromImageTest-1806951304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6da2df96-061d-4112-9b53-7e37721aa751 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:31 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e13dc93-5f8b-478e-bea4-9f0de91924a2 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:30:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2e13dc93-5f8b-478e-bea4-9f0de91924a2 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Flow 'volume_create_manager' (7ac5c505-b24a-4014-8987-e94fb986507a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:30:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2e13dc93-5f8b-478e-bea4-9f0de91924a2 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f398fde3-1d1e-495c-8797-714d5ac25bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2e13dc93-5f8b-478e-bea4-9f0de91924a2 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f398fde3-1d1e-495c-8797-714d5ac25bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:30:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1650376555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=052e559b-0a10-42ed-bfd2-3c8b49ca7f37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f2ecbf4c26745aea61e77c646f1ae08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:30:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:30:32Z,use_quota=True,user_id='eb107a11aa25484bbb00b0017ec862ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2e13dc93-5f8b-478e-bea4-9f0de91924a2 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ede3d5d6-ab1d-4d86-8506-5688f780b976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2e13dc93-5f8b-478e-bea4-9f0de91924a2 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ede3d5d6-ab1d-4d86-8506-5688f780b976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2e13dc93-5f8b-478e-bea4-9f0de91924a2 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf2eb858-d868-41a2-b5e3-d229cfcef471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2e13dc93-5f8b-478e-bea4-9f0de91924a2 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf2eb858-d868-41a2-b5e3-d229cfcef471) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '052e559b-0a10-42ed-bfd2-3c8b49ca7f37', 'volume_name': 'volume-052e559b-0a10-42ed-bfd2-3c8b49ca7f37', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:32 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2e13dc93-5f8b-478e-bea4-9f0de91924a2 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a89c7ecc-cfb2-47dc-a9f4-f492b6152734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2e13dc93-5f8b-478e-bea4-9f0de91924a2 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a89c7ecc-cfb2-47dc-a9f4-f492b6152734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2e13dc93-5f8b-478e-bea4-9f0de91924a2 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3ad4ae0-5097-47ce-9d8b-27c29934e0ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:32 devstack sudo[106737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6da2df96-061d-4112-9b53-7e37721aa751 Nov 04 12:30:32 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-2e13dc93-5f8b-478e-bea4-9f0de91924a2 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Volume 052e559b-0a10-42ed-bfd2-3c8b49ca7f37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-052e559b-0a10-42ed-bfd2-3c8b49ca7f37', 'volume_size': 1} Nov 04 12:30:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2e13dc93-5f8b-478e-bea4-9f0de91924a2 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:30:32 devstack sudo[106737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5f1fa9ff-0b48-446c-bbdc-acbbd06501b7 tempest-VolumeImageDependencyTests-694567839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_09e5adda-2550-49b3-8d93-eb73d166227f_32yex746" returned: 1 in 0.679s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5f1fa9ff-0b48-446c-bbdc-acbbd06501b7 tempest-VolumeImageDependencyTests-694567839 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_09e5adda-2550-49b3-8d93-eb73d166227f_32yex746' failed. Not Retrying. {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 12:30:32 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d8bd375-6b51-4406-ba31-d2b82d48ba9c]: (4, 'raw') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:30:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5f1fa9ff-0b48-446c-bbdc-acbbd06501b7 tempest-VolumeImageDependencyTests-694567839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_09e5adda-2550-49b3-8d93-eb73d166227f_ww7r9lzrdevstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:32 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a7b21314-d1c0-4cb7-b28c-6f9f65b80f3c tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-20886fcc-1863-4aaa-a99a-32d57266e559" returned: 0 in 0.479s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:32 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a7b21314-d1c0-4cb7-b28c-6f9f65b80f3c tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] <== create_volume: return (1622ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:30:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a7b21314-d1c0-4cb7-b28c-6f9f65b80f3c tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.625s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:30:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4d9a0301-6171-4f2b-bdfa-1f77fcede5d0 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.360s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:30:32 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4d9a0301-6171-4f2b-bdfa-1f77fcede5d0 tempest-CreateVolumesFromSnapshotTest-1515403536 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:30:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2040298456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=576775b2-df3e-4e47-9def-c575173abb85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f2ecbf4c26745aea61e77c646f1ae08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:30:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:30:31Z,use_quota=True,user_id='eb107a11aa25484bbb00b0017ec862ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:30:32 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-4d9a0301-6171-4f2b-bdfa-1f77fcede5d0 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Creating volume 576775b2-df3e-4e47-9def-c575173abb85 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:30:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4d9a0301-6171-4f2b-bdfa-1f77fcede5d0 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:30:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4d9a0301-6171-4f2b-bdfa-1f77fcede5d0 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:30:32 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4d9a0301-6171-4f2b-bdfa-1f77fcede5d0 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:30:32 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4d9a0301-6171-4f2b-bdfa-1f77fcede5d0 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:30:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4d9a0301-6171-4f2b-bdfa-1f77fcede5d0 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:30:32 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4d9a0301-6171-4f2b-bdfa-1f77fcede5d0 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:30:32 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-4d9a0301-6171-4f2b-bdfa-1f77fcede5d0 tempest-CreateVolumesFromSnapshotTest-1515403536 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:30:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4d9a0301-6171-4f2b-bdfa-1f77fcede5d0 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-576775b2-df3e-4e47-9def-c575173abb85 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:32 devstack sudo[106745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-576775b2-df3e-4e47-9def-c575173abb85 1073741824 Nov 04 12:30:32 devstack sudo[106745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:32 devstack cinder-volume[87095]: DEBUG cinder.volume.volume_utils [None req-a7b21314-d1c0-4cb7-b28c-6f9f65b80f3c tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] Attempting download of c2ef1e01-a023-431b-a859-fc925c801dd8 ((None, [{'url': 'file:///opt/stack/data/glance/images/c2ef1e01-a023-431b-a859-fc925c801dd8', 'metadata': {}}])) to volume 20886fcc-1863-4aaa-a99a-32d57266e559. {{(pid=87095) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 04 12:30:32 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[8faf97a4-ef4a-4685-925c-454b156948f7]: (4, 'raw') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:30:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a7b21314-d1c0-4cb7-b28c-6f9f65b80f3c tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c2ef1e01-a023-431b-a859-fc925c801dd8_uzim918i {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:32 devstack sudo[106744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_09e5adda-2550-49b3-8d93-eb73d166227f_ww7r9lzrdevstack@QuobyteHD Nov 04 12:30:32 devstack sudo[106744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:32 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-553e42d3-87d5-41cb-8324-8e264dc8b41f tempest-CreateVolumesFromSnapshotTest-1515403536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:30:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-553e42d3-87d5-41cb-8324-8e264dc8b41f tempest-CreateVolumesFromSnapshotTest-1515403536 None] Flow 'volume_create_manager' (6c2d1cd7-8b6c-46b4-af8a-700d50399a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:30:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-553e42d3-87d5-41cb-8324-8e264dc8b41f tempest-CreateVolumesFromSnapshotTest-1515403536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (727dc2e0-2272-48f1-a8eb-833ca993f55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-553e42d3-87d5-41cb-8324-8e264dc8b41f tempest-CreateVolumesFromSnapshotTest-1515403536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (727dc2e0-2272-48f1-a8eb-833ca993f55d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-866609233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e156e44d-8360-4c69-b116-5097aa280726,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f2ecbf4c26745aea61e77c646f1ae08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:30:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:30:32Z,use_quota=True,user_id='eb107a11aa25484bbb00b0017ec862ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-553e42d3-87d5-41cb-8324-8e264dc8b41f tempest-CreateVolumesFromSnapshotTest-1515403536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01f11c20-4001-4b1c-8182-9ca251210309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-553e42d3-87d5-41cb-8324-8e264dc8b41f tempest-CreateVolumesFromSnapshotTest-1515403536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01f11c20-4001-4b1c-8182-9ca251210309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-553e42d3-87d5-41cb-8324-8e264dc8b41f tempest-CreateVolumesFromSnapshotTest-1515403536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76ed42fe-4c8c-4a45-9d35-49babc26c3ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:32 devstack sudo[106747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c2ef1e01-a023-431b-a859-fc925c801dd8_uzim918i Nov 04 12:30:32 devstack sudo[106747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-553e42d3-87d5-41cb-8324-8e264dc8b41f tempest-CreateVolumesFromSnapshotTest-1515403536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76ed42fe-4c8c-4a45-9d35-49babc26c3ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e156e44d-8360-4c69-b116-5097aa280726', 'volume_name': 'volume-e156e44d-8360-4c69-b116-5097aa280726', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-553e42d3-87d5-41cb-8324-8e264dc8b41f tempest-CreateVolumesFromSnapshotTest-1515403536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcf3fb52-ee3c-4644-b9bd-26b2f3ab2b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-553e42d3-87d5-41cb-8324-8e264dc8b41f tempest-CreateVolumesFromSnapshotTest-1515403536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcf3fb52-ee3c-4644-b9bd-26b2f3ab2b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-553e42d3-87d5-41cb-8324-8e264dc8b41f tempest-CreateVolumesFromSnapshotTest-1515403536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc89656f-68bd-48d0-bfdb-7eb138ae79e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:32 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-553e42d3-87d5-41cb-8324-8e264dc8b41f tempest-CreateVolumesFromSnapshotTest-1515403536 None] Volume e156e44d-8360-4c69-b116-5097aa280726: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e156e44d-8360-4c69-b116-5097aa280726', 'volume_size': 1} Nov 04 12:30:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-553e42d3-87d5-41cb-8324-8e264dc8b41f tempest-CreateVolumesFromSnapshotTest-1515403536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:30:32 devstack sudo[106737]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2b2886e5-7a3c-45f5-836b-c598a6734094 tempest-CreateVolumesFromImageTest-1806951304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6da2df96-061d-4112-9b53-7e37721aa751" returned: 0 in 0.907s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2b2886e5-7a3c-45f5-836b-c598a6734094 tempest-CreateVolumesFromImageTest-1806951304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6da2df96-061d-4112-9b53-7e37721aa751 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:32 devstack sudo[106756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6da2df96-061d-4112-9b53-7e37721aa751 Nov 04 12:30:32 devstack sudo[106756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:32 devstack sudo[106744]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5f1fa9ff-0b48-446c-bbdc-acbbd06501b7 tempest-VolumeImageDependencyTests-694567839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_09e5adda-2550-49b3-8d93-eb73d166227f_ww7r9lzrdevstack@QuobyteHD" returned: 0 in 0.736s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5f1fa9ff-0b48-446c-bbdc-acbbd06501b7 tempest-VolumeImageDependencyTests-694567839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09e5adda-2550-49b3-8d93-eb73d166227f_ww7r9lzrdevstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:32 devstack sudo[106747]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:32 devstack sudo[106745]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a7b21314-d1c0-4cb7-b28c-6f9f65b80f3c tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c2ef1e01-a023-431b-a859-fc925c801dd8_uzim918i" returned: 0 in 0.634s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a7b21314-d1c0-4cb7-b28c-6f9f65b80f3c tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c2ef1e01-a023-431b-a859-fc925c801dd8_uzim918i {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:32 devstack sudo[106760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09e5adda-2550-49b3-8d93-eb73d166227f_ww7r9lzrdevstack@QuobyteHD Nov 04 12:30:32 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4d9a0301-6171-4f2b-bdfa-1f77fcede5d0 tempest-CreateVolumesFromSnapshotTest-1515403536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-576775b2-df3e-4e47-9def-c575173abb85 1073741824" returned: 0 in 0.836s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:33 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-b926dc71-7653-4ddf-883d-60dd899381b9 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:30:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b926dc71-7653-4ddf-883d-60dd899381b9 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Flow 'volume_create_manager' (4a1c6dbe-5bdf-403c-9f95-a80210ede594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:30:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b926dc71-7653-4ddf-883d-60dd899381b9 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfc65040-f418-4bb3-80c6-7adab3f7fec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:33 devstack sudo[106756]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:33 devstack sudo[106763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c2ef1e01-a023-431b-a859-fc925c801dd8_uzim918i Nov 04 12:30:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b926dc71-7653-4ddf-883d-60dd899381b9 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfc65040-f418-4bb3-80c6-7adab3f7fec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:30:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-529028090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c701985-c529-48c9-8ff8-6015391d6b34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f2ecbf4c26745aea61e77c646f1ae08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:30:33Z,use_quota=True,user_id='eb107a11aa25484bbb00b0017ec862ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:33 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b926dc71-7653-4ddf-883d-60dd899381b9 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be2a0d64-0e8f-4893-a3f8-2e399b7c99aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b926dc71-7653-4ddf-883d-60dd899381b9 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be2a0d64-0e8f-4893-a3f8-2e399b7c99aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b926dc71-7653-4ddf-883d-60dd899381b9 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f6ceeb7-cb48-442a-9f71-112fb71d65e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b926dc71-7653-4ddf-883d-60dd899381b9 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f6ceeb7-cb48-442a-9f71-112fb71d65e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c701985-c529-48c9-8ff8-6015391d6b34', 'volume_name': 'volume-9c701985-c529-48c9-8ff8-6015391d6b34', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b926dc71-7653-4ddf-883d-60dd899381b9 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40403323-6f90-46e6-a31c-04d02122f819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b926dc71-7653-4ddf-883d-60dd899381b9 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40403323-6f90-46e6-a31c-04d02122f819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b926dc71-7653-4ddf-883d-60dd899381b9 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c7b1da3-56fd-47ee-8aa1-b6e73e878445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:33 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-b926dc71-7653-4ddf-883d-60dd899381b9 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Volume 9c701985-c529-48c9-8ff8-6015391d6b34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c701985-c529-48c9-8ff8-6015391d6b34', 'volume_size': 1} Nov 04 12:30:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b926dc71-7653-4ddf-883d-60dd899381b9 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:30:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2b2886e5-7a3c-45f5-836b-c598a6734094 tempest-CreateVolumesFromImageTest-1806951304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6da2df96-061d-4112-9b53-7e37721aa751" returned: 0 in 0.445s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4d9a0301-6171-4f2b-bdfa-1f77fcede5d0 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-576775b2-df3e-4e47-9def-c575173abb85 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:33 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-2b2886e5-7a3c-45f5-836b-c598a6734094 tempest-CreateVolumesFromImageTest-1806951304 None] Lock "cinder-quobyte-6da2df96-061d-4112-9b53-7e37721aa751" released by "delete_volume" :: held 1.443s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:30:33 devstack sudo[106767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-576775b2-df3e-4e47-9def-c575173abb85 Nov 04 12:30:33 devstack sudo[106767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:33 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-2b2886e5-7a3c-45f5-836b-c598a6734094 tempest-CreateVolumesFromImageTest-1806951304 None] Created reservations ['219e6e37-a941-400c-b582-067dbd841c2e', 'b323fed3-7e7a-4b65-ac0c-aec708e1a8b2', 'd6ba9ce6-4486-45f1-b5c9-17986162f691', '36506abf-c972-4a95-b409-7d028d132e01'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:30:33 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5f1fa9ff-0b48-446c-bbdc-acbbd06501b7 tempest-VolumeImageDependencyTests-694567839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09e5adda-2550-49b3-8d93-eb73d166227f_ww7r9lzrdevstack@QuobyteHD" returned: 1 in 0.404s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5f1fa9ff-0b48-446c-bbdc-acbbd06501b7 tempest-VolumeImageDependencyTests-694567839 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09e5adda-2550-49b3-8d93-eb73d166227f_ww7r9lzrdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 12:30:33 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-5f1fa9ff-0b48-446c-bbdc-acbbd06501b7 tempest-VolumeImageDependencyTests-694567839 None] 09e5adda-2550-49b3-8d93-eb73d166227f was raw, converting to qcow2 {{(pid=87095) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 04 12:30:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5f1fa9ff-0b48-446c-bbdc-acbbd06501b7 tempest-VolumeImageDependencyTests-694567839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_09e5adda-2550-49b3-8d93-eb73d166227f_ww7r9lzrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-65f11fc9-f4f5-4a22-a890-f11aa337f2f7 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:33 devstack sudo[106772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_09e5adda-2550-49b3-8d93-eb73d166227f_ww7r9lzrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-65f11fc9-f4f5-4a22-a890-f11aa337f2f7 Nov 04 12:30:33 devstack sudo[106772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2b2886e5-7a3c-45f5-836b-c598a6734094 tempest-CreateVolumesFromImageTest-1806951304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:30:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2b2886e5-7a3c-45f5-836b-c598a6734094 tempest-CreateVolumesFromImageTest-1806951304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:30:33 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2b2886e5-7a3c-45f5-836b-c598a6734094 tempest-CreateVolumesFromImageTest-1806951304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:30:33 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2b2886e5-7a3c-45f5-836b-c598a6734094 tempest-CreateVolumesFromImageTest-1806951304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:30:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2b2886e5-7a3c-45f5-836b-c598a6734094 tempest-CreateVolumesFromImageTest-1806951304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:30:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2b2886e5-7a3c-45f5-836b-c598a6734094 tempest-CreateVolumesFromImageTest-1806951304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:33 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a7b21314-d1c0-4cb7-b28c-6f9f65b80f3c tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c2ef1e01-a023-431b-a859-fc925c801dd8_uzim918i" returned: 1 in 0.414s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a7b21314-d1c0-4cb7-b28c-6f9f65b80f3c tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c2ef1e01-a023-431b-a859-fc925c801dd8_uzim918i' failed. Not Retrying. {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 12:30:33 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c4c4d9-b7a5-4974-bc0d-9e9d86ad7478]: (4, 'raw') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:30:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a7b21314-d1c0-4cb7-b28c-6f9f65b80f3c tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c2ef1e01-a023-431b-a859-fc925c801dd8_glt6duyodevstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:33 devstack sudo[106776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:30:33 devstack sudo[106776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:33 devstack sudo[106777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c2ef1e01-a023-431b-a859-fc925c801dd8_glt6duyodevstack@QuobyteHD Nov 04 12:30:33 devstack sudo[106777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:33 devstack sudo[106767]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4d9a0301-6171-4f2b-bdfa-1f77fcede5d0 tempest-CreateVolumesFromSnapshotTest-1515403536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-576775b2-df3e-4e47-9def-c575173abb85" returned: 0 in 0.380s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:33 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4d9a0301-6171-4f2b-bdfa-1f77fcede5d0 tempest-CreateVolumesFromSnapshotTest-1515403536 None] <== create_volume: return (1366ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:30:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4d9a0301-6171-4f2b-bdfa-1f77fcede5d0 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.371s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:30:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d05de525-8380-4b49-8ed9-57c3faac0922 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.920s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:30:33 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d05de525-8380-4b49-8ed9-57c3faac0922 tempest-CreateVolumesFromSnapshotTest-1515403536 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:30:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1500876540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6574580a-ea02-4fee-aaf9-4cd633641e72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f2ecbf4c26745aea61e77c646f1ae08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:30:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:30:31Z,use_quota=True,user_id='eb107a11aa25484bbb00b0017ec862ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:30:33 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-d05de525-8380-4b49-8ed9-57c3faac0922 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Creating volume 6574580a-ea02-4fee-aaf9-4cd633641e72 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:30:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d05de525-8380-4b49-8ed9-57c3faac0922 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:30:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d05de525-8380-4b49-8ed9-57c3faac0922 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:30:33 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d05de525-8380-4b49-8ed9-57c3faac0922 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:30:33 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d05de525-8380-4b49-8ed9-57c3faac0922 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:30:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d05de525-8380-4b49-8ed9-57c3faac0922 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:30:33 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d05de525-8380-4b49-8ed9-57c3faac0922 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:30:33 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-d05de525-8380-4b49-8ed9-57c3faac0922 tempest-CreateVolumesFromSnapshotTest-1515403536 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:30:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d05de525-8380-4b49-8ed9-57c3faac0922 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6574580a-ea02-4fee-aaf9-4cd633641e72 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4d9a0301-6171-4f2b-bdfa-1f77fcede5d0 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (457a9594-7ef0-4a70-830b-00f72b1a6bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-576775b2-df3e-4e47-9def-c575173abb85', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:33 devstack sudo[106784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6574580a-ea02-4fee-aaf9-4cd633641e72 1073741824 Nov 04 12:30:33 devstack sudo[106784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4d9a0301-6171-4f2b-bdfa-1f77fcede5d0 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75b02185-889a-4093-8e77-bf6bf0236c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:33 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-4d9a0301-6171-4f2b-bdfa-1f77fcede5d0 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Volume volume-576775b2-df3e-4e47-9def-c575173abb85 (576775b2-df3e-4e47-9def-c575173abb85): created successfully Nov 04 12:30:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4d9a0301-6171-4f2b-bdfa-1f77fcede5d0 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75b02185-889a-4093-8e77-bf6bf0236c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4d9a0301-6171-4f2b-bdfa-1f77fcede5d0 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Flow 'volume_create_manager' (e4648d25-cde1-4a53-aa31-d97d0f401a0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:30:33 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-4d9a0301-6171-4f2b-bdfa-1f77fcede5d0 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Created volume successfully. Nov 04 12:30:33 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-321a5961-b784-40c1-9fab-aa25dcd4e271 tempest-CreateVolumesFromImageTest-1806951304 None] Acquiring lock "cinder-b7a3444f-06e0-4aed-867f-913f1e084a29-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:30:33 devstack sudo[106776]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:33 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-321a5961-b784-40c1-9fab-aa25dcd4e271 tempest-CreateVolumesFromImageTest-1806951304 None] Lock "cinder-b7a3444f-06e0-4aed-867f-913f1e084a29-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:30:33 devstack sudo[106777]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2b2886e5-7a3c-45f5-836b-c598a6734094 tempest-CreateVolumesFromImageTest-1806951304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.430s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:33 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-2b2886e5-7a3c-45f5-836b-c598a6734094 tempest-CreateVolumesFromImageTest-1806951304 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:30:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a7b21314-d1c0-4cb7-b28c-6f9f65b80f3c tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c2ef1e01-a023-431b-a859-fc925c801dd8_glt6duyodevstack@QuobyteHD" returned: 0 in 0.420s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a7b21314-d1c0-4cb7-b28c-6f9f65b80f3c tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c2ef1e01-a023-431b-a859-fc925c801dd8_glt6duyodevstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:33 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-2b2886e5-7a3c-45f5-836b-c598a6734094 tempest-CreateVolumesFromImageTest-1806951304 None] Deleted volume successfully. Nov 04 12:30:33 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-2b2886e5-7a3c-45f5-836b-c598a6734094 tempest-CreateVolumesFromImageTest-1806951304 None] Lock "cinder-6da2df96-061d-4112-9b53-7e37721aa751-delete_volume" released by "delete_volume" :: held 2.442s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:30:33 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-321a5961-b784-40c1-9fab-aa25dcd4e271 tempest-CreateVolumesFromImageTest-1806951304 None] Acquiring lock "cinder-quobyte-b7a3444f-06e0-4aed-867f-913f1e084a29" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:30:33 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-321a5961-b784-40c1-9fab-aa25dcd4e271 tempest-CreateVolumesFromImageTest-1806951304 None] Lock "cinder-quobyte-b7a3444f-06e0-4aed-867f-913f1e084a29" acquired by "delete_volume" :: waited 0.020s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:30:33 devstack sudo[106772]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5f1fa9ff-0b48-446c-bbdc-acbbd06501b7 tempest-VolumeImageDependencyTests-694567839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_09e5adda-2550-49b3-8d93-eb73d166227f_ww7r9lzrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-65f11fc9-f4f5-4a22-a890-f11aa337f2f7" returned: 0 in 0.644s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:33 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-5f1fa9ff-0b48-446c-bbdc-acbbd06501b7 tempest-VolumeImageDependencyTests-694567839 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_09e5adda-2550-49b3-8d93-eb73d166227f_ww7r9lzrdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-65f11fc9-f4f5-4a22-a890-f11aa337f2f7 {{(pid=87095) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 12:30:33 devstack cinder-volume[87095]: INFO cinder.image.image_utils [None req-5f1fa9ff-0b48-446c-bbdc-acbbd06501b7 tempest-VolumeImageDependencyTests-694567839 None] Converted 0.00 MB image at 0.00 MB/s Nov 04 12:30:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5f1fa9ff-0b48-446c-bbdc-acbbd06501b7 tempest-VolumeImageDependencyTests-694567839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-65f11fc9-f4f5-4a22-a890-f11aa337f2f7 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:33 devstack sudo[106791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c2ef1e01-a023-431b-a859-fc925c801dd8_glt6duyodevstack@QuobyteHD Nov 04 12:30:33 devstack sudo[106791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:33 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c69fa7-7922-4a81-ba7d-ae79c544adaa]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:30:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-321a5961-b784-40c1-9fab-aa25dcd4e271 tempest-CreateVolumesFromImageTest-1806951304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b7a3444f-06e0-4aed-867f-913f1e084a29 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:33 devstack sudo[106795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-65f11fc9-f4f5-4a22-a890-f11aa337f2f7 1G Nov 04 12:30:33 devstack sudo[106795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:34 devstack sudo[106798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b7a3444f-06e0-4aed-867f-913f1e084a29 Nov 04 12:30:34 devstack sudo[106798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:34 devstack sudo[106791]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a7b21314-d1c0-4cb7-b28c-6f9f65b80f3c tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c2ef1e01-a023-431b-a859-fc925c801dd8_glt6duyodevstack@QuobyteHD" returned: 1 in 0.407s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a7b21314-d1c0-4cb7-b28c-6f9f65b80f3c tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c2ef1e01-a023-431b-a859-fc925c801dd8_glt6duyodevstack@QuobyteHD' failed. Not Retrying. {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 12:30:34 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-a7b21314-d1c0-4cb7-b28c-6f9f65b80f3c tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] c2ef1e01-a023-431b-a859-fc925c801dd8 was raw, converting to qcow2 {{(pid=87095) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 04 12:30:34 devstack sudo[106784]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a7b21314-d1c0-4cb7-b28c-6f9f65b80f3c tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c2ef1e01-a023-431b-a859-fc925c801dd8_glt6duyodevstack@QuobyteHD /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-20886fcc-1863-4aaa-a99a-32d57266e559 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d05de525-8380-4b49-8ed9-57c3faac0922 tempest-CreateVolumesFromSnapshotTest-1515403536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6574580a-ea02-4fee-aaf9-4cd633641e72 1073741824" returned: 0 in 0.696s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:34 devstack sudo[106806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c2ef1e01-a023-431b-a859-fc925c801dd8_glt6duyodevstack@QuobyteHD /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-20886fcc-1863-4aaa-a99a-32d57266e559 Nov 04 12:30:34 devstack sudo[106806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d05de525-8380-4b49-8ed9-57c3faac0922 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6574580a-ea02-4fee-aaf9-4cd633641e72 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:34 devstack sudo[106809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6574580a-ea02-4fee-aaf9-4cd633641e72 Nov 04 12:30:34 devstack sudo[106809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:34 devstack sudo[106795]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5f1fa9ff-0b48-446c-bbdc-acbbd06501b7 tempest-VolumeImageDependencyTests-694567839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-65f11fc9-f4f5-4a22-a890-f11aa337f2f7 1G" returned: 0 in 0.468s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:34 devstack cinder-volume[87095]: DEBUG cinder.volume.volume_utils [None req-5f1fa9ff-0b48-446c-bbdc-acbbd06501b7 tempest-VolumeImageDependencyTests-694567839 None] Downloaded image 09e5adda-2550-49b3-8d93-eb73d166227f ((None, [{'url': 'file:///opt/stack/data/glance/images/09e5adda-2550-49b3-8d93-eb73d166227f', 'metadata': {}}])) to volume 65f11fc9-f4f5-4a22-a890-f11aa337f2f7 successfully. {{(pid=87095) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 04 12:30:34 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-5f1fa9ff-0b48-446c-bbdc-acbbd06501b7 tempest-VolumeImageDependencyTests-694567839 None] Temporary image 09e5adda-2550-49b3-8d93-eb73d166227f for user 1b604c9af1344a13a00813b43f41d6fb is deleted. {{(pid=87095) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 04 12:30:34 devstack cinder-volume[87095]: DEBUG cinder.volume.volume_utils [None req-5f1fa9ff-0b48-446c-bbdc-acbbd06501b7 tempest-VolumeImageDependencyTests-694567839 None] Marking volume 65f11fc9-f4f5-4a22-a890-f11aa337f2f7 as bootable. {{(pid=87095) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 04 12:30:34 devstack sudo[106798]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-321a5961-b784-40c1-9fab-aa25dcd4e271 tempest-CreateVolumesFromImageTest-1806951304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b7a3444f-06e0-4aed-867f-913f1e084a29" returned: 0 in 0.452s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-321a5961-b784-40c1-9fab-aa25dcd4e271 tempest-CreateVolumesFromImageTest-1806951304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b7a3444f-06e0-4aed-867f-913f1e084a29 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:34 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f1fa9ff-0b48-446c-bbdc-acbbd06501b7 tempest-VolumeImageDependencyTests-694567839 None] Copying metadata from image 09e5adda-2550-49b3-8d93-eb73d166227f to 65f11fc9-f4f5-4a22-a890-f11aa337f2f7. {{(pid=87095) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 04 12:30:34 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f1fa9ff-0b48-446c-bbdc-acbbd06501b7 tempest-VolumeImageDependencyTests-694567839 None] Creating volume glance metadata for volume 65f11fc9-f4f5-4a22-a890-f11aa337f2f7 backed by image 09e5adda-2550-49b3-8d93-eb73d166227f with: {'image_id': '09e5adda-2550-49b3-8d93-eb73d166227f', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '27350da453c1c641f5e6880dfaaef566', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87095) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 04 12:30:34 devstack sudo[106815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b7a3444f-06e0-4aed-867f-913f1e084a29 Nov 04 12:30:34 devstack sudo[106815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5f1fa9ff-0b48-446c-bbdc-acbbd06501b7 tempest-VolumeImageDependencyTests-694567839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (227668c8-7394-4f3a-afbe-52073185fb2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65f11fc9-f4f5-4a22-a890-f11aa337f2f7', 'volume_size': 1, 'image_id': '09e5adda-2550-49b3-8d93-eb73d166227f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/09e5adda-2550-49b3-8d93-eb73d166227f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '27350da453c1c641f5e6880dfaaef566', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd282670ed0a348df8455e012eded36bd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '24b635a42ee547880068c33982bdb3335011c66c3ef7b0ba2b6446da0e6b5dcf6acabd43398bae0666d69deef2d3923e04bbbcc82add4194862697768cd3dd7f', 'id': '09e5adda-2550-49b3-8d93-eb73d166227f', 'created_at': datetime.datetime(2026, 11, 4, 11, 30, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 11, 30, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/09e5adda-2550-49b3-8d93-eb73d166227f/file', 'properties': {}}, 'image_service': }' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5f1fa9ff-0b48-446c-bbdc-acbbd06501b7 tempest-VolumeImageDependencyTests-694567839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09c285dd-c5d6-4d85-ac9c-591d07603107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:34 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-5f1fa9ff-0b48-446c-bbdc-acbbd06501b7 tempest-VolumeImageDependencyTests-694567839 None] Volume volume-65f11fc9-f4f5-4a22-a890-f11aa337f2f7 (65f11fc9-f4f5-4a22-a890-f11aa337f2f7): created successfully Nov 04 12:30:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5f1fa9ff-0b48-446c-bbdc-acbbd06501b7 tempest-VolumeImageDependencyTests-694567839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09c285dd-c5d6-4d85-ac9c-591d07603107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5f1fa9ff-0b48-446c-bbdc-acbbd06501b7 tempest-VolumeImageDependencyTests-694567839 None] Flow 'volume_create_manager' (5556c419-9b35-409a-9c11-3c89378986b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:30:34 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-5f1fa9ff-0b48-446c-bbdc-acbbd06501b7 tempest-VolumeImageDependencyTests-694567839 None] Created volume successfully. Nov 04 12:30:34 devstack sudo[106809]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d05de525-8380-4b49-8ed9-57c3faac0922 tempest-CreateVolumesFromSnapshotTest-1515403536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6574580a-ea02-4fee-aaf9-4cd633641e72" returned: 0 in 0.318s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:34 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d05de525-8380-4b49-8ed9-57c3faac0922 tempest-CreateVolumesFromSnapshotTest-1515403536 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:30:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d05de525-8380-4b49-8ed9-57c3faac0922 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:30:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2e13dc93-5f8b-478e-bea4-9f0de91924a2 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.503s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:30:34 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2e13dc93-5f8b-478e-bea4-9f0de91924a2 tempest-CreateVolumesFromSnapshotTest-1515403536 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:30:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1650376555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=052e559b-0a10-42ed-bfd2-3c8b49ca7f37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f2ecbf4c26745aea61e77c646f1ae08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:30:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:30:32Z,use_quota=True,user_id='eb107a11aa25484bbb00b0017ec862ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:30:34 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-2e13dc93-5f8b-478e-bea4-9f0de91924a2 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Creating volume 052e559b-0a10-42ed-bfd2-3c8b49ca7f37 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:30:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2e13dc93-5f8b-478e-bea4-9f0de91924a2 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:30:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2e13dc93-5f8b-478e-bea4-9f0de91924a2 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:30:34 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2e13dc93-5f8b-478e-bea4-9f0de91924a2 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:30:34 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2e13dc93-5f8b-478e-bea4-9f0de91924a2 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:30:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2e13dc93-5f8b-478e-bea4-9f0de91924a2 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:30:34 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2e13dc93-5f8b-478e-bea4-9f0de91924a2 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:30:34 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-2e13dc93-5f8b-478e-bea4-9f0de91924a2 tempest-CreateVolumesFromSnapshotTest-1515403536 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:30:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2e13dc93-5f8b-478e-bea4-9f0de91924a2 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-052e559b-0a10-42ed-bfd2-3c8b49ca7f37 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d05de525-8380-4b49-8ed9-57c3faac0922 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2d80c18-5eb5-406f-b1e7-04a3bdd85375) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6574580a-ea02-4fee-aaf9-4cd633641e72', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d05de525-8380-4b49-8ed9-57c3faac0922 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9865a9f8-35f1-49ef-a60e-0a82ae8a02fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:34 devstack sudo[106822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-052e559b-0a10-42ed-bfd2-3c8b49ca7f37 1073741824 Nov 04 12:30:34 devstack sudo[106822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:34 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-d05de525-8380-4b49-8ed9-57c3faac0922 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Volume volume-6574580a-ea02-4fee-aaf9-4cd633641e72 (6574580a-ea02-4fee-aaf9-4cd633641e72): created successfully Nov 04 12:30:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d05de525-8380-4b49-8ed9-57c3faac0922 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9865a9f8-35f1-49ef-a60e-0a82ae8a02fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d05de525-8380-4b49-8ed9-57c3faac0922 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Flow 'volume_create_manager' (6c28bc12-d069-472f-8a84-6102a206a279) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:30:34 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-d05de525-8380-4b49-8ed9-57c3faac0922 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Created volume successfully. Nov 04 12:30:34 devstack sudo[106815]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-321a5961-b784-40c1-9fab-aa25dcd4e271 tempest-CreateVolumesFromImageTest-1806951304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-b7a3444f-06e0-4aed-867f-913f1e084a29" returned: 0 in 0.367s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:34 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-321a5961-b784-40c1-9fab-aa25dcd4e271 tempest-CreateVolumesFromImageTest-1806951304 None] Lock "cinder-quobyte-b7a3444f-06e0-4aed-867f-913f1e084a29" released by "delete_volume" :: held 0.908s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:30:34 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-321a5961-b784-40c1-9fab-aa25dcd4e271 tempest-CreateVolumesFromImageTest-1806951304 None] Created reservations ['16f7ec4b-a314-4502-82d7-6613dc39158e', '87a89f3e-968b-4f79-80e3-2e4d98dfc601', '9b99ff18-056d-4f24-92d0-07f2f648e4ef', '8b3a1f6f-f720-4461-8d51-f0d3caf0c233'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:30:34 devstack sudo[106806]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a7b21314-d1c0-4cb7-b28c-6f9f65b80f3c tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c2ef1e01-a023-431b-a859-fc925c801dd8_glt6duyodevstack@QuobyteHD /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-20886fcc-1863-4aaa-a99a-32d57266e559" returned: 0 in 0.682s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:34 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-a7b21314-d1c0-4cb7-b28c-6f9f65b80f3c tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c2ef1e01-a023-431b-a859-fc925c801dd8_glt6duyodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-20886fcc-1863-4aaa-a99a-32d57266e559 {{(pid=87095) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 12:30:34 devstack cinder-volume[87095]: INFO cinder.image.image_utils [None req-a7b21314-d1c0-4cb7-b28c-6f9f65b80f3c tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] Converted 0.00 MB image at 0.00 MB/s Nov 04 12:30:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a7b21314-d1c0-4cb7-b28c-6f9f65b80f3c tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-20886fcc-1863-4aaa-a99a-32d57266e559 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:34 devstack sudo[106828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-20886fcc-1863-4aaa-a99a-32d57266e559 1G Nov 04 12:30:34 devstack sudo[106828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-321a5961-b784-40c1-9fab-aa25dcd4e271 tempest-CreateVolumesFromImageTest-1806951304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:30:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-321a5961-b784-40c1-9fab-aa25dcd4e271 tempest-CreateVolumesFromImageTest-1806951304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:30:34 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-321a5961-b784-40c1-9fab-aa25dcd4e271 tempest-CreateVolumesFromImageTest-1806951304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:30:34 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-321a5961-b784-40c1-9fab-aa25dcd4e271 tempest-CreateVolumesFromImageTest-1806951304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:30:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-321a5961-b784-40c1-9fab-aa25dcd4e271 tempest-CreateVolumesFromImageTest-1806951304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:30:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-321a5961-b784-40c1-9fab-aa25dcd4e271 tempest-CreateVolumesFromImageTest-1806951304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:34 devstack sudo[106832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:30:34 devstack sudo[106832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:35 devstack sudo[106822]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2e13dc93-5f8b-478e-bea4-9f0de91924a2 tempest-CreateVolumesFromSnapshotTest-1515403536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-052e559b-0a10-42ed-bfd2-3c8b49ca7f37 1073741824" returned: 0 in 0.585s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2e13dc93-5f8b-478e-bea4-9f0de91924a2 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-052e559b-0a10-42ed-bfd2-3c8b49ca7f37 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:35 devstack sudo[106832]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-321a5961-b784-40c1-9fab-aa25dcd4e271 tempest-CreateVolumesFromImageTest-1806951304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.304s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:35 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-321a5961-b784-40c1-9fab-aa25dcd4e271 tempest-CreateVolumesFromImageTest-1806951304 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:30:35 devstack sudo[106840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-052e559b-0a10-42ed-bfd2-3c8b49ca7f37 Nov 04 12:30:35 devstack sudo[106840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:35 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-321a5961-b784-40c1-9fab-aa25dcd4e271 tempest-CreateVolumesFromImageTest-1806951304 None] Deleted volume successfully. Nov 04 12:30:35 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-321a5961-b784-40c1-9fab-aa25dcd4e271 tempest-CreateVolumesFromImageTest-1806951304 None] Lock "cinder-b7a3444f-06e0-4aed-867f-913f1e084a29-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:30:35 devstack sudo[106828]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a7b21314-d1c0-4cb7-b28c-6f9f65b80f3c tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-20886fcc-1863-4aaa-a99a-32d57266e559 1G" returned: 0 in 0.427s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:35 devstack cinder-volume[87095]: DEBUG cinder.volume.volume_utils [None req-a7b21314-d1c0-4cb7-b28c-6f9f65b80f3c tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] Downloaded image c2ef1e01-a023-431b-a859-fc925c801dd8 ((None, [{'url': 'file:///opt/stack/data/glance/images/c2ef1e01-a023-431b-a859-fc925c801dd8', 'metadata': {}}])) to volume 20886fcc-1863-4aaa-a99a-32d57266e559 successfully. {{(pid=87095) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 04 12:30:35 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-a7b21314-d1c0-4cb7-b28c-6f9f65b80f3c tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] Temporary image c2ef1e01-a023-431b-a859-fc925c801dd8 for user 90a8f52e11024fd38fbf524653d0de63 is deleted. {{(pid=87095) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 04 12:30:35 devstack cinder-volume[87095]: DEBUG cinder.volume.volume_utils [None req-a7b21314-d1c0-4cb7-b28c-6f9f65b80f3c tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] Marking volume 20886fcc-1863-4aaa-a99a-32d57266e559 as bootable. {{(pid=87095) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 04 12:30:35 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7b21314-d1c0-4cb7-b28c-6f9f65b80f3c tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] Copying metadata from image c2ef1e01-a023-431b-a859-fc925c801dd8 to 20886fcc-1863-4aaa-a99a-32d57266e559. {{(pid=87095) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 04 12:30:35 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7b21314-d1c0-4cb7-b28c-6f9f65b80f3c tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] Creating volume glance metadata for volume 20886fcc-1863-4aaa-a99a-32d57266e559 backed by image c2ef1e01-a023-431b-a859-fc925c801dd8 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'c2ef1e01-a023-431b-a859-fc925c801dd8', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'e652724012bf7386748b8f39b6da270e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87095) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 04 12:30:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a7b21314-d1c0-4cb7-b28c-6f9f65b80f3c tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ea6f41c-45fb-4e99-ad4f-d55a20a2bc5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20886fcc-1863-4aaa-a99a-32d57266e559', 'volume_size': 1, 'image_id': 'c2ef1e01-a023-431b-a859-fc925c801dd8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c2ef1e01-a023-431b-a859-fc925c801dd8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e652724012bf7386748b8f39b6da270e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ddc2d9129e8649d8b839d775c44a35fa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5d62f0fd60a33b4f522b613c76da30d6d72e7837ab5d4b62c43d628f385263c2ffe73acdd2a9efcf7e915d1ac892e54e2b2737083c47db1116b39532234fcc06', 'id': 'c2ef1e01-a023-431b-a859-fc925c801dd8', 'created_at': datetime.datetime(2026, 11, 4, 11, 30, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 11, 30, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c2ef1e01-a023-431b-a859-fc925c801dd8/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a7b21314-d1c0-4cb7-b28c-6f9f65b80f3c tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ddde6ce-0094-4326-ad01-3951b0585af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:35 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-a7b21314-d1c0-4cb7-b28c-6f9f65b80f3c tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] Volume volume-20886fcc-1863-4aaa-a99a-32d57266e559 (20886fcc-1863-4aaa-a99a-32d57266e559): created successfully Nov 04 12:30:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a7b21314-d1c0-4cb7-b28c-6f9f65b80f3c tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ddde6ce-0094-4326-ad01-3951b0585af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a7b21314-d1c0-4cb7-b28c-6f9f65b80f3c tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] Flow 'volume_create_manager' (e2da63fd-952b-444e-99b8-5f8618fb87eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:30:35 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-a7b21314-d1c0-4cb7-b28c-6f9f65b80f3c tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] Created volume successfully. Nov 04 12:30:35 devstack sudo[106840]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2e13dc93-5f8b-478e-bea4-9f0de91924a2 tempest-CreateVolumesFromSnapshotTest-1515403536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-052e559b-0a10-42ed-bfd2-3c8b49ca7f37" returned: 0 in 0.263s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:35 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2e13dc93-5f8b-478e-bea4-9f0de91924a2 tempest-CreateVolumesFromSnapshotTest-1515403536 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:30:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2e13dc93-5f8b-478e-bea4-9f0de91924a2 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:30:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-553e42d3-87d5-41cb-8324-8e264dc8b41f tempest-CreateVolumesFromSnapshotTest-1515403536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.861s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:30:35 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-553e42d3-87d5-41cb-8324-8e264dc8b41f tempest-CreateVolumesFromSnapshotTest-1515403536 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-866609233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e156e44d-8360-4c69-b116-5097aa280726,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f2ecbf4c26745aea61e77c646f1ae08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:30:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:30:32Z,use_quota=True,user_id='eb107a11aa25484bbb00b0017ec862ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:30:35 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-553e42d3-87d5-41cb-8324-8e264dc8b41f tempest-CreateVolumesFromSnapshotTest-1515403536 None] Creating volume e156e44d-8360-4c69-b116-5097aa280726 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:30:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-553e42d3-87d5-41cb-8324-8e264dc8b41f tempest-CreateVolumesFromSnapshotTest-1515403536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:30:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-553e42d3-87d5-41cb-8324-8e264dc8b41f tempest-CreateVolumesFromSnapshotTest-1515403536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:30:35 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-553e42d3-87d5-41cb-8324-8e264dc8b41f tempest-CreateVolumesFromSnapshotTest-1515403536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:30:35 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-553e42d3-87d5-41cb-8324-8e264dc8b41f tempest-CreateVolumesFromSnapshotTest-1515403536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:30:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-553e42d3-87d5-41cb-8324-8e264dc8b41f tempest-CreateVolumesFromSnapshotTest-1515403536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:30:35 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-553e42d3-87d5-41cb-8324-8e264dc8b41f tempest-CreateVolumesFromSnapshotTest-1515403536 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:30:35 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-553e42d3-87d5-41cb-8324-8e264dc8b41f tempest-CreateVolumesFromSnapshotTest-1515403536 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:30:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-553e42d3-87d5-41cb-8324-8e264dc8b41f tempest-CreateVolumesFromSnapshotTest-1515403536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-e156e44d-8360-4c69-b116-5097aa280726 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:35 devstack sudo[106844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-e156e44d-8360-4c69-b116-5097aa280726 1073741824 Nov 04 12:30:35 devstack sudo[106844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2e13dc93-5f8b-478e-bea4-9f0de91924a2 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3ad4ae0-5097-47ce-9d8b-27c29934e0ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-052e559b-0a10-42ed-bfd2-3c8b49ca7f37', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2e13dc93-5f8b-478e-bea4-9f0de91924a2 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f06b6ac4-4add-4b0c-8741-6b0b4ea3686c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:35 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-2e13dc93-5f8b-478e-bea4-9f0de91924a2 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Volume volume-052e559b-0a10-42ed-bfd2-3c8b49ca7f37 (052e559b-0a10-42ed-bfd2-3c8b49ca7f37): created successfully Nov 04 12:30:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2e13dc93-5f8b-478e-bea4-9f0de91924a2 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f06b6ac4-4add-4b0c-8741-6b0b4ea3686c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2e13dc93-5f8b-478e-bea4-9f0de91924a2 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Flow 'volume_create_manager' (7ac5c505-b24a-4014-8987-e94fb986507a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:30:35 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-2e13dc93-5f8b-478e-bea4-9f0de91924a2 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Created volume successfully. Nov 04 12:30:35 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-be77a633-9f44-447f-a534-a3e93b8bad1e tempest-VolumeImageDependencyTests-694567839 None] Acquiring lock "cinder-65f11fc9-f4f5-4a22-a890-f11aa337f2f7-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:30:35 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-be77a633-9f44-447f-a534-a3e93b8bad1e tempest-VolumeImageDependencyTests-694567839 None] Lock "cinder-65f11fc9-f4f5-4a22-a890-f11aa337f2f7-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:30:35 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-be77a633-9f44-447f-a534-a3e93b8bad1e tempest-VolumeImageDependencyTests-694567839 None] Acquiring lock "cinder-quobyte-65f11fc9-f4f5-4a22-a890-f11aa337f2f7" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:30:35 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-be77a633-9f44-447f-a534-a3e93b8bad1e tempest-VolumeImageDependencyTests-694567839 None] Lock "cinder-quobyte-65f11fc9-f4f5-4a22-a890-f11aa337f2f7" acquired by "delete_volume" :: waited 0.026s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:30:35 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[611e4097-fdff-4692-b4f2-9bf13f214f6d]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:30:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-be77a633-9f44-447f-a534-a3e93b8bad1e tempest-VolumeImageDependencyTests-694567839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-65f11fc9-f4f5-4a22-a890-f11aa337f2f7 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:36 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-2af3d8a2-cfc2-42bb-866c-abc6f05b3965 tempest-CreateVolumesFromImageTest-1806951304 None] Acquiring lock "cinder-773e1eab-7f28-46fd-9242-c08b524701ba-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:30:36 devstack sudo[106844]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:36 devstack sudo[106850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-65f11fc9-f4f5-4a22-a890-f11aa337f2f7 Nov 04 12:30:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-553e42d3-87d5-41cb-8324-8e264dc8b41f tempest-CreateVolumesFromSnapshotTest-1515403536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-e156e44d-8360-4c69-b116-5097aa280726 1073741824" returned: 0 in 0.531s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:36 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-2af3d8a2-cfc2-42bb-866c-abc6f05b3965 tempest-CreateVolumesFromImageTest-1806951304 None] Lock "cinder-773e1eab-7f28-46fd-9242-c08b524701ba-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:30:36 devstack sudo[106850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-553e42d3-87d5-41cb-8324-8e264dc8b41f tempest-CreateVolumesFromSnapshotTest-1515403536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-e156e44d-8360-4c69-b116-5097aa280726 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:36 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-2af3d8a2-cfc2-42bb-866c-abc6f05b3965 tempest-CreateVolumesFromImageTest-1806951304 None] Acquiring lock "cinder-quobyte-773e1eab-7f28-46fd-9242-c08b524701ba" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:30:36 devstack sudo[106852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-e156e44d-8360-4c69-b116-5097aa280726 Nov 04 12:30:36 devstack sudo[106852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:36 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-2af3d8a2-cfc2-42bb-866c-abc6f05b3965 tempest-CreateVolumesFromImageTest-1806951304 None] Lock "cinder-quobyte-773e1eab-7f28-46fd-9242-c08b524701ba" acquired by "delete_volume" :: waited 0.019s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:30:36 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd5974e-5e84-46e2-856c-1df3a416c0bc]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:30:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2af3d8a2-cfc2-42bb-866c-abc6f05b3965 tempest-CreateVolumesFromImageTest-1806951304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-773e1eab-7f28-46fd-9242-c08b524701ba {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:36 devstack sudo[106854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-773e1eab-7f28-46fd-9242-c08b524701ba Nov 04 12:30:36 devstack sudo[106854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:36 devstack sudo[106850]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-be77a633-9f44-447f-a534-a3e93b8bad1e tempest-VolumeImageDependencyTests-694567839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-65f11fc9-f4f5-4a22-a890-f11aa337f2f7" returned: 0 in 0.447s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-be77a633-9f44-447f-a534-a3e93b8bad1e tempest-VolumeImageDependencyTests-694567839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-65f11fc9-f4f5-4a22-a890-f11aa337f2f7 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:36 devstack sudo[106852]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-553e42d3-87d5-41cb-8324-8e264dc8b41f tempest-CreateVolumesFromSnapshotTest-1515403536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-e156e44d-8360-4c69-b116-5097aa280726" returned: 0 in 0.283s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:36 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-553e42d3-87d5-41cb-8324-8e264dc8b41f tempest-CreateVolumesFromSnapshotTest-1515403536 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:30:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-553e42d3-87d5-41cb-8324-8e264dc8b41f tempest-CreateVolumesFromSnapshotTest-1515403536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:30:36 devstack sudo[106861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-65f11fc9-f4f5-4a22-a890-f11aa337f2f7 Nov 04 12:30:36 devstack sudo[106861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b926dc71-7653-4ddf-883d-60dd899381b9 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.263s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:30:36 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b926dc71-7653-4ddf-883d-60dd899381b9 tempest-CreateVolumesFromSnapshotTest-1515403536 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:30:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-529028090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c701985-c529-48c9-8ff8-6015391d6b34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f2ecbf4c26745aea61e77c646f1ae08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:30:33Z,use_quota=True,user_id='eb107a11aa25484bbb00b0017ec862ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:30:36 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-b926dc71-7653-4ddf-883d-60dd899381b9 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Creating volume 9c701985-c529-48c9-8ff8-6015391d6b34 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:30:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b926dc71-7653-4ddf-883d-60dd899381b9 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:30:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b926dc71-7653-4ddf-883d-60dd899381b9 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:30:36 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b926dc71-7653-4ddf-883d-60dd899381b9 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:30:36 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b926dc71-7653-4ddf-883d-60dd899381b9 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:30:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b926dc71-7653-4ddf-883d-60dd899381b9 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:30:36 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b926dc71-7653-4ddf-883d-60dd899381b9 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:30:36 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-b926dc71-7653-4ddf-883d-60dd899381b9 tempest-CreateVolumesFromSnapshotTest-1515403536 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:30:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b926dc71-7653-4ddf-883d-60dd899381b9 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9c701985-c529-48c9-8ff8-6015391d6b34 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-553e42d3-87d5-41cb-8324-8e264dc8b41f tempest-CreateVolumesFromSnapshotTest-1515403536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc89656f-68bd-48d0-bfdb-7eb138ae79e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e156e44d-8360-4c69-b116-5097aa280726', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-553e42d3-87d5-41cb-8324-8e264dc8b41f tempest-CreateVolumesFromSnapshotTest-1515403536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0755dea8-a40a-4db0-aed7-ac57e1271fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:36 devstack sudo[106863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9c701985-c529-48c9-8ff8-6015391d6b34 1073741824 Nov 04 12:30:36 devstack sudo[106863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:36 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-553e42d3-87d5-41cb-8324-8e264dc8b41f tempest-CreateVolumesFromSnapshotTest-1515403536 None] Volume volume-e156e44d-8360-4c69-b116-5097aa280726 (e156e44d-8360-4c69-b116-5097aa280726): created successfully Nov 04 12:30:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-553e42d3-87d5-41cb-8324-8e264dc8b41f tempest-CreateVolumesFromSnapshotTest-1515403536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0755dea8-a40a-4db0-aed7-ac57e1271fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-553e42d3-87d5-41cb-8324-8e264dc8b41f tempest-CreateVolumesFromSnapshotTest-1515403536 None] Flow 'volume_create_manager' (6c2d1cd7-8b6c-46b4-af8a-700d50399a21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:30:36 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-553e42d3-87d5-41cb-8324-8e264dc8b41f tempest-CreateVolumesFromSnapshotTest-1515403536 None] Created volume successfully. Nov 04 12:30:36 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6bc2f926-c5e5-4910-b0b4-6748b6199367 tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] Acquiring lock "cinder-20886fcc-1863-4aaa-a99a-32d57266e559-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:30:36 devstack sudo[106861]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-be77a633-9f44-447f-a534-a3e93b8bad1e tempest-VolumeImageDependencyTests-694567839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-65f11fc9-f4f5-4a22-a890-f11aa337f2f7" returned: 0 in 0.308s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:36 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6bc2f926-c5e5-4910-b0b4-6748b6199367 tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] Lock "cinder-20886fcc-1863-4aaa-a99a-32d57266e559-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:30:36 devstack sudo[106854]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:36 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-be77a633-9f44-447f-a534-a3e93b8bad1e tempest-VolumeImageDependencyTests-694567839 None] Lock "cinder-quobyte-65f11fc9-f4f5-4a22-a890-f11aa337f2f7" released by "delete_volume" :: held 0.820s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:30:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2af3d8a2-cfc2-42bb-866c-abc6f05b3965 tempest-CreateVolumesFromImageTest-1806951304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-773e1eab-7f28-46fd-9242-c08b524701ba" returned: 0 in 0.525s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2af3d8a2-cfc2-42bb-866c-abc6f05b3965 tempest-CreateVolumesFromImageTest-1806951304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-773e1eab-7f28-46fd-9242-c08b524701ba {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:36 devstack sudo[106873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-773e1eab-7f28-46fd-9242-c08b524701ba Nov 04 12:30:36 devstack sudo[106873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:36 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6bc2f926-c5e5-4910-b0b4-6748b6199367 tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] Acquiring lock "cinder-quobyte-20886fcc-1863-4aaa-a99a-32d57266e559" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:30:36 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6bc2f926-c5e5-4910-b0b4-6748b6199367 tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] Lock "cinder-quobyte-20886fcc-1863-4aaa-a99a-32d57266e559" acquired by "delete_volume" :: waited 0.023s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:30:36 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b7ea008-1729-4e11-a2e5-d4d28571077e]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:30:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6bc2f926-c5e5-4910-b0b4-6748b6199367 tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-20886fcc-1863-4aaa-a99a-32d57266e559 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:36 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-be77a633-9f44-447f-a534-a3e93b8bad1e tempest-VolumeImageDependencyTests-694567839 None] Created reservations ['29ca850a-78d9-4665-84c8-b9cec05f399f', '33994bed-5b1e-4f36-a791-ac81614df7d1', '349f9c02-b068-4a3e-8b11-9c0f947e87f4', '7d4ef266-124c-4e1e-aefd-1897f3aa058e'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:30:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-be77a633-9f44-447f-a534-a3e93b8bad1e tempest-VolumeImageDependencyTests-694567839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:30:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-be77a633-9f44-447f-a534-a3e93b8bad1e tempest-VolumeImageDependencyTests-694567839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:30:36 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-be77a633-9f44-447f-a534-a3e93b8bad1e tempest-VolumeImageDependencyTests-694567839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:30:36 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-be77a633-9f44-447f-a534-a3e93b8bad1e tempest-VolumeImageDependencyTests-694567839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:30:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-be77a633-9f44-447f-a534-a3e93b8bad1e tempest-VolumeImageDependencyTests-694567839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:30:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-be77a633-9f44-447f-a534-a3e93b8bad1e tempest-VolumeImageDependencyTests-694567839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:36 devstack sudo[106878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:30:36 devstack sudo[106878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:36 devstack sudo[106873]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2af3d8a2-cfc2-42bb-866c-abc6f05b3965 tempest-CreateVolumesFromImageTest-1806951304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-773e1eab-7f28-46fd-9242-c08b524701ba" returned: 0 in 0.278s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:36 devstack sudo[106863]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:36 devstack sudo[106876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-20886fcc-1863-4aaa-a99a-32d57266e559 Nov 04 12:30:36 devstack sudo[106876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b926dc71-7653-4ddf-883d-60dd899381b9 tempest-CreateVolumesFromSnapshotTest-1515403536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9c701985-c529-48c9-8ff8-6015391d6b34 1073741824" returned: 0 in 0.605s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:37 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-2af3d8a2-cfc2-42bb-866c-abc6f05b3965 tempest-CreateVolumesFromImageTest-1806951304 None] Lock "cinder-quobyte-773e1eab-7f28-46fd-9242-c08b524701ba" released by "delete_volume" :: held 0.873s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:30:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b926dc71-7653-4ddf-883d-60dd899381b9 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9c701985-c529-48c9-8ff8-6015391d6b34 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:37 devstack sudo[106881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9c701985-c529-48c9-8ff8-6015391d6b34 Nov 04 12:30:37 devstack sudo[106881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:37 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-2af3d8a2-cfc2-42bb-866c-abc6f05b3965 tempest-CreateVolumesFromImageTest-1806951304 None] Created reservations ['f2f1e56e-36de-4ff7-b295-a7b4b4824674', '4ca17f54-2b63-4315-93e8-eb95115a0e7b', '9c2d12bc-5e66-4878-80ae-dcb82ad1b796', '4e150a9e-f053-4b63-8cb6-1ac549ec4c1c'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:30:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2af3d8a2-cfc2-42bb-866c-abc6f05b3965 tempest-CreateVolumesFromImageTest-1806951304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:30:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2af3d8a2-cfc2-42bb-866c-abc6f05b3965 tempest-CreateVolumesFromImageTest-1806951304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:30:37 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2af3d8a2-cfc2-42bb-866c-abc6f05b3965 tempest-CreateVolumesFromImageTest-1806951304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:30:37 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2af3d8a2-cfc2-42bb-866c-abc6f05b3965 tempest-CreateVolumesFromImageTest-1806951304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:30:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2af3d8a2-cfc2-42bb-866c-abc6f05b3965 tempest-CreateVolumesFromImageTest-1806951304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:30:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2af3d8a2-cfc2-42bb-866c-abc6f05b3965 tempest-CreateVolumesFromImageTest-1806951304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:37 devstack sudo[106878]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-be77a633-9f44-447f-a534-a3e93b8bad1e tempest-VolumeImageDependencyTests-694567839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.378s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:37 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-be77a633-9f44-447f-a534-a3e93b8bad1e tempest-VolumeImageDependencyTests-694567839 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:30:37 devstack sudo[106886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:30:37 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:37 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-be77a633-9f44-447f-a534-a3e93b8bad1e tempest-VolumeImageDependencyTests-694567839 None] Deleted volume successfully. Nov 04 12:30:37 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-be77a633-9f44-447f-a534-a3e93b8bad1e tempest-VolumeImageDependencyTests-694567839 None] Lock "cinder-65f11fc9-f4f5-4a22-a890-f11aa337f2f7-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:30:37 devstack sudo[106876]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6bc2f926-c5e5-4910-b0b4-6748b6199367 tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-20886fcc-1863-4aaa-a99a-32d57266e559" returned: 0 in 0.579s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6bc2f926-c5e5-4910-b0b4-6748b6199367 tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-20886fcc-1863-4aaa-a99a-32d57266e559 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:37 devstack sudo[106889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-20886fcc-1863-4aaa-a99a-32d57266e559 Nov 04 12:30:37 devstack sudo[106889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:37 devstack sudo[106881]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b926dc71-7653-4ddf-883d-60dd899381b9 tempest-CreateVolumesFromSnapshotTest-1515403536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9c701985-c529-48c9-8ff8-6015391d6b34" returned: 0 in 0.393s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:37 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b926dc71-7653-4ddf-883d-60dd899381b9 tempest-CreateVolumesFromSnapshotTest-1515403536 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:30:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b926dc71-7653-4ddf-883d-60dd899381b9 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:30:37 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b926dc71-7653-4ddf-883d-60dd899381b9 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c7b1da3-56fd-47ee-8aa1-b6e73e878445) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c701985-c529-48c9-8ff8-6015391d6b34', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:37 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b926dc71-7653-4ddf-883d-60dd899381b9 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03fa341c-5b1c-410f-b674-a133e29cd86a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:37 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-b926dc71-7653-4ddf-883d-60dd899381b9 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Volume volume-9c701985-c529-48c9-8ff8-6015391d6b34 (9c701985-c529-48c9-8ff8-6015391d6b34): created successfully Nov 04 12:30:37 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b926dc71-7653-4ddf-883d-60dd899381b9 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03fa341c-5b1c-410f-b674-a133e29cd86a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:37 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b926dc71-7653-4ddf-883d-60dd899381b9 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Flow 'volume_create_manager' (4a1c6dbe-5bdf-403c-9f95-a80210ede594) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:30:37 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-b926dc71-7653-4ddf-883d-60dd899381b9 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Created volume successfully. Nov 04 12:30:37 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2af3d8a2-cfc2-42bb-866c-abc6f05b3965 tempest-CreateVolumesFromImageTest-1806951304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.359s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:37 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-2af3d8a2-cfc2-42bb-866c-abc6f05b3965 tempest-CreateVolumesFromImageTest-1806951304 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:30:37 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-2af3d8a2-cfc2-42bb-866c-abc6f05b3965 tempest-CreateVolumesFromImageTest-1806951304 None] Deleted volume successfully. Nov 04 12:30:37 devstack sudo[106889]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6bc2f926-c5e5-4910-b0b4-6748b6199367 tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-20886fcc-1863-4aaa-a99a-32d57266e559" returned: 0 in 0.300s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:37 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6bc2f926-c5e5-4910-b0b4-6748b6199367 tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] Lock "cinder-quobyte-20886fcc-1863-4aaa-a99a-32d57266e559" released by "delete_volume" :: held 0.932s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:30:37 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-2af3d8a2-cfc2-42bb-866c-abc6f05b3965 tempest-CreateVolumesFromImageTest-1806951304 None] Lock "cinder-773e1eab-7f28-46fd-9242-c08b524701ba-delete_volume" released by "delete_volume" :: held 1.704s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:30:37 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-6bc2f926-c5e5-4910-b0b4-6748b6199367 tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] Created reservations ['869cbd04-0cee-4778-8e40-c6c444d7ac2b', '50842941-f1de-402f-bc18-8a637e93eba5', '00b1b3c3-12e7-4f53-84d1-4636e8aa226e', '25ea533f-1d28-4992-bcf1-e126cdb5233f'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:30:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6bc2f926-c5e5-4910-b0b4-6748b6199367 tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:30:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6bc2f926-c5e5-4910-b0b4-6748b6199367 tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:30:37 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6bc2f926-c5e5-4910-b0b4-6748b6199367 tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:30:37 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6bc2f926-c5e5-4910-b0b4-6748b6199367 tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:30:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6bc2f926-c5e5-4910-b0b4-6748b6199367 tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:30:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6bc2f926-c5e5-4910-b0b4-6748b6199367 tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:37 devstack sudo[106894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:30:37 devstack sudo[106894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:38 devstack sudo[106894]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6bc2f926-c5e5-4910-b0b4-6748b6199367 tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.274s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:38 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-6bc2f926-c5e5-4910-b0b4-6748b6199367 tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:30:38 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-6bc2f926-c5e5-4910-b0b4-6748b6199367 tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] Deleted volume successfully. Nov 04 12:30:38 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6bc2f926-c5e5-4910-b0b4-6748b6199367 tempest-VolumeAndVolumeTypeFromImageTest-779759304 None] Lock "cinder-20886fcc-1863-4aaa-a99a-32d57266e559-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:30:38 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-80d11033-9b88-47f0-970f-340ea3fc97e0 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Acquiring lock "cinder-9c701985-c529-48c9-8ff8-6015391d6b34-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:30:38 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-80d11033-9b88-47f0-970f-340ea3fc97e0 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Lock "cinder-9c701985-c529-48c9-8ff8-6015391d6b34-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:30:38 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-80d11033-9b88-47f0-970f-340ea3fc97e0 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Acquiring lock "cinder-quobyte-9c701985-c529-48c9-8ff8-6015391d6b34" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:30:38 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-80d11033-9b88-47f0-970f-340ea3fc97e0 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Lock "cinder-quobyte-9c701985-c529-48c9-8ff8-6015391d6b34" acquired by "delete_volume" :: waited 0.024s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:30:38 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bae28c9-ea2f-4736-bf63-83e4baa5a87c]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:30:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-80d11033-9b88-47f0-970f-340ea3fc97e0 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9c701985-c529-48c9-8ff8-6015391d6b34 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:38 devstack sudo[106898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9c701985-c529-48c9-8ff8-6015391d6b34 Nov 04 12:30:38 devstack sudo[106898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:39 devstack sudo[106898]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-80d11033-9b88-47f0-970f-340ea3fc97e0 tempest-CreateVolumesFromSnapshotTest-1515403536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9c701985-c529-48c9-8ff8-6015391d6b34" returned: 0 in 0.573s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-80d11033-9b88-47f0-970f-340ea3fc97e0 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9c701985-c529-48c9-8ff8-6015391d6b34 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:39 devstack sudo[106903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9c701985-c529-48c9-8ff8-6015391d6b34 Nov 04 12:30:39 devstack sudo[106903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:39 devstack sudo[106903]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-80d11033-9b88-47f0-970f-340ea3fc97e0 tempest-CreateVolumesFromSnapshotTest-1515403536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9c701985-c529-48c9-8ff8-6015391d6b34" returned: 0 in 0.329s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:39 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-80d11033-9b88-47f0-970f-340ea3fc97e0 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Lock "cinder-quobyte-9c701985-c529-48c9-8ff8-6015391d6b34" released by "delete_volume" :: held 0.978s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:30:39 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-80d11033-9b88-47f0-970f-340ea3fc97e0 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Created reservations ['dcbf8037-6585-4a4c-86b8-fccaa10fff49', '9aae638a-cc54-415c-b73f-c53e685262b9', '6bfa395f-8acc-4540-9f43-5fed4686dbb7', 'f0b17a85-7556-4f23-9731-d56f23640e45'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:30:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-80d11033-9b88-47f0-970f-340ea3fc97e0 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:30:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-80d11033-9b88-47f0-970f-340ea3fc97e0 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:30:39 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-80d11033-9b88-47f0-970f-340ea3fc97e0 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:30:39 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-80d11033-9b88-47f0-970f-340ea3fc97e0 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:30:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-80d11033-9b88-47f0-970f-340ea3fc97e0 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:30:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-80d11033-9b88-47f0-970f-340ea3fc97e0 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:40 devstack sudo[106906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:30:40 devstack sudo[106906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:40 devstack sudo[106906]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-80d11033-9b88-47f0-970f-340ea3fc97e0 tempest-CreateVolumesFromSnapshotTest-1515403536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.284s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:40 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-80d11033-9b88-47f0-970f-340ea3fc97e0 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:30:40 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-80d11033-9b88-47f0-970f-340ea3fc97e0 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Deleted volume successfully. Nov 04 12:30:40 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-80d11033-9b88-47f0-970f-340ea3fc97e0 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Lock "cinder-9c701985-c529-48c9-8ff8-6015391d6b34-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:30:41 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-5985dddc-047b-4c91-8aff-b42328859764 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Acquiring lock "cinder-e156e44d-8360-4c69-b116-5097aa280726-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:30:41 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-5985dddc-047b-4c91-8aff-b42328859764 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Lock "cinder-e156e44d-8360-4c69-b116-5097aa280726-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:30:41 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-5985dddc-047b-4c91-8aff-b42328859764 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Acquiring lock "cinder-quobyte-e156e44d-8360-4c69-b116-5097aa280726" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:30:41 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-5985dddc-047b-4c91-8aff-b42328859764 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Lock "cinder-quobyte-e156e44d-8360-4c69-b116-5097aa280726" acquired by "delete_volume" :: waited 0.017s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:30:41 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d875d00c-9d26-413d-9b0b-7bf512448c21]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:30:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5985dddc-047b-4c91-8aff-b42328859764 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-e156e44d-8360-4c69-b116-5097aa280726 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:41 devstack sudo[106909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-e156e44d-8360-4c69-b116-5097aa280726 Nov 04 12:30:41 devstack sudo[106909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:41 devstack sudo[106909]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5985dddc-047b-4c91-8aff-b42328859764 tempest-CreateVolumesFromSnapshotTest-1515403536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-e156e44d-8360-4c69-b116-5097aa280726" returned: 0 in 0.452s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5985dddc-047b-4c91-8aff-b42328859764 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-e156e44d-8360-4c69-b116-5097aa280726 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:41 devstack sudo[106915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-e156e44d-8360-4c69-b116-5097aa280726 Nov 04 12:30:41 devstack sudo[106915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:41 devstack sudo[106915]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5985dddc-047b-4c91-8aff-b42328859764 tempest-CreateVolumesFromSnapshotTest-1515403536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-e156e44d-8360-4c69-b116-5097aa280726" returned: 0 in 0.305s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:41 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-5985dddc-047b-4c91-8aff-b42328859764 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Lock "cinder-quobyte-e156e44d-8360-4c69-b116-5097aa280726" released by "delete_volume" :: held 0.828s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:30:42 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-5985dddc-047b-4c91-8aff-b42328859764 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Created reservations ['82935dd9-26b6-4893-854f-fda443f2b0f8', '5a6d5df6-78e4-4611-b465-0c35e09035bb', 'c598545c-6a48-48fd-8dbe-f355f182a386', '73442c57-c3ea-4881-aee0-96b0db89259b'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:30:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5985dddc-047b-4c91-8aff-b42328859764 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:30:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5985dddc-047b-4c91-8aff-b42328859764 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:30:42 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-5985dddc-047b-4c91-8aff-b42328859764 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:30:42 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-5985dddc-047b-4c91-8aff-b42328859764 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:30:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5985dddc-047b-4c91-8aff-b42328859764 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:30:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5985dddc-047b-4c91-8aff-b42328859764 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:42 devstack sudo[106918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:30:42 devstack sudo[106918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:42 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a19a7a18-ab62-47a1-80a9-c6de2a43a2bd tempest-CreateVolumesFromSnapshotTest-1515403536 None] Acquiring lock "cinder-052e559b-0a10-42ed-bfd2-3c8b49ca7f37-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:30:42 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a19a7a18-ab62-47a1-80a9-c6de2a43a2bd tempest-CreateVolumesFromSnapshotTest-1515403536 None] Lock "cinder-052e559b-0a10-42ed-bfd2-3c8b49ca7f37-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:30:42 devstack sudo[106918]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:42 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a19a7a18-ab62-47a1-80a9-c6de2a43a2bd tempest-CreateVolumesFromSnapshotTest-1515403536 None] Acquiring lock "cinder-quobyte-052e559b-0a10-42ed-bfd2-3c8b49ca7f37" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:30:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5985dddc-047b-4c91-8aff-b42328859764 tempest-CreateVolumesFromSnapshotTest-1515403536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.420s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:42 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-5985dddc-047b-4c91-8aff-b42328859764 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:30:42 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-5985dddc-047b-4c91-8aff-b42328859764 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Deleted volume successfully. Nov 04 12:30:42 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-b09fc912-793d-413e-b9d2-87701dd1091f tempest-ProjectMemberTests-1539753999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:30:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b09fc912-793d-413e-b9d2-87701dd1091f tempest-ProjectMemberTests-1539753999 None] Flow 'volume_create_manager' (d480624b-7749-41a1-802f-fe5c327fab3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:30:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b09fc912-793d-413e-b9d2-87701dd1091f tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f922ba81-bff9-43ec-b695-302385719ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:42 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a19a7a18-ab62-47a1-80a9-c6de2a43a2bd tempest-CreateVolumesFromSnapshotTest-1515403536 None] Lock "cinder-quobyte-052e559b-0a10-42ed-bfd2-3c8b49ca7f37" acquired by "delete_volume" :: waited 0.073s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:30:42 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c7dadc4-1417-4f29-adb2-a8316ef14751]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:30:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a19a7a18-ab62-47a1-80a9-c6de2a43a2bd tempest-CreateVolumesFromSnapshotTest-1515403536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-052e559b-0a10-42ed-bfd2-3c8b49ca7f37 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:42 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-5985dddc-047b-4c91-8aff-b42328859764 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Lock "cinder-e156e44d-8360-4c69-b116-5097aa280726-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:30:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b09fc912-793d-413e-b9d2-87701dd1091f tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f922ba81-bff9-43ec-b695-302385719ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:30:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2141296508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aecec0f-0dfe-4b9a-b059-7bce61824c62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cb67397f4d04f049564f5d284f139d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:30:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:30:42Z,use_quota=True,user_id='091b86592c99419b9c07a685e7933341',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b09fc912-793d-413e-b9d2-87701dd1091f tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef2091b8-1409-4450-8973-1fd06957291c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b09fc912-793d-413e-b9d2-87701dd1091f tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef2091b8-1409-4450-8973-1fd06957291c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b09fc912-793d-413e-b9d2-87701dd1091f tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ded86734-6b82-475a-b0f9-99e0db891694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b09fc912-793d-413e-b9d2-87701dd1091f tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ded86734-6b82-475a-b0f9-99e0db891694) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1aecec0f-0dfe-4b9a-b059-7bce61824c62', 'volume_name': 'volume-1aecec0f-0dfe-4b9a-b059-7bce61824c62', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b09fc912-793d-413e-b9d2-87701dd1091f tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f738e01-65ad-4762-8446-7432ec8fb8fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b09fc912-793d-413e-b9d2-87701dd1091f tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f738e01-65ad-4762-8446-7432ec8fb8fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b09fc912-793d-413e-b9d2-87701dd1091f tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0df659f7-4ae6-4c20-8ce8-923652da8a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:42 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-b09fc912-793d-413e-b9d2-87701dd1091f tempest-ProjectMemberTests-1539753999 None] Volume 1aecec0f-0dfe-4b9a-b059-7bce61824c62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1aecec0f-0dfe-4b9a-b059-7bce61824c62', 'volume_size': 1} Nov 04 12:30:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b09fc912-793d-413e-b9d2-87701dd1091f tempest-ProjectMemberTests-1539753999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:30:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b09fc912-793d-413e-b9d2-87701dd1091f tempest-ProjectMemberTests-1539753999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:30:42 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b09fc912-793d-413e-b9d2-87701dd1091f tempest-ProjectMemberTests-1539753999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:30:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2141296508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aecec0f-0dfe-4b9a-b059-7bce61824c62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cb67397f4d04f049564f5d284f139d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:30:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:30:42Z,use_quota=True,user_id='091b86592c99419b9c07a685e7933341',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:30:42 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-b09fc912-793d-413e-b9d2-87701dd1091f tempest-ProjectMemberTests-1539753999 None] Creating volume 1aecec0f-0dfe-4b9a-b059-7bce61824c62 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:30:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b09fc912-793d-413e-b9d2-87701dd1091f tempest-ProjectMemberTests-1539753999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:30:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b09fc912-793d-413e-b9d2-87701dd1091f tempest-ProjectMemberTests-1539753999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:30:42 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b09fc912-793d-413e-b9d2-87701dd1091f tempest-ProjectMemberTests-1539753999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:30:42 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b09fc912-793d-413e-b9d2-87701dd1091f tempest-ProjectMemberTests-1539753999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:30:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b09fc912-793d-413e-b9d2-87701dd1091f tempest-ProjectMemberTests-1539753999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:30:42 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b09fc912-793d-413e-b9d2-87701dd1091f tempest-ProjectMemberTests-1539753999 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:30:42 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-b09fc912-793d-413e-b9d2-87701dd1091f tempest-ProjectMemberTests-1539753999 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:30:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b09fc912-793d-413e-b9d2-87701dd1091f tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1aecec0f-0dfe-4b9a-b059-7bce61824c62 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:42 devstack sudo[106921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-052e559b-0a10-42ed-bfd2-3c8b49ca7f37 Nov 04 12:30:42 devstack sudo[106921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:42 devstack sudo[106922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1aecec0f-0dfe-4b9a-b059-7bce61824c62 1073741824 Nov 04 12:30:42 devstack sudo[106922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:42 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4b6a6b1-beb3-4d36-b60a-3453d04ad624 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:30:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d4b6a6b1-beb3-4d36-b60a-3453d04ad624 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Flow 'volume_create_manager' (b730dd73-9a82-43a5-b2e0-1d00ba4eea54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:30:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d4b6a6b1-beb3-4d36-b60a-3453d04ad624 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a338b9ce-dab1-45df-948f-bb9f8b86863f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d4b6a6b1-beb3-4d36-b60a-3453d04ad624 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a338b9ce-dab1-45df-948f-bb9f8b86863f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:30:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1975076233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78a9d6d1-06cb-4df9-bf05-75e3337f5e4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0adb9e5356a342da8acaeec2df63cd9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:30:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:30:43Z,use_quota=True,user_id='31c497d042bd4fa7acaddd962d6b6e1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d4b6a6b1-beb3-4d36-b60a-3453d04ad624 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd22e037-20b2-45c0-bc6b-b166c7e43427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d4b6a6b1-beb3-4d36-b60a-3453d04ad624 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd22e037-20b2-45c0-bc6b-b166c7e43427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d4b6a6b1-beb3-4d36-b60a-3453d04ad624 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03539d16-8aa6-424e-9a62-1270470156df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d4b6a6b1-beb3-4d36-b60a-3453d04ad624 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03539d16-8aa6-424e-9a62-1270470156df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78a9d6d1-06cb-4df9-bf05-75e3337f5e4c', 'volume_name': 'volume-78a9d6d1-06cb-4df9-bf05-75e3337f5e4c', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d4b6a6b1-beb3-4d36-b60a-3453d04ad624 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9d5ad3c-85d1-4748-b719-866a23a88b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d4b6a6b1-beb3-4d36-b60a-3453d04ad624 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9d5ad3c-85d1-4748-b719-866a23a88b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d4b6a6b1-beb3-4d36-b60a-3453d04ad624 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc36a3e2-361b-42aa-9e95-63f1f469c15e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:42 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-d4b6a6b1-beb3-4d36-b60a-3453d04ad624 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Volume 78a9d6d1-06cb-4df9-bf05-75e3337f5e4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78a9d6d1-06cb-4df9-bf05-75e3337f5e4c', 'volume_size': 1} Nov 04 12:30:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d4b6a6b1-beb3-4d36-b60a-3453d04ad624 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:30:43 devstack sudo[106921]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a19a7a18-ab62-47a1-80a9-c6de2a43a2bd tempest-CreateVolumesFromSnapshotTest-1515403536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-052e559b-0a10-42ed-bfd2-3c8b49ca7f37" returned: 0 in 0.476s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a19a7a18-ab62-47a1-80a9-c6de2a43a2bd tempest-CreateVolumesFromSnapshotTest-1515403536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-052e559b-0a10-42ed-bfd2-3c8b49ca7f37 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:43 devstack sudo[106931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-052e559b-0a10-42ed-bfd2-3c8b49ca7f37 Nov 04 12:30:43 devstack sudo[106931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:43 devstack sudo[106922]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b09fc912-793d-413e-b9d2-87701dd1091f tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1aecec0f-0dfe-4b9a-b059-7bce61824c62 1073741824" returned: 0 in 0.542s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b09fc912-793d-413e-b9d2-87701dd1091f tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1aecec0f-0dfe-4b9a-b059-7bce61824c62 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:43 devstack sudo[106934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1aecec0f-0dfe-4b9a-b059-7bce61824c62 Nov 04 12:30:43 devstack sudo[106934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:43 devstack sudo[106931]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a19a7a18-ab62-47a1-80a9-c6de2a43a2bd tempest-CreateVolumesFromSnapshotTest-1515403536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-052e559b-0a10-42ed-bfd2-3c8b49ca7f37" returned: 0 in 0.309s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:43 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a19a7a18-ab62-47a1-80a9-c6de2a43a2bd tempest-CreateVolumesFromSnapshotTest-1515403536 None] Lock "cinder-quobyte-052e559b-0a10-42ed-bfd2-3c8b49ca7f37" released by "delete_volume" :: held 0.843s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:30:43 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-a19a7a18-ab62-47a1-80a9-c6de2a43a2bd tempest-CreateVolumesFromSnapshotTest-1515403536 None] Created reservations ['afca29d0-d66c-4cfd-9f7e-c083471a9801', '8dbc99c3-5e82-429f-985f-d74d29f8a85e', '339d747b-c499-456f-838a-489af07539fb', '57c07d6d-e79a-4eef-b7f2-052412b73f6a'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:30:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a19a7a18-ab62-47a1-80a9-c6de2a43a2bd tempest-CreateVolumesFromSnapshotTest-1515403536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:30:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a19a7a18-ab62-47a1-80a9-c6de2a43a2bd tempest-CreateVolumesFromSnapshotTest-1515403536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:30:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a19a7a18-ab62-47a1-80a9-c6de2a43a2bd tempest-CreateVolumesFromSnapshotTest-1515403536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:30:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a19a7a18-ab62-47a1-80a9-c6de2a43a2bd tempest-CreateVolumesFromSnapshotTest-1515403536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:30:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a19a7a18-ab62-47a1-80a9-c6de2a43a2bd tempest-CreateVolumesFromSnapshotTest-1515403536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:30:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a19a7a18-ab62-47a1-80a9-c6de2a43a2bd tempest-CreateVolumesFromSnapshotTest-1515403536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:43 devstack sudo[106939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:30:43 devstack sudo[106939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:43 devstack sudo[106934]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b09fc912-793d-413e-b9d2-87701dd1091f tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1aecec0f-0dfe-4b9a-b059-7bce61824c62" returned: 0 in 0.310s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b09fc912-793d-413e-b9d2-87701dd1091f tempest-ProjectMemberTests-1539753999 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:30:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b09fc912-793d-413e-b9d2-87701dd1091f tempest-ProjectMemberTests-1539753999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:30:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d4b6a6b1-beb3-4d36-b60a-3453d04ad624 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.735s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:30:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d4b6a6b1-beb3-4d36-b60a-3453d04ad624 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:30:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1975076233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78a9d6d1-06cb-4df9-bf05-75e3337f5e4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0adb9e5356a342da8acaeec2df63cd9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:30:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:30:43Z,use_quota=True,user_id='31c497d042bd4fa7acaddd962d6b6e1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:30:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-d4b6a6b1-beb3-4d36-b60a-3453d04ad624 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Creating volume 78a9d6d1-06cb-4df9-bf05-75e3337f5e4c {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:30:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d4b6a6b1-beb3-4d36-b60a-3453d04ad624 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:30:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d4b6a6b1-beb3-4d36-b60a-3453d04ad624 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:30:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d4b6a6b1-beb3-4d36-b60a-3453d04ad624 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:30:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d4b6a6b1-beb3-4d36-b60a-3453d04ad624 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:30:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d4b6a6b1-beb3-4d36-b60a-3453d04ad624 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:30:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d4b6a6b1-beb3-4d36-b60a-3453d04ad624 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:30:43 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-d4b6a6b1-beb3-4d36-b60a-3453d04ad624 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:30:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d4b6a6b1-beb3-4d36-b60a-3453d04ad624 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-78a9d6d1-06cb-4df9-bf05-75e3337f5e4c 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b09fc912-793d-413e-b9d2-87701dd1091f tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0df659f7-4ae6-4c20-8ce8-923652da8a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1aecec0f-0dfe-4b9a-b059-7bce61824c62', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:43 devstack sudo[106941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-78a9d6d1-06cb-4df9-bf05-75e3337f5e4c 1073741824 Nov 04 12:30:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b09fc912-793d-413e-b9d2-87701dd1091f tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf11a12d-8d71-4829-a6dc-87084f902f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:43 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-01381477-ce40-4169-bc51-8e9119e7f5df tempest-CreateVolumesFromSnapshotTest-1515403536 None] Acquiring lock "cinder-6574580a-ea02-4fee-aaf9-4cd633641e72-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:30:43 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-b09fc912-793d-413e-b9d2-87701dd1091f tempest-ProjectMemberTests-1539753999 None] Volume volume-1aecec0f-0dfe-4b9a-b059-7bce61824c62 (1aecec0f-0dfe-4b9a-b059-7bce61824c62): created successfully Nov 04 12:30:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b09fc912-793d-413e-b9d2-87701dd1091f tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf11a12d-8d71-4829-a6dc-87084f902f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b09fc912-793d-413e-b9d2-87701dd1091f tempest-ProjectMemberTests-1539753999 None] Flow 'volume_create_manager' (d480624b-7749-41a1-802f-fe5c327fab3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:30:43 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-01381477-ce40-4169-bc51-8e9119e7f5df tempest-CreateVolumesFromSnapshotTest-1515403536 None] Lock "cinder-6574580a-ea02-4fee-aaf9-4cd633641e72-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:30:43 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-b09fc912-793d-413e-b9d2-87701dd1091f tempest-ProjectMemberTests-1539753999 None] Created volume successfully. Nov 04 12:30:43 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-01381477-ce40-4169-bc51-8e9119e7f5df tempest-CreateVolumesFromSnapshotTest-1515403536 None] Acquiring lock "cinder-quobyte-6574580a-ea02-4fee-aaf9-4cd633641e72" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:30:43 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-01381477-ce40-4169-bc51-8e9119e7f5df tempest-CreateVolumesFromSnapshotTest-1515403536 None] Lock "cinder-quobyte-6574580a-ea02-4fee-aaf9-4cd633641e72" acquired by "delete_volume" :: waited 0.028s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:30:43 devstack sudo[106941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:43 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[808eb0ad-7ed4-43a4-9beb-c9ffd0d3e5e7]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:30:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-01381477-ce40-4169-bc51-8e9119e7f5df tempest-CreateVolumesFromSnapshotTest-1515403536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6574580a-ea02-4fee-aaf9-4cd633641e72 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:43 devstack sudo[106939]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a19a7a18-ab62-47a1-80a9-c6de2a43a2bd tempest-CreateVolumesFromSnapshotTest-1515403536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.396s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:43 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-a19a7a18-ab62-47a1-80a9-c6de2a43a2bd tempest-CreateVolumesFromSnapshotTest-1515403536 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:30:44 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-a19a7a18-ab62-47a1-80a9-c6de2a43a2bd tempest-CreateVolumesFromSnapshotTest-1515403536 None] Deleted volume successfully. Nov 04 12:30:44 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a19a7a18-ab62-47a1-80a9-c6de2a43a2bd tempest-CreateVolumesFromSnapshotTest-1515403536 None] Lock "cinder-052e559b-0a10-42ed-bfd2-3c8b49ca7f37-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:30:44 devstack sudo[106946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6574580a-ea02-4fee-aaf9-4cd633641e72 Nov 04 12:30:44 devstack sudo[106946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:44 devstack sudo[106941]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d4b6a6b1-beb3-4d36-b60a-3453d04ad624 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-78a9d6d1-06cb-4df9-bf05-75e3337f5e4c 1073741824" returned: 0 in 0.668s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d4b6a6b1-beb3-4d36-b60a-3453d04ad624 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-78a9d6d1-06cb-4df9-bf05-75e3337f5e4c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:44 devstack sudo[106955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-78a9d6d1-06cb-4df9-bf05-75e3337f5e4c Nov 04 12:30:44 devstack sudo[106955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:44 devstack sudo[106946]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-01381477-ce40-4169-bc51-8e9119e7f5df tempest-CreateVolumesFromSnapshotTest-1515403536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6574580a-ea02-4fee-aaf9-4cd633641e72" returned: 0 in 0.504s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-01381477-ce40-4169-bc51-8e9119e7f5df tempest-CreateVolumesFromSnapshotTest-1515403536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6574580a-ea02-4fee-aaf9-4cd633641e72 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:44 devstack sudo[106957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6574580a-ea02-4fee-aaf9-4cd633641e72 Nov 04 12:30:44 devstack sudo[106957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:44 devstack sudo[106955]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d4b6a6b1-beb3-4d36-b60a-3453d04ad624 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-78a9d6d1-06cb-4df9-bf05-75e3337f5e4c" returned: 0 in 0.314s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:44 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d4b6a6b1-beb3-4d36-b60a-3453d04ad624 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:30:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d4b6a6b1-beb3-4d36-b60a-3453d04ad624 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:30:44 devstack sudo[106957]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d4b6a6b1-beb3-4d36-b60a-3453d04ad624 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc36a3e2-361b-42aa-9e95-63f1f469c15e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78a9d6d1-06cb-4df9-bf05-75e3337f5e4c', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d4b6a6b1-beb3-4d36-b60a-3453d04ad624 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03344b3a-9b1f-41e8-971f-874aaa5013b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-01381477-ce40-4169-bc51-8e9119e7f5df tempest-CreateVolumesFromSnapshotTest-1515403536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6574580a-ea02-4fee-aaf9-4cd633641e72" returned: 0 in 0.317s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:44 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-01381477-ce40-4169-bc51-8e9119e7f5df tempest-CreateVolumesFromSnapshotTest-1515403536 None] Lock "cinder-quobyte-6574580a-ea02-4fee-aaf9-4cd633641e72" released by "delete_volume" :: held 0.888s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:30:44 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-d4b6a6b1-beb3-4d36-b60a-3453d04ad624 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Volume volume-78a9d6d1-06cb-4df9-bf05-75e3337f5e4c (78a9d6d1-06cb-4df9-bf05-75e3337f5e4c): created successfully Nov 04 12:30:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d4b6a6b1-beb3-4d36-b60a-3453d04ad624 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03344b3a-9b1f-41e8-971f-874aaa5013b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d4b6a6b1-beb3-4d36-b60a-3453d04ad624 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Flow 'volume_create_manager' (b730dd73-9a82-43a5-b2e0-1d00ba4eea54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:30:44 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-d4b6a6b1-beb3-4d36-b60a-3453d04ad624 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Created volume successfully. Nov 04 12:30:44 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-01381477-ce40-4169-bc51-8e9119e7f5df tempest-CreateVolumesFromSnapshotTest-1515403536 None] Created reservations ['c57ed7d0-5e84-4876-ac0e-57c74ebcdef0', '11c05663-25ad-4051-a77c-a3f53139a967', 'b2270029-72f6-4b53-98f1-51c052ce86e1', 'e8131b5d-cedc-4d37-84ed-4e3da1493013'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:30:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-01381477-ce40-4169-bc51-8e9119e7f5df tempest-CreateVolumesFromSnapshotTest-1515403536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:30:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-01381477-ce40-4169-bc51-8e9119e7f5df tempest-CreateVolumesFromSnapshotTest-1515403536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:30:44 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-01381477-ce40-4169-bc51-8e9119e7f5df tempest-CreateVolumesFromSnapshotTest-1515403536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:30:44 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-01381477-ce40-4169-bc51-8e9119e7f5df tempest-CreateVolumesFromSnapshotTest-1515403536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:30:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-01381477-ce40-4169-bc51-8e9119e7f5df tempest-CreateVolumesFromSnapshotTest-1515403536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:30:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-01381477-ce40-4169-bc51-8e9119e7f5df tempest-CreateVolumesFromSnapshotTest-1515403536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:44 devstack sudo[106961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:30:44 devstack sudo[106961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-26029c8a-4f7a-4306-9f0a-cbfb8fadbb22 tempest-ProjectMemberTests-1539753999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:30:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-26029c8a-4f7a-4306-9f0a-cbfb8fadbb22 tempest-ProjectMemberTests-1539753999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:30:45 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-26029c8a-4f7a-4306-9f0a-cbfb8fadbb22 tempest-ProjectMemberTests-1539753999 None] Creating offline snapshot 877ba83d-947f-4082-91a3-e8c1f7b1be0a of volume 1aecec0f-0dfe-4b9a-b059-7bce61824c62 {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 12:30:45 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b166a34e-8c7e-4795-95fd-e5754eccf016]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:30:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-26029c8a-4f7a-4306-9f0a-cbfb8fadbb22 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1aecec0f-0dfe-4b9a-b059-7bce61824c62 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:45 devstack sudo[106961]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-01381477-ce40-4169-bc51-8e9119e7f5df tempest-CreateVolumesFromSnapshotTest-1515403536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.306s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:45 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-01381477-ce40-4169-bc51-8e9119e7f5df tempest-CreateVolumesFromSnapshotTest-1515403536 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:30:45 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-01381477-ce40-4169-bc51-8e9119e7f5df tempest-CreateVolumesFromSnapshotTest-1515403536 None] Deleted volume successfully. Nov 04 12:30:45 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-01381477-ce40-4169-bc51-8e9119e7f5df tempest-CreateVolumesFromSnapshotTest-1515403536 None] Lock "cinder-6574580a-ea02-4fee-aaf9-4cd633641e72-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:30:45 devstack sudo[106963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1aecec0f-0dfe-4b9a-b059-7bce61824c62 Nov 04 12:30:45 devstack sudo[106963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5b3ff3ec-6cf4-4349-a135-fe5054c42e4d tempest-ProjectAdminTests-1456425158 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6071128845215, 'free_capacity_gb': 1773.6071128845215, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87095) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 04 12:30:45 devstack sudo[106963]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-26029c8a-4f7a-4306-9f0a-cbfb8fadbb22 tempest-ProjectMemberTests-1539753999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1aecec0f-0dfe-4b9a-b059-7bce61824c62" returned: 0 in 0.407s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-26029c8a-4f7a-4306-9f0a-cbfb8fadbb22 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1aecec0f-0dfe-4b9a-b059-7bce61824c62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1aecec0f-0dfe-4b9a-b059-7bce61824c62.877ba83d-947f-4082-91a3-e8c1f7b1be0a 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:45 devstack sudo[106969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1aecec0f-0dfe-4b9a-b059-7bce61824c62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1aecec0f-0dfe-4b9a-b059-7bce61824c62.877ba83d-947f-4082-91a3-e8c1f7b1be0a 1G Nov 04 12:30:45 devstack sudo[106969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:46 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-78ecd0d3-07e8-4365-a3e3-137c7d100e20 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Acquiring lock "cinder-576775b2-df3e-4e47-9def-c575173abb85-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:30:46 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-78ecd0d3-07e8-4365-a3e3-137c7d100e20 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Lock "cinder-576775b2-df3e-4e47-9def-c575173abb85-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:30:46 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-78ecd0d3-07e8-4365-a3e3-137c7d100e20 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Acquiring lock "cinder-quobyte-576775b2-df3e-4e47-9def-c575173abb85" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:30:46 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-78ecd0d3-07e8-4365-a3e3-137c7d100e20 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Lock "cinder-quobyte-576775b2-df3e-4e47-9def-c575173abb85" acquired by "delete_volume" :: waited 0.017s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:30:46 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a66c198d-027e-425e-aace-f7a2aeaf6e77]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:30:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-78ecd0d3-07e8-4365-a3e3-137c7d100e20 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-576775b2-df3e-4e47-9def-c575173abb85 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:46 devstack sudo[106969]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-26029c8a-4f7a-4306-9f0a-cbfb8fadbb22 tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1aecec0f-0dfe-4b9a-b059-7bce61824c62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1aecec0f-0dfe-4b9a-b059-7bce61824c62.877ba83d-947f-4082-91a3-e8c1f7b1be0a 1G" returned: 0 in 0.641s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-26029c8a-4f7a-4306-9f0a-cbfb8fadbb22 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1aecec0f-0dfe-4b9a-b059-7bce61824c62 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1aecec0f-0dfe-4b9a-b059-7bce61824c62.877ba83d-947f-4082-91a3-e8c1f7b1be0a {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:46 devstack sudo[106976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1aecec0f-0dfe-4b9a-b059-7bce61824c62 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1aecec0f-0dfe-4b9a-b059-7bce61824c62.877ba83d-947f-4082-91a3-e8c1f7b1be0a Nov 04 12:30:46 devstack sudo[106976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:46 devstack sudo[106975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-576775b2-df3e-4e47-9def-c575173abb85 Nov 04 12:30:46 devstack sudo[106975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:46 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-c17d12a2-79b3-44b8-b661-dd3b18fed549 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:30:46 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c17d12a2-79b3-44b8-b661-dd3b18fed549 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Flow 'volume_create_manager' (987576ec-0eb3-4635-b372-7652b06df857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:30:46 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c17d12a2-79b3-44b8-b661-dd3b18fed549 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5c63922-cc92-4d4a-bb58-a6a8e90cda1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:46 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c17d12a2-79b3-44b8-b661-dd3b18fed549 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5c63922-cc92-4d4a-bb58-a6a8e90cda1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:30:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1110973161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dc7aebb-620e-4a57-bac6-81f3d8fb173e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0adb9e5356a342da8acaeec2df63cd9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:30:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:30:47Z,use_quota=True,user_id='31c497d042bd4fa7acaddd962d6b6e1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:46 devstack sudo[106976]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:46 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c17d12a2-79b3-44b8-b661-dd3b18fed549 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e3f2f14-dff9-4808-99ff-e932300e9460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:46 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c17d12a2-79b3-44b8-b661-dd3b18fed549 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e3f2f14-dff9-4808-99ff-e932300e9460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:46 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c17d12a2-79b3-44b8-b661-dd3b18fed549 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55b2d801-3040-4816-aa28-c4bce3cc182e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:46 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c17d12a2-79b3-44b8-b661-dd3b18fed549 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55b2d801-3040-4816-aa28-c4bce3cc182e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3dc7aebb-620e-4a57-bac6-81f3d8fb173e', 'volume_name': 'volume-3dc7aebb-620e-4a57-bac6-81f3d8fb173e', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:46 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c17d12a2-79b3-44b8-b661-dd3b18fed549 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ceacef9-7016-4de1-a6fb-160c5239d18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:46 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c17d12a2-79b3-44b8-b661-dd3b18fed549 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ceacef9-7016-4de1-a6fb-160c5239d18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:46 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c17d12a2-79b3-44b8-b661-dd3b18fed549 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5401fd03-0839-4359-8bb7-b65e0c93a885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:46 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-c17d12a2-79b3-44b8-b661-dd3b18fed549 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Volume 3dc7aebb-620e-4a57-bac6-81f3d8fb173e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3dc7aebb-620e-4a57-bac6-81f3d8fb173e', 'volume_size': 1} Nov 04 12:30:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c17d12a2-79b3-44b8-b661-dd3b18fed549 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:30:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-26029c8a-4f7a-4306-9f0a-cbfb8fadbb22 tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1aecec0f-0dfe-4b9a-b059-7bce61824c62 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1aecec0f-0dfe-4b9a-b059-7bce61824c62.877ba83d-947f-4082-91a3-e8c1f7b1be0a" returned: 0 in 0.465s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:46 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-26029c8a-4f7a-4306-9f0a-cbfb8fadbb22 tempest-ProjectMemberTests-1539753999 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1aecec0f-0dfe-4b9a-b059-7bce61824c62.877ba83d-947f-4082-91a3-e8c1f7b1be0a is being set with open permissions: ugo+rw Nov 04 12:30:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-26029c8a-4f7a-4306-9f0a-cbfb8fadbb22 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1aecec0f-0dfe-4b9a-b059-7bce61824c62.877ba83d-947f-4082-91a3-e8c1f7b1be0a {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:46 devstack sudo[106975]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-78ecd0d3-07e8-4365-a3e3-137c7d100e20 tempest-CreateVolumesFromSnapshotTest-1515403536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-576775b2-df3e-4e47-9def-c575173abb85" returned: 0 in 0.553s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-78ecd0d3-07e8-4365-a3e3-137c7d100e20 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-576775b2-df3e-4e47-9def-c575173abb85 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:46 devstack sudo[106985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1aecec0f-0dfe-4b9a-b059-7bce61824c62.877ba83d-947f-4082-91a3-e8c1f7b1be0a Nov 04 12:30:46 devstack sudo[106985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:46 devstack sudo[106987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-576775b2-df3e-4e47-9def-c575173abb85 Nov 04 12:30:46 devstack sudo[106987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:47 devstack sudo[106985]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-26029c8a-4f7a-4306-9f0a-cbfb8fadbb22 tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1aecec0f-0dfe-4b9a-b059-7bce61824c62.877ba83d-947f-4082-91a3-e8c1f7b1be0a" returned: 0 in 0.346s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:47 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-5818f381-9e18-4835-ba9a-620877e701f3 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:30:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5818f381-9e18-4835-ba9a-620877e701f3 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Flow 'volume_create_manager' (94781b22-46f7-4c69-9b5d-f0427e981f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:30:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5818f381-9e18-4835-ba9a-620877e701f3 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e167ad4a-77f9-4983-a33c-cd37d50d8232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5818f381-9e18-4835-ba9a-620877e701f3 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e167ad4a-77f9-4983-a33c-cd37d50d8232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:30:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1646578229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c5f830e-a037-4bf9-a6a8-dc610dff0333,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0adb9e5356a342da8acaeec2df63cd9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:30:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:30:47Z,use_quota=True,user_id='31c497d042bd4fa7acaddd962d6b6e1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:47 devstack sudo[106987]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5818f381-9e18-4835-ba9a-620877e701f3 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b52c7b49-dd98-42f3-bba2-e640bb131a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5818f381-9e18-4835-ba9a-620877e701f3 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b52c7b49-dd98-42f3-bba2-e640bb131a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5818f381-9e18-4835-ba9a-620877e701f3 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fd60e19-0b11-4f5b-8401-a82cde577060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5818f381-9e18-4835-ba9a-620877e701f3 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fd60e19-0b11-4f5b-8401-a82cde577060) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c5f830e-a037-4bf9-a6a8-dc610dff0333', 'volume_name': 'volume-5c5f830e-a037-4bf9-a6a8-dc610dff0333', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5818f381-9e18-4835-ba9a-620877e701f3 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cf00447-3791-4faa-9122-5703b8bb49b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5818f381-9e18-4835-ba9a-620877e701f3 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cf00447-3791-4faa-9122-5703b8bb49b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5818f381-9e18-4835-ba9a-620877e701f3 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (722cb592-e41f-4e76-a0ea-a79044028124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:47 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-5818f381-9e18-4835-ba9a-620877e701f3 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Volume 5c5f830e-a037-4bf9-a6a8-dc610dff0333: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c5f830e-a037-4bf9-a6a8-dc610dff0333', 'volume_size': 1} Nov 04 12:30:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5818f381-9e18-4835-ba9a-620877e701f3 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:30:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-26029c8a-4f7a-4306-9f0a-cbfb8fadbb22 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1aecec0f-0dfe-4b9a-b059-7bce61824c62.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-78ecd0d3-07e8-4365-a3e3-137c7d100e20 tempest-CreateVolumesFromSnapshotTest-1515403536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-576775b2-df3e-4e47-9def-c575173abb85" returned: 0 in 0.472s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:47 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-78ecd0d3-07e8-4365-a3e3-137c7d100e20 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Lock "cinder-quobyte-576775b2-df3e-4e47-9def-c575173abb85" released by "delete_volume" :: held 1.092s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:30:47 devstack sudo[106991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1aecec0f-0dfe-4b9a-b059-7bce61824c62.info Nov 04 12:30:47 devstack sudo[106991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:47 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-78ecd0d3-07e8-4365-a3e3-137c7d100e20 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Created reservations ['ea4a5d7a-f7d3-4e69-8a8e-6fe41e6d3b60', '4833da11-7eff-4472-b023-bef258152b94', 'b77832d9-b7ad-4ed8-8e20-7bb38f2a1199', '54841a09-c052-4799-bbd7-4ae5544b881c'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:30:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-78ecd0d3-07e8-4365-a3e3-137c7d100e20 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:30:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-78ecd0d3-07e8-4365-a3e3-137c7d100e20 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:30:47 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-78ecd0d3-07e8-4365-a3e3-137c7d100e20 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:30:47 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-78ecd0d3-07e8-4365-a3e3-137c7d100e20 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:30:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-78ecd0d3-07e8-4365-a3e3-137c7d100e20 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:30:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-78ecd0d3-07e8-4365-a3e3-137c7d100e20 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:47 devstack sudo[106993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:30:47 devstack sudo[106993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:47 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e0de014-b9e3-4c24-a96b-b852ad3c01ff tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:30:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1e0de014-b9e3-4c24-a96b-b852ad3c01ff tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Flow 'volume_create_manager' (7d1549f2-8a27-481e-b23e-bc9747461ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:30:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1e0de014-b9e3-4c24-a96b-b852ad3c01ff tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d795bf15-9195-4b14-9018-6c3338df38cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:47 devstack sudo[106991]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1e0de014-b9e3-4c24-a96b-b852ad3c01ff tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d795bf15-9195-4b14-9018-6c3338df38cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:30:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-647274693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80bf7b5a-22e2-440c-8991-c80752d72278,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0adb9e5356a342da8acaeec2df63cd9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:30:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:30:48Z,use_quota=True,user_id='31c497d042bd4fa7acaddd962d6b6e1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1e0de014-b9e3-4c24-a96b-b852ad3c01ff tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b294895a-adf6-446e-8cb0-dea5c50cf390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1e0de014-b9e3-4c24-a96b-b852ad3c01ff tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b294895a-adf6-446e-8cb0-dea5c50cf390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1e0de014-b9e3-4c24-a96b-b852ad3c01ff tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2cea2ea-4167-441b-b74c-8b8defd81694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1e0de014-b9e3-4c24-a96b-b852ad3c01ff tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2cea2ea-4167-441b-b74c-8b8defd81694) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80bf7b5a-22e2-440c-8991-c80752d72278', 'volume_name': 'volume-80bf7b5a-22e2-440c-8991-c80752d72278', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1e0de014-b9e3-4c24-a96b-b852ad3c01ff tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (388545dc-f5dc-4d34-857d-de95afdc866a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:47 devstack sudo[106993]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1e0de014-b9e3-4c24-a96b-b852ad3c01ff tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (388545dc-f5dc-4d34-857d-de95afdc866a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1e0de014-b9e3-4c24-a96b-b852ad3c01ff tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f6e2a9a-0fed-4e05-a925-1ed471e83724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:47 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-1e0de014-b9e3-4c24-a96b-b852ad3c01ff tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Volume 80bf7b5a-22e2-440c-8991-c80752d72278: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80bf7b5a-22e2-440c-8991-c80752d72278', 'volume_size': 1} Nov 04 12:30:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1e0de014-b9e3-4c24-a96b-b852ad3c01ff tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:30:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-26029c8a-4f7a-4306-9f0a-cbfb8fadbb22 tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1aecec0f-0dfe-4b9a-b059-7bce61824c62.info" returned: 0 in 0.583s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:47 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-26029c8a-4f7a-4306-9f0a-cbfb8fadbb22 tempest-ProjectMemberTests-1539753999 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1aecec0f-0dfe-4b9a-b059-7bce61824c62.info is being set with open permissions: ugo+rw Nov 04 12:30:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-26029c8a-4f7a-4306-9f0a-cbfb8fadbb22 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1aecec0f-0dfe-4b9a-b059-7bce61824c62.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-78ecd0d3-07e8-4365-a3e3-137c7d100e20 tempest-CreateVolumesFromSnapshotTest-1515403536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.393s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:47 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-78ecd0d3-07e8-4365-a3e3-137c7d100e20 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:30:47 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-78ecd0d3-07e8-4365-a3e3-137c7d100e20 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Deleted volume successfully. Nov 04 12:30:47 devstack sudo[106997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1aecec0f-0dfe-4b9a-b059-7bce61824c62.info Nov 04 12:30:47 devstack sudo[106997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:47 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-78ecd0d3-07e8-4365-a3e3-137c7d100e20 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Lock "cinder-576775b2-df3e-4e47-9def-c575173abb85-delete_volume" released by "delete_volume" :: held 1.783s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:30:48 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8ed10ab-51d2-42a9-9237-6db5ec57eaf4 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:30:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f8ed10ab-51d2-42a9-9237-6db5ec57eaf4 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Flow 'volume_create_manager' (374437ca-83e0-47cb-b55d-9d38e26042c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:30:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f8ed10ab-51d2-42a9-9237-6db5ec57eaf4 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddf9a567-47ba-4508-89c2-7eb73f00f254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f8ed10ab-51d2-42a9-9237-6db5ec57eaf4 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddf9a567-47ba-4508-89c2-7eb73f00f254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:30:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-499512049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec112a92-7b9d-4cba-9138-70278b4041e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0adb9e5356a342da8acaeec2df63cd9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:30:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:30:48Z,use_quota=True,user_id='31c497d042bd4fa7acaddd962d6b6e1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f8ed10ab-51d2-42a9-9237-6db5ec57eaf4 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b183a97-790f-4ac6-bc74-777d72bee01e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f8ed10ab-51d2-42a9-9237-6db5ec57eaf4 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b183a97-790f-4ac6-bc74-777d72bee01e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:48 devstack sudo[106997]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f8ed10ab-51d2-42a9-9237-6db5ec57eaf4 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6eec88c0-5411-423d-a628-130c72337954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f8ed10ab-51d2-42a9-9237-6db5ec57eaf4 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6eec88c0-5411-423d-a628-130c72337954) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec112a92-7b9d-4cba-9138-70278b4041e6', 'volume_name': 'volume-ec112a92-7b9d-4cba-9138-70278b4041e6', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f8ed10ab-51d2-42a9-9237-6db5ec57eaf4 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b40057c-1e20-45ac-a2fd-3d057e5f3611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f8ed10ab-51d2-42a9-9237-6db5ec57eaf4 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b40057c-1e20-45ac-a2fd-3d057e5f3611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f8ed10ab-51d2-42a9-9237-6db5ec57eaf4 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a8ff635-0e76-45dd-abf1-a94163a3621d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:48 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-f8ed10ab-51d2-42a9-9237-6db5ec57eaf4 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Volume ec112a92-7b9d-4cba-9138-70278b4041e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec112a92-7b9d-4cba-9138-70278b4041e6', 'volume_size': 1} Nov 04 12:30:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f8ed10ab-51d2-42a9-9237-6db5ec57eaf4 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:30:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-26029c8a-4f7a-4306-9f0a-cbfb8fadbb22 tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1aecec0f-0dfe-4b9a-b059-7bce61824c62.info" returned: 0 in 0.448s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-26029c8a-4f7a-4306-9f0a-cbfb8fadbb22 tempest-ProjectMemberTests-1539753999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.114s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:30:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c17d12a2-79b3-44b8-b661-dd3b18fed549 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.561s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:30:48 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c17d12a2-79b3-44b8-b661-dd3b18fed549 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:30:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1110973161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dc7aebb-620e-4a57-bac6-81f3d8fb173e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0adb9e5356a342da8acaeec2df63cd9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:30:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:30:47Z,use_quota=True,user_id='31c497d042bd4fa7acaddd962d6b6e1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:30:48 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-c17d12a2-79b3-44b8-b661-dd3b18fed549 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Creating volume 3dc7aebb-620e-4a57-bac6-81f3d8fb173e {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:30:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c17d12a2-79b3-44b8-b661-dd3b18fed549 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:30:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c17d12a2-79b3-44b8-b661-dd3b18fed549 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:30:48 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c17d12a2-79b3-44b8-b661-dd3b18fed549 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:30:48 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c17d12a2-79b3-44b8-b661-dd3b18fed549 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:30:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c17d12a2-79b3-44b8-b661-dd3b18fed549 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:30:48 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c17d12a2-79b3-44b8-b661-dd3b18fed549 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:30:48 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-c17d12a2-79b3-44b8-b661-dd3b18fed549 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:30:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c17d12a2-79b3-44b8-b661-dd3b18fed549 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-3dc7aebb-620e-4a57-bac6-81f3d8fb173e 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:48 devstack sudo[107001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-3dc7aebb-620e-4a57-bac6-81f3d8fb173e 1073741824 Nov 04 12:30:48 devstack sudo[107001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:48 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-26029c8a-4f7a-4306-9f0a-cbfb8fadbb22 tempest-ProjectMemberTests-1539753999 None] Create snapshot completed successfully Nov 04 12:30:48 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-be6e5953-e966-486a-96f9-235ff2c75bc9 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Acquiring lock "cinder-4bf03d0d-2ab2-4e2a-a2ba-1f61179d318e-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:30:48 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-be6e5953-e966-486a-96f9-235ff2c75bc9 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Lock "cinder-4bf03d0d-2ab2-4e2a-a2ba-1f61179d318e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:30:48 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-be6e5953-e966-486a-96f9-235ff2c75bc9 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Acquiring lock "cinder-quobyte-8216c52a-a5e7-4469-889c-e540cb326b1b" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:30:48 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-be6e5953-e966-486a-96f9-235ff2c75bc9 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Lock "cinder-quobyte-8216c52a-a5e7-4469-889c-e540cb326b1b" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:30:48 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-be6e5953-e966-486a-96f9-235ff2c75bc9 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Acquiring lock "cinder-quobyte-4bf03d0d-2ab2-4e2a-a2ba-1f61179d318e" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:30:48 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-be6e5953-e966-486a-96f9-235ff2c75bc9 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Lock "cinder-quobyte-4bf03d0d-2ab2-4e2a-a2ba-1f61179d318e" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:30:48 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-be6e5953-e966-486a-96f9-235ff2c75bc9 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Deleting offline snapshot 4bf03d0d-2ab2-4e2a-a2ba-1f61179d318e of volume 8216c52a-a5e7-4469-889c-e540cb326b1b {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 12:30:48 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-be6e5953-e966-486a-96f9-235ff2c75bc9 tempest-CreateVolumesFromSnapshotTest-1515403536 None] snapshot_file for this snap is: volume-8216c52a-a5e7-4469-889c-e540cb326b1b.4bf03d0d-2ab2-4e2a-a2ba-1f61179d318e {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 12:30:48 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[574f915e-aff5-4eb9-9560-6ae7ea8c158f]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:30:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-be6e5953-e966-486a-96f9-235ff2c75bc9 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8216c52a-a5e7-4469-889c-e540cb326b1b.4bf03d0d-2ab2-4e2a-a2ba-1f61179d318e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:48 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1cbf8ff-187c-45b9-a46e-836ee10f6a47 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:30:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e1cbf8ff-187c-45b9-a46e-836ee10f6a47 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Flow 'volume_create_manager' (cdbe475a-d756-48fd-88b3-9f240482f49c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:30:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e1cbf8ff-187c-45b9-a46e-836ee10f6a47 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87cabc4c-b14b-4489-8efd-d5ed113b98fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e1cbf8ff-187c-45b9-a46e-836ee10f6a47 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87cabc4c-b14b-4489-8efd-d5ed113b98fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:30:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-289949458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=832ab111-d69e-478a-adfe-61c2d06ee270,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0adb9e5356a342da8acaeec2df63cd9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:30:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:30:49Z,use_quota=True,user_id='31c497d042bd4fa7acaddd962d6b6e1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e1cbf8ff-187c-45b9-a46e-836ee10f6a47 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99b3dee4-9d7a-45cf-a2ea-dee6895ddb64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:48 devstack sudo[107003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8216c52a-a5e7-4469-889c-e540cb326b1b.4bf03d0d-2ab2-4e2a-a2ba-1f61179d318e Nov 04 12:30:48 devstack sudo[107003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e1cbf8ff-187c-45b9-a46e-836ee10f6a47 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99b3dee4-9d7a-45cf-a2ea-dee6895ddb64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e1cbf8ff-187c-45b9-a46e-836ee10f6a47 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (957dd13a-fd7f-4574-8775-abb70b050cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e1cbf8ff-187c-45b9-a46e-836ee10f6a47 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (957dd13a-fd7f-4574-8775-abb70b050cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '832ab111-d69e-478a-adfe-61c2d06ee270', 'volume_name': 'volume-832ab111-d69e-478a-adfe-61c2d06ee270', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e1cbf8ff-187c-45b9-a46e-836ee10f6a47 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86d83e06-0134-4694-803c-6352b30f9a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e1cbf8ff-187c-45b9-a46e-836ee10f6a47 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86d83e06-0134-4694-803c-6352b30f9a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e1cbf8ff-187c-45b9-a46e-836ee10f6a47 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19568632-cdf7-4e62-bb7a-583177612ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:48 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-e1cbf8ff-187c-45b9-a46e-836ee10f6a47 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Volume 832ab111-d69e-478a-adfe-61c2d06ee270: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-832ab111-d69e-478a-adfe-61c2d06ee270', 'volume_size': 1} Nov 04 12:30:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e1cbf8ff-187c-45b9-a46e-836ee10f6a47 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:30:48 devstack sudo[107001]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c17d12a2-79b3-44b8-b661-dd3b18fed549 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-3dc7aebb-620e-4a57-bac6-81f3d8fb173e 1073741824" returned: 0 in 0.632s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c17d12a2-79b3-44b8-b661-dd3b18fed549 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-3dc7aebb-620e-4a57-bac6-81f3d8fb173e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:48 devstack sudo[107013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-3dc7aebb-620e-4a57-bac6-81f3d8fb173e Nov 04 12:30:48 devstack sudo[107013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:49 devstack sudo[107003]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-be6e5953-e966-486a-96f9-235ff2c75bc9 tempest-CreateVolumesFromSnapshotTest-1515403536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8216c52a-a5e7-4469-889c-e540cb326b1b.4bf03d0d-2ab2-4e2a-a2ba-1f61179d318e" returned: 0 in 0.448s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:49 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-be6e5953-e966-486a-96f9-235ff2c75bc9 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8216c52a-a5e7-4469-889c-e540cb326b1b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 12:30:49 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d33527-cb7a-4703-b2a8-68e432fa855f]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:30:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-be6e5953-e966-486a-96f9-235ff2c75bc9 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8216c52a-a5e7-4469-889c-e540cb326b1b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:49 devstack sudo[107015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8216c52a-a5e7-4469-889c-e540cb326b1b Nov 04 12:30:49 devstack sudo[107015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:49 devstack sudo[107013]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c17d12a2-79b3-44b8-b661-dd3b18fed549 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-3dc7aebb-620e-4a57-bac6-81f3d8fb173e" returned: 0 in 0.293s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:49 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c17d12a2-79b3-44b8-b661-dd3b18fed549 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:30:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c17d12a2-79b3-44b8-b661-dd3b18fed549 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:30:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5818f381-9e18-4835-ba9a-620877e701f3 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.061s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:30:49 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-5818f381-9e18-4835-ba9a-620877e701f3 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:30:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1646578229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c5f830e-a037-4bf9-a6a8-dc610dff0333,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0adb9e5356a342da8acaeec2df63cd9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:30:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:30:47Z,use_quota=True,user_id='31c497d042bd4fa7acaddd962d6b6e1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:30:49 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-5818f381-9e18-4835-ba9a-620877e701f3 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Creating volume 5c5f830e-a037-4bf9-a6a8-dc610dff0333 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:30:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5818f381-9e18-4835-ba9a-620877e701f3 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:30:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5818f381-9e18-4835-ba9a-620877e701f3 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:30:49 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-5818f381-9e18-4835-ba9a-620877e701f3 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:30:49 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-5818f381-9e18-4835-ba9a-620877e701f3 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:30:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5818f381-9e18-4835-ba9a-620877e701f3 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:30:49 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-5818f381-9e18-4835-ba9a-620877e701f3 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:30:49 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-5818f381-9e18-4835-ba9a-620877e701f3 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:30:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5818f381-9e18-4835-ba9a-620877e701f3 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-5c5f830e-a037-4bf9-a6a8-dc610dff0333 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c17d12a2-79b3-44b8-b661-dd3b18fed549 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5401fd03-0839-4359-8bb7-b65e0c93a885) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dc7aebb-620e-4a57-bac6-81f3d8fb173e', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c17d12a2-79b3-44b8-b661-dd3b18fed549 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec4da8af-21cf-45b0-8910-00fc8d032aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:49 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-c17d12a2-79b3-44b8-b661-dd3b18fed549 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Volume volume-3dc7aebb-620e-4a57-bac6-81f3d8fb173e (3dc7aebb-620e-4a57-bac6-81f3d8fb173e): created successfully Nov 04 12:30:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c17d12a2-79b3-44b8-b661-dd3b18fed549 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec4da8af-21cf-45b0-8910-00fc8d032aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:49 devstack sudo[107018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-5c5f830e-a037-4bf9-a6a8-dc610dff0333 1073741824 Nov 04 12:30:49 devstack sudo[107018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c17d12a2-79b3-44b8-b661-dd3b18fed549 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Flow 'volume_create_manager' (987576ec-0eb3-4635-b372-7652b06df857) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:30:49 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-c17d12a2-79b3-44b8-b661-dd3b18fed549 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Created volume successfully. Nov 04 12:30:49 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ae234f1e-7d41-4c8c-9b69-5230bfdf63fa tempest-ProjectMemberTests-1539753999 None] Acquiring lock "cinder-877ba83d-947f-4082-91a3-e8c1f7b1be0a-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:30:49 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ae234f1e-7d41-4c8c-9b69-5230bfdf63fa tempest-ProjectMemberTests-1539753999 None] Lock "cinder-877ba83d-947f-4082-91a3-e8c1f7b1be0a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:30:49 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ae234f1e-7d41-4c8c-9b69-5230bfdf63fa tempest-ProjectMemberTests-1539753999 None] Acquiring lock "cinder-quobyte-1aecec0f-0dfe-4b9a-b059-7bce61824c62" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:30:49 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ae234f1e-7d41-4c8c-9b69-5230bfdf63fa tempest-ProjectMemberTests-1539753999 None] Lock "cinder-quobyte-1aecec0f-0dfe-4b9a-b059-7bce61824c62" acquired by "delete_snapshot" :: waited 0.057s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:30:49 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ae234f1e-7d41-4c8c-9b69-5230bfdf63fa tempest-ProjectMemberTests-1539753999 None] Acquiring lock "cinder-quobyte-877ba83d-947f-4082-91a3-e8c1f7b1be0a" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:30:49 devstack sudo[107015]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:49 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ae234f1e-7d41-4c8c-9b69-5230bfdf63fa tempest-ProjectMemberTests-1539753999 None] Lock "cinder-quobyte-877ba83d-947f-4082-91a3-e8c1f7b1be0a" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:30:49 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-ae234f1e-7d41-4c8c-9b69-5230bfdf63fa tempest-ProjectMemberTests-1539753999 None] Deleting offline snapshot 877ba83d-947f-4082-91a3-e8c1f7b1be0a of volume 1aecec0f-0dfe-4b9a-b059-7bce61824c62 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 12:30:49 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-ae234f1e-7d41-4c8c-9b69-5230bfdf63fa tempest-ProjectMemberTests-1539753999 None] snapshot_file for this snap is: volume-1aecec0f-0dfe-4b9a-b059-7bce61824c62.877ba83d-947f-4082-91a3-e8c1f7b1be0a {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 12:30:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-be6e5953-e966-486a-96f9-235ff2c75bc9 tempest-CreateVolumesFromSnapshotTest-1515403536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8216c52a-a5e7-4469-889c-e540cb326b1b" returned: 0 in 0.563s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-be6e5953-e966-486a-96f9-235ff2c75bc9 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8216c52a-a5e7-4469-889c-e540cb326b1b.4bf03d0d-2ab2-4e2a-a2ba-1f61179d318e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:49 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e385f58-72b9-4eca-afad-513aa7608a13]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:30:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ae234f1e-7d41-4c8c-9b69-5230bfdf63fa tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1aecec0f-0dfe-4b9a-b059-7bce61824c62.877ba83d-947f-4082-91a3-e8c1f7b1be0a {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:49 devstack sudo[107024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8216c52a-a5e7-4469-889c-e540cb326b1b.4bf03d0d-2ab2-4e2a-a2ba-1f61179d318e Nov 04 12:30:49 devstack sudo[107024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:49 devstack sudo[107026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1aecec0f-0dfe-4b9a-b059-7bce61824c62.877ba83d-947f-4082-91a3-e8c1f7b1be0a Nov 04 12:30:49 devstack sudo[107026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:49 devstack sudo[107018]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5818f381-9e18-4835-ba9a-620877e701f3 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-5c5f830e-a037-4bf9-a6a8-dc610dff0333 1073741824" returned: 0 in 0.654s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5818f381-9e18-4835-ba9a-620877e701f3 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-5c5f830e-a037-4bf9-a6a8-dc610dff0333 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:50 devstack sudo[107035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-5c5f830e-a037-4bf9-a6a8-dc610dff0333 Nov 04 12:30:50 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:50 devstack sudo[107024]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-be6e5953-e966-486a-96f9-235ff2c75bc9 tempest-CreateVolumesFromSnapshotTest-1515403536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8216c52a-a5e7-4469-889c-e540cb326b1b.4bf03d0d-2ab2-4e2a-a2ba-1f61179d318e" returned: 0 in 0.442s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-be6e5953-e966-486a-96f9-235ff2c75bc9 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8216c52a-a5e7-4469-889c-e540cb326b1b.4bf03d0d-2ab2-4e2a-a2ba-1f61179d318e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:50 devstack sudo[107026]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ae234f1e-7d41-4c8c-9b69-5230bfdf63fa tempest-ProjectMemberTests-1539753999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1aecec0f-0dfe-4b9a-b059-7bce61824c62.877ba83d-947f-4082-91a3-e8c1f7b1be0a" returned: 0 in 0.465s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:50 devstack sudo[107039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8216c52a-a5e7-4469-889c-e540cb326b1b.4bf03d0d-2ab2-4e2a-a2ba-1f61179d318e Nov 04 12:30:50 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-ae234f1e-7d41-4c8c-9b69-5230bfdf63fa tempest-ProjectMemberTests-1539753999 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1aecec0f-0dfe-4b9a-b059-7bce61824c62(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 12:30:50 devstack sudo[107039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:50 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a915c0-7629-48ac-be83-c4efa06e8319]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:30:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ae234f1e-7d41-4c8c-9b69-5230bfdf63fa tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1aecec0f-0dfe-4b9a-b059-7bce61824c62 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:50 devstack sudo[107041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1aecec0f-0dfe-4b9a-b059-7bce61824c62 Nov 04 12:30:50 devstack sudo[107041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:50 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5818f381-9e18-4835-ba9a-620877e701f3 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-5c5f830e-a037-4bf9-a6a8-dc610dff0333" returned: 0 in 0.346s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:50 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-5818f381-9e18-4835-ba9a-620877e701f3 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:30:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5818f381-9e18-4835-ba9a-620877e701f3 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:30:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1e0de014-b9e3-4c24-a96b-b852ad3c01ff tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.552s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:30:50 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1e0de014-b9e3-4c24-a96b-b852ad3c01ff tempest-CreateVolumesFromSourceVolumeTest-759799975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:30:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-647274693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80bf7b5a-22e2-440c-8991-c80752d72278,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0adb9e5356a342da8acaeec2df63cd9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:30:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:30:48Z,use_quota=True,user_id='31c497d042bd4fa7acaddd962d6b6e1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:30:50 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-1e0de014-b9e3-4c24-a96b-b852ad3c01ff tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Creating volume 80bf7b5a-22e2-440c-8991-c80752d72278 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:30:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1e0de014-b9e3-4c24-a96b-b852ad3c01ff tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:30:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1e0de014-b9e3-4c24-a96b-b852ad3c01ff tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:30:50 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1e0de014-b9e3-4c24-a96b-b852ad3c01ff tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:30:50 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1e0de014-b9e3-4c24-a96b-b852ad3c01ff tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:30:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1e0de014-b9e3-4c24-a96b-b852ad3c01ff tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:30:50 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1e0de014-b9e3-4c24-a96b-b852ad3c01ff tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:30:50 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-1e0de014-b9e3-4c24-a96b-b852ad3c01ff tempest-CreateVolumesFromSourceVolumeTest-759799975 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:30:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1e0de014-b9e3-4c24-a96b-b852ad3c01ff tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-80bf7b5a-22e2-440c-8991-c80752d72278 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5818f381-9e18-4835-ba9a-620877e701f3 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (722cb592-e41f-4e76-a0ea-a79044028124) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c5f830e-a037-4bf9-a6a8-dc610dff0333', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5818f381-9e18-4835-ba9a-620877e701f3 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30d4883d-034a-4fb7-b6a5-fef41f3fbd2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:50 devstack sudo[107039]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-be6e5953-e966-486a-96f9-235ff2c75bc9 tempest-CreateVolumesFromSnapshotTest-1515403536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8216c52a-a5e7-4469-889c-e540cb326b1b.4bf03d0d-2ab2-4e2a-a2ba-1f61179d318e" returned: 0 in 0.351s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:50 devstack sudo[107045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-80bf7b5a-22e2-440c-8991-c80752d72278 1073741824 Nov 04 12:30:50 devstack sudo[107045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:50 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-5818f381-9e18-4835-ba9a-620877e701f3 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Volume volume-5c5f830e-a037-4bf9-a6a8-dc610dff0333 (5c5f830e-a037-4bf9-a6a8-dc610dff0333): created successfully Nov 04 12:30:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5818f381-9e18-4835-ba9a-620877e701f3 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30d4883d-034a-4fb7-b6a5-fef41f3fbd2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5818f381-9e18-4835-ba9a-620877e701f3 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Flow 'volume_create_manager' (94781b22-46f7-4c69-9b5d-f0427e981f86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:30:50 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-be6e5953-e966-486a-96f9-235ff2c75bc9 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Lock "cinder-quobyte-4bf03d0d-2ab2-4e2a-a2ba-1f61179d318e" released by "_delete_snapshot" :: held 1.986s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:30:50 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-5818f381-9e18-4835-ba9a-620877e701f3 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Created volume successfully. Nov 04 12:30:50 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-be6e5953-e966-486a-96f9-235ff2c75bc9 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Lock "cinder-quobyte-8216c52a-a5e7-4469-889c-e540cb326b1b" released by "delete_snapshot" :: held 2.034s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:30:50 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-be6e5953-e966-486a-96f9-235ff2c75bc9 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Created reservations ['e99f6855-f473-4a4f-87ea-9ae946356071', 'd41dd962-1036-44bc-bbd0-6a271c0cc1ed', '47307335-75f5-4e98-bca4-3a6131bcfdef', 'b1479e27-9046-4328-bd6a-7d45b6de5c37'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:30:50 devstack sudo[107041]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ae234f1e-7d41-4c8c-9b69-5230bfdf63fa tempest-ProjectMemberTests-1539753999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1aecec0f-0dfe-4b9a-b059-7bce61824c62" returned: 0 in 0.527s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ae234f1e-7d41-4c8c-9b69-5230bfdf63fa tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1aecec0f-0dfe-4b9a-b059-7bce61824c62.877ba83d-947f-4082-91a3-e8c1f7b1be0a {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:50 devstack sudo[107050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1aecec0f-0dfe-4b9a-b059-7bce61824c62.877ba83d-947f-4082-91a3-e8c1f7b1be0a Nov 04 12:30:50 devstack sudo[107050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:50 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-be6e5953-e966-486a-96f9-235ff2c75bc9 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Delete snapshot completed successfully. Nov 04 12:30:50 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-be6e5953-e966-486a-96f9-235ff2c75bc9 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Lock "cinder-4bf03d0d-2ab2-4e2a-a2ba-1f61179d318e-delete_snapshot" released by "delete_snapshot" :: held 2.307s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:30:51 devstack sudo[107045]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1e0de014-b9e3-4c24-a96b-b852ad3c01ff tempest-CreateVolumesFromSourceVolumeTest-759799975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-80bf7b5a-22e2-440c-8991-c80752d72278 1073741824" returned: 0 in 0.676s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1e0de014-b9e3-4c24-a96b-b852ad3c01ff tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-80bf7b5a-22e2-440c-8991-c80752d72278 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:51 devstack sudo[107060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-80bf7b5a-22e2-440c-8991-c80752d72278 Nov 04 12:30:51 devstack sudo[107060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:51 devstack sudo[107050]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ae234f1e-7d41-4c8c-9b69-5230bfdf63fa tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1aecec0f-0dfe-4b9a-b059-7bce61824c62.877ba83d-947f-4082-91a3-e8c1f7b1be0a" returned: 0 in 0.465s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ae234f1e-7d41-4c8c-9b69-5230bfdf63fa tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1aecec0f-0dfe-4b9a-b059-7bce61824c62.877ba83d-947f-4082-91a3-e8c1f7b1be0a {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:51 devstack sudo[107062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1aecec0f-0dfe-4b9a-b059-7bce61824c62.877ba83d-947f-4082-91a3-e8c1f7b1be0a Nov 04 12:30:51 devstack sudo[107062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:51 devstack sudo[107060]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1e0de014-b9e3-4c24-a96b-b852ad3c01ff tempest-CreateVolumesFromSourceVolumeTest-759799975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-80bf7b5a-22e2-440c-8991-c80752d72278" returned: 0 in 0.294s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:51 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1e0de014-b9e3-4c24-a96b-b852ad3c01ff tempest-CreateVolumesFromSourceVolumeTest-759799975 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:30:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1e0de014-b9e3-4c24-a96b-b852ad3c01ff tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:30:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f8ed10ab-51d2-42a9-9237-6db5ec57eaf4 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.146s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:30:51 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f8ed10ab-51d2-42a9-9237-6db5ec57eaf4 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:30:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-499512049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec112a92-7b9d-4cba-9138-70278b4041e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0adb9e5356a342da8acaeec2df63cd9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:30:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:30:48Z,use_quota=True,user_id='31c497d042bd4fa7acaddd962d6b6e1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:30:51 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-f8ed10ab-51d2-42a9-9237-6db5ec57eaf4 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Creating volume ec112a92-7b9d-4cba-9138-70278b4041e6 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:30:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f8ed10ab-51d2-42a9-9237-6db5ec57eaf4 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:30:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f8ed10ab-51d2-42a9-9237-6db5ec57eaf4 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:30:51 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f8ed10ab-51d2-42a9-9237-6db5ec57eaf4 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:30:51 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f8ed10ab-51d2-42a9-9237-6db5ec57eaf4 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:30:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f8ed10ab-51d2-42a9-9237-6db5ec57eaf4 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:30:51 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f8ed10ab-51d2-42a9-9237-6db5ec57eaf4 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:30:51 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-f8ed10ab-51d2-42a9-9237-6db5ec57eaf4 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:30:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f8ed10ab-51d2-42a9-9237-6db5ec57eaf4 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ec112a92-7b9d-4cba-9138-70278b4041e6 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:51 devstack sudo[107062]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1e0de014-b9e3-4c24-a96b-b852ad3c01ff tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f6e2a9a-0fed-4e05-a925-1ed471e83724) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80bf7b5a-22e2-440c-8991-c80752d72278', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1e0de014-b9e3-4c24-a96b-b852ad3c01ff tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12aa61ed-5016-4d9e-9d5e-92d1db922b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:51 devstack sudo[107066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ec112a92-7b9d-4cba-9138-70278b4041e6 1073741824 Nov 04 12:30:51 devstack sudo[107066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ae234f1e-7d41-4c8c-9b69-5230bfdf63fa tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1aecec0f-0dfe-4b9a-b059-7bce61824c62.877ba83d-947f-4082-91a3-e8c1f7b1be0a" returned: 0 in 0.304s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:51 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-1e0de014-b9e3-4c24-a96b-b852ad3c01ff tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Volume volume-80bf7b5a-22e2-440c-8991-c80752d72278 (80bf7b5a-22e2-440c-8991-c80752d72278): created successfully Nov 04 12:30:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1e0de014-b9e3-4c24-a96b-b852ad3c01ff tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12aa61ed-5016-4d9e-9d5e-92d1db922b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1e0de014-b9e3-4c24-a96b-b852ad3c01ff tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Flow 'volume_create_manager' (7d1549f2-8a27-481e-b23e-bc9747461ef7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:30:51 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ae234f1e-7d41-4c8c-9b69-5230bfdf63fa tempest-ProjectMemberTests-1539753999 None] Lock "cinder-quobyte-877ba83d-947f-4082-91a3-e8c1f7b1be0a" released by "_delete_snapshot" :: held 1.948s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:30:51 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ae234f1e-7d41-4c8c-9b69-5230bfdf63fa tempest-ProjectMemberTests-1539753999 None] Lock "cinder-quobyte-1aecec0f-0dfe-4b9a-b059-7bce61824c62" released by "delete_snapshot" :: held 1.991s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:30:51 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-1e0de014-b9e3-4c24-a96b-b852ad3c01ff tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Created volume successfully. Nov 04 12:30:51 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-ae234f1e-7d41-4c8c-9b69-5230bfdf63fa tempest-ProjectMemberTests-1539753999 None] Created reservations ['61f3adc9-adc1-4dbd-b565-37cb4a9ae141', 'd6564e57-df2b-4f37-b04a-ec3f39d58a6d', '9df47a2e-285f-4c54-9577-3494ada1c9d1', 'c8e6b545-a834-4709-b174-eaac0754a335'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:30:51 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-73819a04-41a3-44e2-9ea6-d7ccf067f569 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Acquiring lock "cinder-8216c52a-a5e7-4469-889c-e540cb326b1b-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:30:51 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-73819a04-41a3-44e2-9ea6-d7ccf067f569 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Lock "cinder-8216c52a-a5e7-4469-889c-e540cb326b1b-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:30:51 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-ae234f1e-7d41-4c8c-9b69-5230bfdf63fa tempest-ProjectMemberTests-1539753999 None] Delete snapshot completed successfully. Nov 04 12:30:51 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ae234f1e-7d41-4c8c-9b69-5230bfdf63fa tempest-ProjectMemberTests-1539753999 None] Lock "cinder-877ba83d-947f-4082-91a3-e8c1f7b1be0a-delete_snapshot" released by "delete_snapshot" :: held 2.280s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:30:51 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-73819a04-41a3-44e2-9ea6-d7ccf067f569 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Acquiring lock "cinder-quobyte-8216c52a-a5e7-4469-889c-e540cb326b1b" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:30:51 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-73819a04-41a3-44e2-9ea6-d7ccf067f569 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Lock "cinder-quobyte-8216c52a-a5e7-4469-889c-e540cb326b1b" acquired by "delete_volume" :: waited 0.018s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:30:51 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de470fb-7a53-4276-8937-0283c533d0a2]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:30:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-73819a04-41a3-44e2-9ea6-d7ccf067f569 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8216c52a-a5e7-4469-889c-e540cb326b1b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:52 devstack sudo[107071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8216c52a-a5e7-4469-889c-e540cb326b1b Nov 04 12:30:52 devstack sudo[107071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:52 devstack sudo[107066]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f8ed10ab-51d2-42a9-9237-6db5ec57eaf4 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ec112a92-7b9d-4cba-9138-70278b4041e6 1073741824" returned: 0 in 0.660s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f8ed10ab-51d2-42a9-9237-6db5ec57eaf4 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ec112a92-7b9d-4cba-9138-70278b4041e6 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:52 devstack sudo[107074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ec112a92-7b9d-4cba-9138-70278b4041e6 Nov 04 12:30:52 devstack sudo[107074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:52 devstack sudo[107071]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-73819a04-41a3-44e2-9ea6-d7ccf067f569 tempest-CreateVolumesFromSnapshotTest-1515403536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8216c52a-a5e7-4469-889c-e540cb326b1b" returned: 0 in 0.450s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-73819a04-41a3-44e2-9ea6-d7ccf067f569 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8216c52a-a5e7-4469-889c-e540cb326b1b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:52 devstack sudo[107079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8216c52a-a5e7-4469-889c-e540cb326b1b Nov 04 12:30:52 devstack sudo[107079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:52 devstack sudo[107074]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f8ed10ab-51d2-42a9-9237-6db5ec57eaf4 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ec112a92-7b9d-4cba-9138-70278b4041e6" returned: 0 in 0.272s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:52 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f8ed10ab-51d2-42a9-9237-6db5ec57eaf4 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:30:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f8ed10ab-51d2-42a9-9237-6db5ec57eaf4 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:30:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e1cbf8ff-187c-45b9-a46e-836ee10f6a47 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.641s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:30:52 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e1cbf8ff-187c-45b9-a46e-836ee10f6a47 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:30:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-289949458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=832ab111-d69e-478a-adfe-61c2d06ee270,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0adb9e5356a342da8acaeec2df63cd9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:30:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:30:49Z,use_quota=True,user_id='31c497d042bd4fa7acaddd962d6b6e1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:30:52 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-e1cbf8ff-187c-45b9-a46e-836ee10f6a47 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Creating volume 832ab111-d69e-478a-adfe-61c2d06ee270 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:30:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e1cbf8ff-187c-45b9-a46e-836ee10f6a47 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:30:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e1cbf8ff-187c-45b9-a46e-836ee10f6a47 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:30:52 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e1cbf8ff-187c-45b9-a46e-836ee10f6a47 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:30:52 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e1cbf8ff-187c-45b9-a46e-836ee10f6a47 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:30:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e1cbf8ff-187c-45b9-a46e-836ee10f6a47 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:30:52 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e1cbf8ff-187c-45b9-a46e-836ee10f6a47 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:30:52 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-e1cbf8ff-187c-45b9-a46e-836ee10f6a47 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:30:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e1cbf8ff-187c-45b9-a46e-836ee10f6a47 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-832ab111-d69e-478a-adfe-61c2d06ee270 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f8ed10ab-51d2-42a9-9237-6db5ec57eaf4 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a8ff635-0e76-45dd-abf1-a94163a3621d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec112a92-7b9d-4cba-9138-70278b4041e6', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f8ed10ab-51d2-42a9-9237-6db5ec57eaf4 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53dabc63-8871-4187-b352-4e2de5c6db8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:52 devstack sudo[107082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-832ab111-d69e-478a-adfe-61c2d06ee270 1073741824 Nov 04 12:30:52 devstack sudo[107082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:52 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-f8ed10ab-51d2-42a9-9237-6db5ec57eaf4 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Volume volume-ec112a92-7b9d-4cba-9138-70278b4041e6 (ec112a92-7b9d-4cba-9138-70278b4041e6): created successfully Nov 04 12:30:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f8ed10ab-51d2-42a9-9237-6db5ec57eaf4 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53dabc63-8871-4187-b352-4e2de5c6db8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f8ed10ab-51d2-42a9-9237-6db5ec57eaf4 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Flow 'volume_create_manager' (374437ca-83e0-47cb-b55d-9d38e26042c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:30:52 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-f8ed10ab-51d2-42a9-9237-6db5ec57eaf4 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Created volume successfully. Nov 04 12:30:52 devstack sudo[107079]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-73819a04-41a3-44e2-9ea6-d7ccf067f569 tempest-CreateVolumesFromSnapshotTest-1515403536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8216c52a-a5e7-4469-889c-e540cb326b1b" returned: 0 in 0.317s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-73819a04-41a3-44e2-9ea6-d7ccf067f569 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Lock "cinder-quobyte-8216c52a-a5e7-4469-889c-e540cb326b1b" released by "delete_volume" :: held 0.867s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:30:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0c1e5969-9455-456a-b388-f657200cb6ed tempest-ProjectMemberTests-1539753999 None] Acquiring lock "cinder-1aecec0f-0dfe-4b9a-b059-7bce61824c62-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:30:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0c1e5969-9455-456a-b388-f657200cb6ed tempest-ProjectMemberTests-1539753999 None] Lock "cinder-1aecec0f-0dfe-4b9a-b059-7bce61824c62-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:30:52 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-73819a04-41a3-44e2-9ea6-d7ccf067f569 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Created reservations ['8538fdaf-1edd-4322-ad4b-05105eeb2326', 'b9f7be24-62ec-4815-bd82-c974093b1109', 'b9de541f-3e50-47e2-b375-a780aaac478c', '5eb5ff44-e944-4357-a412-d54429c34ba6'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:30:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0c1e5969-9455-456a-b388-f657200cb6ed tempest-ProjectMemberTests-1539753999 None] Acquiring lock "cinder-quobyte-1aecec0f-0dfe-4b9a-b059-7bce61824c62" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:30:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0c1e5969-9455-456a-b388-f657200cb6ed tempest-ProjectMemberTests-1539753999 None] Lock "cinder-quobyte-1aecec0f-0dfe-4b9a-b059-7bce61824c62" acquired by "delete_volume" :: waited 0.028s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:30:52 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c102fa-7ac3-44c0-90ab-b01ac6cd3b59]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:30:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0c1e5969-9455-456a-b388-f657200cb6ed tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1aecec0f-0dfe-4b9a-b059-7bce61824c62 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-73819a04-41a3-44e2-9ea6-d7ccf067f569 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:30:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-73819a04-41a3-44e2-9ea6-d7ccf067f569 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:30:52 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-73819a04-41a3-44e2-9ea6-d7ccf067f569 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:30:52 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-73819a04-41a3-44e2-9ea6-d7ccf067f569 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:30:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-73819a04-41a3-44e2-9ea6-d7ccf067f569 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:30:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-73819a04-41a3-44e2-9ea6-d7ccf067f569 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:52 devstack sudo[107090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:30:52 devstack sudo[107090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:53 devstack sudo[107089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1aecec0f-0dfe-4b9a-b059-7bce61824c62 Nov 04 12:30:53 devstack sudo[107089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:53 devstack sudo[107082]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e1cbf8ff-187c-45b9-a46e-836ee10f6a47 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-832ab111-d69e-478a-adfe-61c2d06ee270 1073741824" returned: 0 in 0.698s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e1cbf8ff-187c-45b9-a46e-836ee10f6a47 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-832ab111-d69e-478a-adfe-61c2d06ee270 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:53 devstack sudo[107093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-832ab111-d69e-478a-adfe-61c2d06ee270 Nov 04 12:30:53 devstack sudo[107093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:53 devstack sudo[107090]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-73819a04-41a3-44e2-9ea6-d7ccf067f569 tempest-CreateVolumesFromSnapshotTest-1515403536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.414s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:53 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-73819a04-41a3-44e2-9ea6-d7ccf067f569 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:30:53 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-73819a04-41a3-44e2-9ea6-d7ccf067f569 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Deleted volume successfully. Nov 04 12:30:53 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-73819a04-41a3-44e2-9ea6-d7ccf067f569 tempest-CreateVolumesFromSnapshotTest-1515403536 None] Lock "cinder-8216c52a-a5e7-4469-889c-e540cb326b1b-delete_volume" released by "delete_volume" :: held 1.708s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:30:53 devstack sudo[107089]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0c1e5969-9455-456a-b388-f657200cb6ed tempest-ProjectMemberTests-1539753999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1aecec0f-0dfe-4b9a-b059-7bce61824c62" returned: 0 in 0.599s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:53 devstack sudo[107093]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0c1e5969-9455-456a-b388-f657200cb6ed tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1aecec0f-0dfe-4b9a-b059-7bce61824c62 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e1cbf8ff-187c-45b9-a46e-836ee10f6a47 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-832ab111-d69e-478a-adfe-61c2d06ee270" returned: 0 in 0.374s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:53 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e1cbf8ff-187c-45b9-a46e-836ee10f6a47 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] <== create_volume: return (1140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:30:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e1cbf8ff-187c-45b9-a46e-836ee10f6a47 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.143s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:30:53 devstack sudo[107101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1aecec0f-0dfe-4b9a-b059-7bce61824c62 Nov 04 12:30:53 devstack sudo[107101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:53 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e1cbf8ff-187c-45b9-a46e-836ee10f6a47 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19568632-cdf7-4e62-bb7a-583177612ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-832ab111-d69e-478a-adfe-61c2d06ee270', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:53 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e1cbf8ff-187c-45b9-a46e-836ee10f6a47 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad8397a4-d482-4764-89cb-990e7095f6ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:53 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-e1cbf8ff-187c-45b9-a46e-836ee10f6a47 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Volume volume-832ab111-d69e-478a-adfe-61c2d06ee270 (832ab111-d69e-478a-adfe-61c2d06ee270): created successfully Nov 04 12:30:53 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e1cbf8ff-187c-45b9-a46e-836ee10f6a47 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad8397a4-d482-4764-89cb-990e7095f6ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:53 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e1cbf8ff-187c-45b9-a46e-836ee10f6a47 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Flow 'volume_create_manager' (cdbe475a-d756-48fd-88b3-9f240482f49c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:30:53 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-e1cbf8ff-187c-45b9-a46e-836ee10f6a47 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Created volume successfully. Nov 04 12:30:53 devstack sudo[107101]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0c1e5969-9455-456a-b388-f657200cb6ed tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1aecec0f-0dfe-4b9a-b059-7bce61824c62" returned: 0 in 0.297s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:53 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0c1e5969-9455-456a-b388-f657200cb6ed tempest-ProjectMemberTests-1539753999 None] Lock "cinder-quobyte-1aecec0f-0dfe-4b9a-b059-7bce61824c62" released by "delete_volume" :: held 1.016s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:30:53 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-0c1e5969-9455-456a-b388-f657200cb6ed tempest-ProjectMemberTests-1539753999 None] Created reservations ['5624bbf8-45c4-4bf7-9fd2-3e62ecd7bc43', 'e47d6110-d081-4fd1-8cee-5a7895d7a7bb', '2013cecb-0b68-4f4f-ae27-6850b3260e6d', 'e5a99fde-ec72-424d-b05f-8e52409589b6'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:30:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0c1e5969-9455-456a-b388-f657200cb6ed tempest-ProjectMemberTests-1539753999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:30:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0c1e5969-9455-456a-b388-f657200cb6ed tempest-ProjectMemberTests-1539753999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:30:54 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0c1e5969-9455-456a-b388-f657200cb6ed tempest-ProjectMemberTests-1539753999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:30:54 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0c1e5969-9455-456a-b388-f657200cb6ed tempest-ProjectMemberTests-1539753999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:30:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0c1e5969-9455-456a-b388-f657200cb6ed tempest-ProjectMemberTests-1539753999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:30:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0c1e5969-9455-456a-b388-f657200cb6ed tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:54 devstack sudo[107104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:30:54 devstack sudo[107104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:54 devstack sudo[107104]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0c1e5969-9455-456a-b388-f657200cb6ed tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.314s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:54 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-0c1e5969-9455-456a-b388-f657200cb6ed tempest-ProjectMemberTests-1539753999 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:30:54 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-0c1e5969-9455-456a-b388-f657200cb6ed tempest-ProjectMemberTests-1539753999 None] Deleted volume successfully. Nov 04 12:30:54 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-66459b7f-827e-49df-af44-f536373ae0d2 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Acquiring lock "cinder-832ab111-d69e-478a-adfe-61c2d06ee270-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:30:54 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0c1e5969-9455-456a-b388-f657200cb6ed tempest-ProjectMemberTests-1539753999 None] Lock "cinder-1aecec0f-0dfe-4b9a-b059-7bce61824c62-delete_volume" released by "delete_volume" :: held 1.721s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:30:54 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-66459b7f-827e-49df-af44-f536373ae0d2 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Lock "cinder-832ab111-d69e-478a-adfe-61c2d06ee270-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:30:54 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-66459b7f-827e-49df-af44-f536373ae0d2 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Acquiring lock "cinder-quobyte-832ab111-d69e-478a-adfe-61c2d06ee270" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:30:54 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-66459b7f-827e-49df-af44-f536373ae0d2 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Lock "cinder-quobyte-832ab111-d69e-478a-adfe-61c2d06ee270" acquired by "delete_volume" :: waited 0.021s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:30:54 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42a9b09-1937-4114-8f3e-b0464683b0dc]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:30:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-66459b7f-827e-49df-af44-f536373ae0d2 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-832ab111-d69e-478a-adfe-61c2d06ee270 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:54 devstack sudo[107107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-832ab111-d69e-478a-adfe-61c2d06ee270 Nov 04 12:30:54 devstack sudo[107107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:55 devstack sudo[107107]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-66459b7f-827e-49df-af44-f536373ae0d2 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-832ab111-d69e-478a-adfe-61c2d06ee270" returned: 0 in 0.456s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-66459b7f-827e-49df-af44-f536373ae0d2 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-832ab111-d69e-478a-adfe-61c2d06ee270 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:55 devstack sudo[107113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-832ab111-d69e-478a-adfe-61c2d06ee270 Nov 04 12:30:55 devstack sudo[107113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:55 devstack sudo[107113]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-66459b7f-827e-49df-af44-f536373ae0d2 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-832ab111-d69e-478a-adfe-61c2d06ee270" returned: 0 in 0.420s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:55 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-66459b7f-827e-49df-af44-f536373ae0d2 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Lock "cinder-quobyte-832ab111-d69e-478a-adfe-61c2d06ee270" released by "delete_volume" :: held 0.936s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:30:55 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-66459b7f-827e-49df-af44-f536373ae0d2 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Created reservations ['402f3a01-226c-4c10-a085-ba4b270e9ec9', '5b597cc5-3525-4c65-ac8e-68ed5dbc92f3', '8b4dd8e2-8558-40f6-9fec-477006ca3f9c', '0543736c-a620-41cb-84a3-e6c79b8fc468'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:30:55 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e9a03e4-5630-48dc-ad4d-d83bca768047 tempest-ProjectMemberTests-1539753999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:30:55 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0e9a03e4-5630-48dc-ad4d-d83bca768047 tempest-ProjectMemberTests-1539753999 None] Flow 'volume_create_manager' (a18d0ace-51c7-4351-bfaa-7311c9baaff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:30:55 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0e9a03e4-5630-48dc-ad4d-d83bca768047 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aec358e9-2b56-434e-977a-0f277419d72d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:55 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0e9a03e4-5630-48dc-ad4d-d83bca768047 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aec358e9-2b56-434e-977a-0f277419d72d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:30:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-92989558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd994b0e-0948-4df6-b626-14a94f6b0d5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cb67397f4d04f049564f5d284f139d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:30:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:30:55Z,use_quota=True,user_id='091b86592c99419b9c07a685e7933341',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:55 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0e9a03e4-5630-48dc-ad4d-d83bca768047 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea2feb03-54d7-45c1-bd48-ffd287d211c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:55 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0e9a03e4-5630-48dc-ad4d-d83bca768047 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea2feb03-54d7-45c1-bd48-ffd287d211c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:55 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0e9a03e4-5630-48dc-ad4d-d83bca768047 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fd09010-ad71-47ef-9ac5-2cd502c84458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:55 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0e9a03e4-5630-48dc-ad4d-d83bca768047 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fd09010-ad71-47ef-9ac5-2cd502c84458) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd994b0e-0948-4df6-b626-14a94f6b0d5a', 'volume_name': 'volume-dd994b0e-0948-4df6-b626-14a94f6b0d5a', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:55 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0e9a03e4-5630-48dc-ad4d-d83bca768047 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14841ffe-0f91-49ea-9c4b-f8472366f9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:55 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0e9a03e4-5630-48dc-ad4d-d83bca768047 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14841ffe-0f91-49ea-9c4b-f8472366f9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:55 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0e9a03e4-5630-48dc-ad4d-d83bca768047 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a0504a3-3652-4aef-8823-39765ac888ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:55 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-0e9a03e4-5630-48dc-ad4d-d83bca768047 tempest-ProjectMemberTests-1539753999 None] Volume dd994b0e-0948-4df6-b626-14a94f6b0d5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd994b0e-0948-4df6-b626-14a94f6b0d5a', 'volume_size': 1} Nov 04 12:30:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0e9a03e4-5630-48dc-ad4d-d83bca768047 tempest-ProjectMemberTests-1539753999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:30:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0e9a03e4-5630-48dc-ad4d-d83bca768047 tempest-ProjectMemberTests-1539753999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:30:55 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0e9a03e4-5630-48dc-ad4d-d83bca768047 tempest-ProjectMemberTests-1539753999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:30:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-92989558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd994b0e-0948-4df6-b626-14a94f6b0d5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cb67397f4d04f049564f5d284f139d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:30:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:30:55Z,use_quota=True,user_id='091b86592c99419b9c07a685e7933341',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:30:55 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-0e9a03e4-5630-48dc-ad4d-d83bca768047 tempest-ProjectMemberTests-1539753999 None] Creating volume dd994b0e-0948-4df6-b626-14a94f6b0d5a {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:30:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0e9a03e4-5630-48dc-ad4d-d83bca768047 tempest-ProjectMemberTests-1539753999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:30:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0e9a03e4-5630-48dc-ad4d-d83bca768047 tempest-ProjectMemberTests-1539753999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:30:55 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0e9a03e4-5630-48dc-ad4d-d83bca768047 tempest-ProjectMemberTests-1539753999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:30:55 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0e9a03e4-5630-48dc-ad4d-d83bca768047 tempest-ProjectMemberTests-1539753999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:30:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0e9a03e4-5630-48dc-ad4d-d83bca768047 tempest-ProjectMemberTests-1539753999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:30:55 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0e9a03e4-5630-48dc-ad4d-d83bca768047 tempest-ProjectMemberTests-1539753999 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:30:55 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-0e9a03e4-5630-48dc-ad4d-d83bca768047 tempest-ProjectMemberTests-1539753999 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:30:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0e9a03e4-5630-48dc-ad4d-d83bca768047 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-dd994b0e-0948-4df6-b626-14a94f6b0d5a 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:55 devstack sudo[107116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-dd994b0e-0948-4df6-b626-14a94f6b0d5a 1073741824 Nov 04 12:30:55 devstack sudo[107116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-66459b7f-827e-49df-af44-f536373ae0d2 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:30:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-66459b7f-827e-49df-af44-f536373ae0d2 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:30:55 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-66459b7f-827e-49df-af44-f536373ae0d2 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:30:55 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-66459b7f-827e-49df-af44-f536373ae0d2 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:30:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-66459b7f-827e-49df-af44-f536373ae0d2 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:30:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-66459b7f-827e-49df-af44-f536373ae0d2 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:55 devstack sudo[107118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:30:55 devstack sudo[107118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:56 devstack sudo[107118]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-66459b7f-827e-49df-af44-f536373ae0d2 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.382s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:56 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-66459b7f-827e-49df-af44-f536373ae0d2 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:30:56 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-66459b7f-827e-49df-af44-f536373ae0d2 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Deleted volume successfully. Nov 04 12:30:56 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-66459b7f-827e-49df-af44-f536373ae0d2 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Lock "cinder-832ab111-d69e-478a-adfe-61c2d06ee270-delete_volume" released by "delete_volume" :: held 1.784s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:30:56 devstack sudo[107116]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0e9a03e4-5630-48dc-ad4d-d83bca768047 tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-dd994b0e-0948-4df6-b626-14a94f6b0d5a 1073741824" returned: 0 in 0.622s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0e9a03e4-5630-48dc-ad4d-d83bca768047 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-dd994b0e-0948-4df6-b626-14a94f6b0d5a {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:56 devstack sudo[107125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-dd994b0e-0948-4df6-b626-14a94f6b0d5a Nov 04 12:30:56 devstack sudo[107125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:56 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f837f7d4-ff0d-451f-a6de-cf07bfa5240d tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Acquiring lock "cinder-ec112a92-7b9d-4cba-9138-70278b4041e6-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:30:56 devstack sudo[107125]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0e9a03e4-5630-48dc-ad4d-d83bca768047 tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-dd994b0e-0948-4df6-b626-14a94f6b0d5a" returned: 0 in 0.383s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:56 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0e9a03e4-5630-48dc-ad4d-d83bca768047 tempest-ProjectMemberTests-1539753999 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:30:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0e9a03e4-5630-48dc-ad4d-d83bca768047 tempest-ProjectMemberTests-1539753999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:30:56 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f837f7d4-ff0d-451f-a6de-cf07bfa5240d tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Lock "cinder-ec112a92-7b9d-4cba-9138-70278b4041e6-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:30:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0e9a03e4-5630-48dc-ad4d-d83bca768047 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a0504a3-3652-4aef-8823-39765ac888ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd994b0e-0948-4df6-b626-14a94f6b0d5a', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0e9a03e4-5630-48dc-ad4d-d83bca768047 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b409b28-7040-4379-9c45-1767419f343a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:56 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-0e9a03e4-5630-48dc-ad4d-d83bca768047 tempest-ProjectMemberTests-1539753999 None] Volume volume-dd994b0e-0948-4df6-b626-14a94f6b0d5a (dd994b0e-0948-4df6-b626-14a94f6b0d5a): created successfully Nov 04 12:30:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0e9a03e4-5630-48dc-ad4d-d83bca768047 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b409b28-7040-4379-9c45-1767419f343a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0e9a03e4-5630-48dc-ad4d-d83bca768047 tempest-ProjectMemberTests-1539753999 None] Flow 'volume_create_manager' (a18d0ace-51c7-4351-bfaa-7311c9baaff3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:30:56 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f837f7d4-ff0d-451f-a6de-cf07bfa5240d tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Acquiring lock "cinder-quobyte-ec112a92-7b9d-4cba-9138-70278b4041e6" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:30:56 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-0e9a03e4-5630-48dc-ad4d-d83bca768047 tempest-ProjectMemberTests-1539753999 None] Created volume successfully. Nov 04 12:30:56 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f837f7d4-ff0d-451f-a6de-cf07bfa5240d tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Lock "cinder-quobyte-ec112a92-7b9d-4cba-9138-70278b4041e6" acquired by "delete_volume" :: waited 0.040s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:30:56 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c09fd6-b566-4a70-b241-a2d054530a05]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:30:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f837f7d4-ff0d-451f-a6de-cf07bfa5240d tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ec112a92-7b9d-4cba-9138-70278b4041e6 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:57 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9df97ab-66c0-429a-8264-336fe909aad6 tempest-CinderUnicodeTest-13571817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:30:57 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c9df97ab-66c0-429a-8264-336fe909aad6 tempest-CinderUnicodeTest-13571817 None] Flow 'volume_create_manager' (4dcd3617-4f8e-4ae2-9c1b-5dfc486315b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:30:57 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c9df97ab-66c0-429a-8264-336fe909aad6 tempest-CinderUnicodeTest-13571817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f295231-2a40-49f6-8674-35cf153439a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:57 devstack sudo[107128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ec112a92-7b9d-4cba-9138-70278b4041e6 Nov 04 12:30:57 devstack sudo[107128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:57 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c9df97ab-66c0-429a-8264-336fe909aad6 tempest-CinderUnicodeTest-13571817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f295231-2a40-49f6-8674-35cf153439a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:30:57Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab0f1aaa-1ad3-49ad-974f-a6f79a2b80a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5784e34a6e2349c29112310f1c8d644e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:30:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:30:57Z,use_quota=True,user_id='da9e14c9a67e4e9488959f9aa5bc2ae5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:57 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c9df97ab-66c0-429a-8264-336fe909aad6 tempest-CinderUnicodeTest-13571817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ce5604c-cbb2-4d21-a7f3-e61f9c57742a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:57 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c9df97ab-66c0-429a-8264-336fe909aad6 tempest-CinderUnicodeTest-13571817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ce5604c-cbb2-4d21-a7f3-e61f9c57742a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:57 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c9df97ab-66c0-429a-8264-336fe909aad6 tempest-CinderUnicodeTest-13571817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48eb4510-6364-4f04-9322-b1ef19f95c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:57 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c9df97ab-66c0-429a-8264-336fe909aad6 tempest-CinderUnicodeTest-13571817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48eb4510-6364-4f04-9322-b1ef19f95c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab0f1aaa-1ad3-49ad-974f-a6f79a2b80a4', 'volume_name': 'volume-ab0f1aaa-1ad3-49ad-974f-a6f79a2b80a4', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:57 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c9df97ab-66c0-429a-8264-336fe909aad6 tempest-CinderUnicodeTest-13571817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdc561cf-eef6-4936-855e-8a2072c2a82e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:57 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c9df97ab-66c0-429a-8264-336fe909aad6 tempest-CinderUnicodeTest-13571817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdc561cf-eef6-4936-855e-8a2072c2a82e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:57 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c9df97ab-66c0-429a-8264-336fe909aad6 tempest-CinderUnicodeTest-13571817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11c579f1-4d51-48e8-8e90-e31db1be742b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:57 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-c9df97ab-66c0-429a-8264-336fe909aad6 tempest-CinderUnicodeTest-13571817 None] Volume ab0f1aaa-1ad3-49ad-974f-a6f79a2b80a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab0f1aaa-1ad3-49ad-974f-a6f79a2b80a4', 'volume_size': 1} Nov 04 12:30:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c9df97ab-66c0-429a-8264-336fe909aad6 tempest-CinderUnicodeTest-13571817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:30:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c9df97ab-66c0-429a-8264-336fe909aad6 tempest-CinderUnicodeTest-13571817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:30:57 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c9df97ab-66c0-429a-8264-336fe909aad6 tempest-CinderUnicodeTest-13571817 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:30:57Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab0f1aaa-1ad3-49ad-974f-a6f79a2b80a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5784e34a6e2349c29112310f1c8d644e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:30:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:30:57Z,use_quota=True,user_id='da9e14c9a67e4e9488959f9aa5bc2ae5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:30:57 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-c9df97ab-66c0-429a-8264-336fe909aad6 tempest-CinderUnicodeTest-13571817 None] Creating volume ab0f1aaa-1ad3-49ad-974f-a6f79a2b80a4 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:30:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c9df97ab-66c0-429a-8264-336fe909aad6 tempest-CinderUnicodeTest-13571817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:30:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c9df97ab-66c0-429a-8264-336fe909aad6 tempest-CinderUnicodeTest-13571817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:30:57 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c9df97ab-66c0-429a-8264-336fe909aad6 tempest-CinderUnicodeTest-13571817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:30:57 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c9df97ab-66c0-429a-8264-336fe909aad6 tempest-CinderUnicodeTest-13571817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:30:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c9df97ab-66c0-429a-8264-336fe909aad6 tempest-CinderUnicodeTest-13571817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:30:57 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c9df97ab-66c0-429a-8264-336fe909aad6 tempest-CinderUnicodeTest-13571817 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:30:57 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-c9df97ab-66c0-429a-8264-336fe909aad6 tempest-CinderUnicodeTest-13571817 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:30:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c9df97ab-66c0-429a-8264-336fe909aad6 tempest-CinderUnicodeTest-13571817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ab0f1aaa-1ad3-49ad-974f-a6f79a2b80a4 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:57 devstack sudo[107130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ab0f1aaa-1ad3-49ad-974f-a6f79a2b80a4 1073741824 Nov 04 12:30:57 devstack sudo[107130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:57 devstack sudo[107128]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f837f7d4-ff0d-451f-a6de-cf07bfa5240d tempest-CreateVolumesFromSourceVolumeTest-759799975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ec112a92-7b9d-4cba-9138-70278b4041e6" returned: 0 in 0.443s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f837f7d4-ff0d-451f-a6de-cf07bfa5240d tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ec112a92-7b9d-4cba-9138-70278b4041e6 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:57 devstack sudo[107138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ec112a92-7b9d-4cba-9138-70278b4041e6 Nov 04 12:30:57 devstack sudo[107138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:57 devstack sudo[107138]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f837f7d4-ff0d-451f-a6de-cf07bfa5240d tempest-CreateVolumesFromSourceVolumeTest-759799975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ec112a92-7b9d-4cba-9138-70278b4041e6" returned: 0 in 0.303s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:57 devstack sudo[107130]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c9df97ab-66c0-429a-8264-336fe909aad6 tempest-CinderUnicodeTest-13571817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ab0f1aaa-1ad3-49ad-974f-a6f79a2b80a4 1073741824" returned: 0 in 0.561s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:57 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f837f7d4-ff0d-451f-a6de-cf07bfa5240d tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Lock "cinder-quobyte-ec112a92-7b9d-4cba-9138-70278b4041e6" released by "delete_volume" :: held 0.819s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:30:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c9df97ab-66c0-429a-8264-336fe909aad6 tempest-CinderUnicodeTest-13571817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ab0f1aaa-1ad3-49ad-974f-a6f79a2b80a4 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:57 devstack sudo[107142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ab0f1aaa-1ad3-49ad-974f-a6f79a2b80a4 Nov 04 12:30:57 devstack sudo[107142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:57 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-f837f7d4-ff0d-451f-a6de-cf07bfa5240d tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Created reservations ['abfb1dbe-ed44-4047-aad6-16c33faebed6', 'b27289e3-70d2-4798-bea3-9b74a1a799ef', 'a01dcb36-3b47-47cf-973c-283fe1a9a968', '0befd5d8-574a-4c93-970a-283bac6bc082'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:30:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-52ef5b91-d9d1-4517-8196-848f8d3697a7 tempest-ProjectMemberTests-1539753999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:30:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f837f7d4-ff0d-451f-a6de-cf07bfa5240d tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:30:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f837f7d4-ff0d-451f-a6de-cf07bfa5240d tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:30:57 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f837f7d4-ff0d-451f-a6de-cf07bfa5240d tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:30:57 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f837f7d4-ff0d-451f-a6de-cf07bfa5240d tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:30:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f837f7d4-ff0d-451f-a6de-cf07bfa5240d tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:30:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f837f7d4-ff0d-451f-a6de-cf07bfa5240d tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:57 devstack sudo[107144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:30:57 devstack sudo[107144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:58 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-44ecff4f-9e3a-4fed-a2be-82f30466d222 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Acquiring lock "cinder-80bf7b5a-22e2-440c-8991-c80752d72278-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:30:58 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-44ecff4f-9e3a-4fed-a2be-82f30466d222 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Lock "cinder-80bf7b5a-22e2-440c-8991-c80752d72278-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:30:58 devstack sudo[107142]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:58 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-44ecff4f-9e3a-4fed-a2be-82f30466d222 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Acquiring lock "cinder-quobyte-80bf7b5a-22e2-440c-8991-c80752d72278" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:30:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c9df97ab-66c0-429a-8264-336fe909aad6 tempest-CinderUnicodeTest-13571817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ab0f1aaa-1ad3-49ad-974f-a6f79a2b80a4" returned: 0 in 0.332s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:58 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c9df97ab-66c0-429a-8264-336fe909aad6 tempest-CinderUnicodeTest-13571817 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:30:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c9df97ab-66c0-429a-8264-336fe909aad6 tempest-CinderUnicodeTest-13571817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:30:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-52ef5b91-d9d1-4517-8196-848f8d3697a7 tempest-ProjectMemberTests-1539753999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.272s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:30:58 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-52ef5b91-d9d1-4517-8196-848f8d3697a7 tempest-ProjectMemberTests-1539753999 None] Creating offline snapshot dd302969-4f81-47f0-ab50-37f6984dba3b of volume dd994b0e-0948-4df6-b626-14a94f6b0d5a {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 12:30:58 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-44ecff4f-9e3a-4fed-a2be-82f30466d222 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Lock "cinder-quobyte-80bf7b5a-22e2-440c-8991-c80752d72278" acquired by "delete_volume" :: waited 0.038s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:30:58 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c9df97ab-66c0-429a-8264-336fe909aad6 tempest-CinderUnicodeTest-13571817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11c579f1-4d51-48e8-8e90-e31db1be742b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab0f1aaa-1ad3-49ad-974f-a6f79a2b80a4', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:58 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c9df97ab-66c0-429a-8264-336fe909aad6 tempest-CinderUnicodeTest-13571817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd5f1162-d285-456f-a578-e104e5295664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:30:58 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dca6eb9-0a49-4f1c-8d2f-a22657e7e8d3]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:30:58 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee20aa2-5bb9-46f3-9281-ef693d456694]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:30:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-52ef5b91-d9d1-4517-8196-848f8d3697a7 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-dd994b0e-0948-4df6-b626-14a94f6b0d5a {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-44ecff4f-9e3a-4fed-a2be-82f30466d222 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-80bf7b5a-22e2-440c-8991-c80752d72278 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:58 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-c9df97ab-66c0-429a-8264-336fe909aad6 tempest-CinderUnicodeTest-13571817 None] Volume volume-ab0f1aaa-1ad3-49ad-974f-a6f79a2b80a4 (ab0f1aaa-1ad3-49ad-974f-a6f79a2b80a4): created successfully Nov 04 12:30:58 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c9df97ab-66c0-429a-8264-336fe909aad6 tempest-CinderUnicodeTest-13571817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd5f1162-d285-456f-a578-e104e5295664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:30:58 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c9df97ab-66c0-429a-8264-336fe909aad6 tempest-CinderUnicodeTest-13571817 None] Flow 'volume_create_manager' (4dcd3617-4f8e-4ae2-9c1b-5dfc486315b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:30:58 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-c9df97ab-66c0-429a-8264-336fe909aad6 tempest-CinderUnicodeTest-13571817 None] Created volume successfully. Nov 04 12:30:58 devstack sudo[107144]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f837f7d4-ff0d-451f-a6de-cf07bfa5240d tempest-CreateVolumesFromSourceVolumeTest-759799975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.385s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:58 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-f837f7d4-ff0d-451f-a6de-cf07bfa5240d tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:30:58 devstack sudo[107147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-dd994b0e-0948-4df6-b626-14a94f6b0d5a Nov 04 12:30:58 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-f837f7d4-ff0d-451f-a6de-cf07bfa5240d tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Deleted volume successfully. Nov 04 12:30:58 devstack sudo[107147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:58 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f837f7d4-ff0d-451f-a6de-cf07bfa5240d tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Lock "cinder-ec112a92-7b9d-4cba-9138-70278b4041e6-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:30:58 devstack sudo[107148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-80bf7b5a-22e2-440c-8991-c80752d72278 Nov 04 12:30:58 devstack sudo[107148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:58 devstack sudo[107147]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-52ef5b91-d9d1-4517-8196-848f8d3697a7 tempest-ProjectMemberTests-1539753999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-dd994b0e-0948-4df6-b626-14a94f6b0d5a" returned: 0 in 0.437s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-52ef5b91-d9d1-4517-8196-848f8d3697a7 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-dd994b0e-0948-4df6-b626-14a94f6b0d5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-dd994b0e-0948-4df6-b626-14a94f6b0d5a.dd302969-4f81-47f0-ab50-37f6984dba3b 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:58 devstack sudo[107148]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-44ecff4f-9e3a-4fed-a2be-82f30466d222 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-80bf7b5a-22e2-440c-8991-c80752d72278" returned: 0 in 0.458s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:58 devstack sudo[107158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-dd994b0e-0948-4df6-b626-14a94f6b0d5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-dd994b0e-0948-4df6-b626-14a94f6b0d5a.dd302969-4f81-47f0-ab50-37f6984dba3b 1G Nov 04 12:30:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-44ecff4f-9e3a-4fed-a2be-82f30466d222 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-80bf7b5a-22e2-440c-8991-c80752d72278 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:58 devstack sudo[107158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:58 devstack sudo[107160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-80bf7b5a-22e2-440c-8991-c80752d72278 Nov 04 12:30:58 devstack sudo[107160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:58 devstack sudo[107160]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-44ecff4f-9e3a-4fed-a2be-82f30466d222 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-80bf7b5a-22e2-440c-8991-c80752d72278" returned: 0 in 0.278s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:58 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-44ecff4f-9e3a-4fed-a2be-82f30466d222 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Lock "cinder-quobyte-80bf7b5a-22e2-440c-8991-c80752d72278" released by "delete_volume" :: held 0.809s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:30:59 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-44ecff4f-9e3a-4fed-a2be-82f30466d222 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Created reservations ['1f05e13d-c957-4bfa-b677-be38fe944c09', '030ed2f5-04a3-4785-877d-37dddefc5aae', 'cfadb6f5-15a9-47a3-aeeb-53fc1dd385aa', 'e57f0da8-ba4c-44dd-962c-175452f65275'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:30:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-44ecff4f-9e3a-4fed-a2be-82f30466d222 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:30:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-44ecff4f-9e3a-4fed-a2be-82f30466d222 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:30:59 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-44ecff4f-9e3a-4fed-a2be-82f30466d222 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:30:59 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-44ecff4f-9e3a-4fed-a2be-82f30466d222 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:30:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-44ecff4f-9e3a-4fed-a2be-82f30466d222 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:30:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-44ecff4f-9e3a-4fed-a2be-82f30466d222 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:59 devstack sudo[107158]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-52ef5b91-d9d1-4517-8196-848f8d3697a7 tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-dd994b0e-0948-4df6-b626-14a94f6b0d5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-dd994b0e-0948-4df6-b626-14a94f6b0d5a.dd302969-4f81-47f0-ab50-37f6984dba3b 1G" returned: 0 in 0.627s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-52ef5b91-d9d1-4517-8196-848f8d3697a7 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd994b0e-0948-4df6-b626-14a94f6b0d5a -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-dd994b0e-0948-4df6-b626-14a94f6b0d5a.dd302969-4f81-47f0-ab50-37f6984dba3b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:59 devstack sudo[107167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:30:59 devstack sudo[107167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:59 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-99650995-a6e0-4eee-91ce-30951db8d5d9 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Acquiring lock "cinder-5c5f830e-a037-4bf9-a6a8-dc610dff0333-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:30:59 devstack sudo[107169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd994b0e-0948-4df6-b626-14a94f6b0d5a -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-dd994b0e-0948-4df6-b626-14a94f6b0d5a.dd302969-4f81-47f0-ab50-37f6984dba3b Nov 04 12:30:59 devstack sudo[107169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:59 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-99650995-a6e0-4eee-91ce-30951db8d5d9 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Lock "cinder-5c5f830e-a037-4bf9-a6a8-dc610dff0333-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:30:59 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-99650995-a6e0-4eee-91ce-30951db8d5d9 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Acquiring lock "cinder-quobyte-5c5f830e-a037-4bf9-a6a8-dc610dff0333" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:30:59 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-99650995-a6e0-4eee-91ce-30951db8d5d9 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Lock "cinder-quobyte-5c5f830e-a037-4bf9-a6a8-dc610dff0333" acquired by "delete_volume" :: waited 0.028s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:30:59 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c59c2df-2e31-40bc-a492-a92b253b6203]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:30:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-99650995-a6e0-4eee-91ce-30951db8d5d9 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-5c5f830e-a037-4bf9-a6a8-dc610dff0333 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:59 devstack sudo[107167]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-44ecff4f-9e3a-4fed-a2be-82f30466d222 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.473s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:59 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-44ecff4f-9e3a-4fed-a2be-82f30466d222 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:30:59 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-44ecff4f-9e3a-4fed-a2be-82f30466d222 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Deleted volume successfully. Nov 04 12:30:59 devstack sudo[107171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-5c5f830e-a037-4bf9-a6a8-dc610dff0333 Nov 04 12:30:59 devstack sudo[107171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:59 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-44ecff4f-9e3a-4fed-a2be-82f30466d222 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Lock "cinder-80bf7b5a-22e2-440c-8991-c80752d72278-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:30:59 devstack sudo[107169]: pam_unix(sudo:session): session closed for user root Nov 04 12:30:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-52ef5b91-d9d1-4517-8196-848f8d3697a7 tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd994b0e-0948-4df6-b626-14a94f6b0d5a -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-dd994b0e-0948-4df6-b626-14a94f6b0d5a.dd302969-4f81-47f0-ab50-37f6984dba3b" returned: 0 in 0.553s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:30:59 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-52ef5b91-d9d1-4517-8196-848f8d3697a7 tempest-ProjectMemberTests-1539753999 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-dd994b0e-0948-4df6-b626-14a94f6b0d5a.dd302969-4f81-47f0-ab50-37f6984dba3b is being set with open permissions: ugo+rw Nov 04 12:30:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-52ef5b91-d9d1-4517-8196-848f8d3697a7 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-dd994b0e-0948-4df6-b626-14a94f6b0d5a.dd302969-4f81-47f0-ab50-37f6984dba3b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:30:59 devstack sudo[107177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-dd994b0e-0948-4df6-b626-14a94f6b0d5a.dd302969-4f81-47f0-ab50-37f6984dba3b Nov 04 12:30:59 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:30:59 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-273806ed-3cfc-4803-8d33-a57ae8b9307b tempest-CinderUnicodeTest-13571817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:31:00 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-273806ed-3cfc-4803-8d33-a57ae8b9307b tempest-CinderUnicodeTest-13571817 None] Flow 'volume_create_manager' (417cb0a1-a2e5-4459-a673-7fc78c90c415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:31:00 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-273806ed-3cfc-4803-8d33-a57ae8b9307b tempest-CinderUnicodeTest-13571817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18c92fcc-a101-460c-af5a-f1554c1f3a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:31:00 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-273806ed-3cfc-4803-8d33-a57ae8b9307b tempest-CinderUnicodeTest-13571817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18c92fcc-a101-460c-af5a-f1554c1f3a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:31:00Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2123373729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d75885a-d3a1-4b76-9c82-b8ee6d1e931e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5784e34a6e2349c29112310f1c8d644e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:31:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:31:00Z,use_quota=True,user_id='da9e14c9a67e4e9488959f9aa5bc2ae5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:31:00 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-273806ed-3cfc-4803-8d33-a57ae8b9307b tempest-CinderUnicodeTest-13571817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fbad755-b69b-4c90-a35f-764aafe40bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:31:00 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-273806ed-3cfc-4803-8d33-a57ae8b9307b tempest-CinderUnicodeTest-13571817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fbad755-b69b-4c90-a35f-764aafe40bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:31:00 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-273806ed-3cfc-4803-8d33-a57ae8b9307b tempest-CinderUnicodeTest-13571817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f82bf53-3d68-4ab6-ad7a-cd108a8ce026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:31:00 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-273806ed-3cfc-4803-8d33-a57ae8b9307b tempest-CinderUnicodeTest-13571817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f82bf53-3d68-4ab6-ad7a-cd108a8ce026) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d75885a-d3a1-4b76-9c82-b8ee6d1e931e', 'volume_name': 'volume-2d75885a-d3a1-4b76-9c82-b8ee6d1e931e', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:31:00 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-273806ed-3cfc-4803-8d33-a57ae8b9307b tempest-CinderUnicodeTest-13571817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c97dc86-7691-4b5e-93ac-873911a745ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:31:00 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-273806ed-3cfc-4803-8d33-a57ae8b9307b tempest-CinderUnicodeTest-13571817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c97dc86-7691-4b5e-93ac-873911a745ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:31:00 devstack sudo[107171]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:00 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-273806ed-3cfc-4803-8d33-a57ae8b9307b tempest-CinderUnicodeTest-13571817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6047cc30-0b53-40e3-8a3b-f47c521ea5a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:31:00 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-273806ed-3cfc-4803-8d33-a57ae8b9307b tempest-CinderUnicodeTest-13571817 None] Volume 2d75885a-d3a1-4b76-9c82-b8ee6d1e931e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d75885a-d3a1-4b76-9c82-b8ee6d1e931e', 'volume_size': 1} Nov 04 12:31:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-273806ed-3cfc-4803-8d33-a57ae8b9307b tempest-CinderUnicodeTest-13571817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:31:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-99650995-a6e0-4eee-91ce-30951db8d5d9 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-5c5f830e-a037-4bf9-a6a8-dc610dff0333" returned: 0 in 0.602s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-99650995-a6e0-4eee-91ce-30951db8d5d9 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-5c5f830e-a037-4bf9-a6a8-dc610dff0333 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:00 devstack sudo[107184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-5c5f830e-a037-4bf9-a6a8-dc610dff0333 Nov 04 12:31:00 devstack sudo[107184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:00 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-52ef5b91-d9d1-4517-8196-848f8d3697a7 tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-dd994b0e-0948-4df6-b626-14a94f6b0d5a.dd302969-4f81-47f0-ab50-37f6984dba3b" returned: 0 in 0.315s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-52ef5b91-d9d1-4517-8196-848f8d3697a7 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-dd994b0e-0948-4df6-b626-14a94f6b0d5a.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:00 devstack sudo[107187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-dd994b0e-0948-4df6-b626-14a94f6b0d5a.info Nov 04 12:31:00 devstack sudo[107187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:00 devstack sudo[107184]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-99650995-a6e0-4eee-91ce-30951db8d5d9 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-5c5f830e-a037-4bf9-a6a8-dc610dff0333" returned: 0 in 0.258s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:00 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-99650995-a6e0-4eee-91ce-30951db8d5d9 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Lock "cinder-quobyte-5c5f830e-a037-4bf9-a6a8-dc610dff0333" released by "delete_volume" :: held 0.954s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:31:00 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-99650995-a6e0-4eee-91ce-30951db8d5d9 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Created reservations ['d8341267-5004-4c34-aee1-9b4f2b7c016f', 'b71ec0b6-53f4-4889-bce3-bb38f9f084bc', '9db59b7c-196e-44b3-b492-492493fd4027', '7f1099f5-f03e-44f5-a808-2e8f72d255c3'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:31:00 devstack sudo[107187]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-52ef5b91-d9d1-4517-8196-848f8d3697a7 tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-dd994b0e-0948-4df6-b626-14a94f6b0d5a.info" returned: 0 in 0.285s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:00 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-52ef5b91-d9d1-4517-8196-848f8d3697a7 tempest-ProjectMemberTests-1539753999 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-dd994b0e-0948-4df6-b626-14a94f6b0d5a.info is being set with open permissions: ugo+rw Nov 04 12:31:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-52ef5b91-d9d1-4517-8196-848f8d3697a7 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-dd994b0e-0948-4df6-b626-14a94f6b0d5a.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:00 devstack sudo[107191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-dd994b0e-0948-4df6-b626-14a94f6b0d5a.info Nov 04 12:31:00 devstack sudo[107191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-99650995-a6e0-4eee-91ce-30951db8d5d9 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:31:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-99650995-a6e0-4eee-91ce-30951db8d5d9 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:31:00 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-99650995-a6e0-4eee-91ce-30951db8d5d9 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:31:00 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-99650995-a6e0-4eee-91ce-30951db8d5d9 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:31:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-99650995-a6e0-4eee-91ce-30951db8d5d9 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:31:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-99650995-a6e0-4eee-91ce-30951db8d5d9 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:00 devstack sudo[107193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:31:00 devstack sudo[107193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:00 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-90599f39-8ad8-44ca-8832-d99cc5ddc86b tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Acquiring lock "cinder-3dc7aebb-620e-4a57-bac6-81f3d8fb173e-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:31:00 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-90599f39-8ad8-44ca-8832-d99cc5ddc86b tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Lock "cinder-3dc7aebb-620e-4a57-bac6-81f3d8fb173e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:31:00 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-90599f39-8ad8-44ca-8832-d99cc5ddc86b tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Acquiring lock "cinder-quobyte-3dc7aebb-620e-4a57-bac6-81f3d8fb173e" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:31:00 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-90599f39-8ad8-44ca-8832-d99cc5ddc86b tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Lock "cinder-quobyte-3dc7aebb-620e-4a57-bac6-81f3d8fb173e" acquired by "delete_volume" :: waited 0.025s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:31:00 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[57338728-f3ec-472f-90b0-497f9337ec21]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:31:00 devstack sudo[107191]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-90599f39-8ad8-44ca-8832-d99cc5ddc86b tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-3dc7aebb-620e-4a57-bac6-81f3d8fb173e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-52ef5b91-d9d1-4517-8196-848f8d3697a7 tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-dd994b0e-0948-4df6-b626-14a94f6b0d5a.info" returned: 0 in 0.317s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-52ef5b91-d9d1-4517-8196-848f8d3697a7 tempest-ProjectMemberTests-1539753999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.676s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:31:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-273806ed-3cfc-4803-8d33-a57ae8b9307b tempest-CinderUnicodeTest-13571817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.729s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:31:00 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-273806ed-3cfc-4803-8d33-a57ae8b9307b tempest-CinderUnicodeTest-13571817 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:31:00Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2123373729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d75885a-d3a1-4b76-9c82-b8ee6d1e931e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5784e34a6e2349c29112310f1c8d644e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:31:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:31:00Z,use_quota=True,user_id='da9e14c9a67e4e9488959f9aa5bc2ae5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:31:00 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-273806ed-3cfc-4803-8d33-a57ae8b9307b tempest-CinderUnicodeTest-13571817 None] Creating volume 2d75885a-d3a1-4b76-9c82-b8ee6d1e931e {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:31:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-273806ed-3cfc-4803-8d33-a57ae8b9307b tempest-CinderUnicodeTest-13571817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:31:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-273806ed-3cfc-4803-8d33-a57ae8b9307b tempest-CinderUnicodeTest-13571817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:31:00 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-273806ed-3cfc-4803-8d33-a57ae8b9307b tempest-CinderUnicodeTest-13571817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:31:00 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-273806ed-3cfc-4803-8d33-a57ae8b9307b tempest-CinderUnicodeTest-13571817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:31:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-273806ed-3cfc-4803-8d33-a57ae8b9307b tempest-CinderUnicodeTest-13571817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:31:00 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-273806ed-3cfc-4803-8d33-a57ae8b9307b tempest-CinderUnicodeTest-13571817 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:31:00 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-273806ed-3cfc-4803-8d33-a57ae8b9307b tempest-CinderUnicodeTest-13571817 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:31:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-273806ed-3cfc-4803-8d33-a57ae8b9307b tempest-CinderUnicodeTest-13571817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2d75885a-d3a1-4b76-9c82-b8ee6d1e931e 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:00 devstack sudo[107193]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-99650995-a6e0-4eee-91ce-30951db8d5d9 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.330s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:00 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-99650995-a6e0-4eee-91ce-30951db8d5d9 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:31:00 devstack sudo[107198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2d75885a-d3a1-4b76-9c82-b8ee6d1e931e 1073741824 Nov 04 12:31:00 devstack sudo[107198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:00 devstack sudo[107196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-3dc7aebb-620e-4a57-bac6-81f3d8fb173e Nov 04 12:31:00 devstack sudo[107196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:00 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-99650995-a6e0-4eee-91ce-30951db8d5d9 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Deleted volume successfully. Nov 04 12:31:00 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-52ef5b91-d9d1-4517-8196-848f8d3697a7 tempest-ProjectMemberTests-1539753999 None] Create snapshot completed successfully Nov 04 12:31:00 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-99650995-a6e0-4eee-91ce-30951db8d5d9 tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Lock "cinder-5c5f830e-a037-4bf9-a6a8-dc610dff0333-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:31:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-315617bf-e304-49d8-87d7-987608d3d842 tempest-ProjectMemberTests-1539753999 None] Acquiring lock "cinder-dd302969-4f81-47f0-ab50-37f6984dba3b-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:31:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-315617bf-e304-49d8-87d7-987608d3d842 tempest-ProjectMemberTests-1539753999 None] Lock "cinder-dd302969-4f81-47f0-ab50-37f6984dba3b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:31:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-315617bf-e304-49d8-87d7-987608d3d842 tempest-ProjectMemberTests-1539753999 None] Acquiring lock "cinder-quobyte-dd994b0e-0948-4df6-b626-14a94f6b0d5a" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:31:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-315617bf-e304-49d8-87d7-987608d3d842 tempest-ProjectMemberTests-1539753999 None] Lock "cinder-quobyte-dd994b0e-0948-4df6-b626-14a94f6b0d5a" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:31:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-315617bf-e304-49d8-87d7-987608d3d842 tempest-ProjectMemberTests-1539753999 None] Acquiring lock "cinder-quobyte-dd302969-4f81-47f0-ab50-37f6984dba3b" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:31:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-315617bf-e304-49d8-87d7-987608d3d842 tempest-ProjectMemberTests-1539753999 None] Lock "cinder-quobyte-dd302969-4f81-47f0-ab50-37f6984dba3b" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:31:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-315617bf-e304-49d8-87d7-987608d3d842 tempest-ProjectMemberTests-1539753999 None] Deleting offline snapshot dd302969-4f81-47f0-ab50-37f6984dba3b of volume dd994b0e-0948-4df6-b626-14a94f6b0d5a {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 12:31:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-315617bf-e304-49d8-87d7-987608d3d842 tempest-ProjectMemberTests-1539753999 None] snapshot_file for this snap is: volume-dd994b0e-0948-4df6-b626-14a94f6b0d5a.dd302969-4f81-47f0-ab50-37f6984dba3b {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 12:31:01 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea583e3-18d0-46d3-ad20-04f4b2125873]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:31:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-315617bf-e304-49d8-87d7-987608d3d842 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-dd994b0e-0948-4df6-b626-14a94f6b0d5a.dd302969-4f81-47f0-ab50-37f6984dba3b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:01 devstack sudo[107196]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-90599f39-8ad8-44ca-8832-d99cc5ddc86b tempest-CreateVolumesFromSourceVolumeTest-759799975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-3dc7aebb-620e-4a57-bac6-81f3d8fb173e" returned: 0 in 0.688s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-90599f39-8ad8-44ca-8832-d99cc5ddc86b tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-3dc7aebb-620e-4a57-bac6-81f3d8fb173e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:01 devstack sudo[107209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-3dc7aebb-620e-4a57-bac6-81f3d8fb173e Nov 04 12:31:01 devstack sudo[107209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:01 devstack sudo[107204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-dd994b0e-0948-4df6-b626-14a94f6b0d5a.dd302969-4f81-47f0-ab50-37f6984dba3b Nov 04 12:31:01 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:01 devstack sudo[107198]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-273806ed-3cfc-4803-8d33-a57ae8b9307b tempest-CinderUnicodeTest-13571817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2d75885a-d3a1-4b76-9c82-b8ee6d1e931e 1073741824" returned: 0 in 0.826s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-273806ed-3cfc-4803-8d33-a57ae8b9307b tempest-CinderUnicodeTest-13571817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2d75885a-d3a1-4b76-9c82-b8ee6d1e931e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:01 devstack sudo[107212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2d75885a-d3a1-4b76-9c82-b8ee6d1e931e Nov 04 12:31:01 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:01 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 12:31:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:31:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:31:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:31:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:31:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:31:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:01 devstack sudo[107209]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-90599f39-8ad8-44ca-8832-d99cc5ddc86b tempest-CreateVolumesFromSourceVolumeTest-759799975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-3dc7aebb-620e-4a57-bac6-81f3d8fb173e" returned: 0 in 0.410s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:01 devstack sudo[107217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:31:01 devstack sudo[107217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-90599f39-8ad8-44ca-8832-d99cc5ddc86b tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Lock "cinder-quobyte-3dc7aebb-620e-4a57-bac6-81f3d8fb173e" released by "delete_volume" :: held 1.171s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:31:01 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:01 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-90599f39-8ad8-44ca-8832-d99cc5ddc86b tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Created reservations ['e6fb81f6-8d3f-4b3f-be1f-7e5c6be26c17', '0ff7726b-0e9d-4952-ab42-9a902b8a39b7', '058a641e-3539-4814-a622-d0749c14fbc5', 'f04aa320-ddc8-417b-941b-2efe1d1d0775'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:31:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-315617bf-e304-49d8-87d7-987608d3d842 tempest-ProjectMemberTests-1539753999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-dd994b0e-0948-4df6-b626-14a94f6b0d5a.dd302969-4f81-47f0-ab50-37f6984dba3b" returned: 0 in 0.685s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:02 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-315617bf-e304-49d8-87d7-987608d3d842 tempest-ProjectMemberTests-1539753999 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd994b0e-0948-4df6-b626-14a94f6b0d5a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 12:31:02 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-273806ed-3cfc-4803-8d33-a57ae8b9307b tempest-CinderUnicodeTest-13571817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2d75885a-d3a1-4b76-9c82-b8ee6d1e931e" returned: 0 in 0.357s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:02 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-273806ed-3cfc-4803-8d33-a57ae8b9307b tempest-CinderUnicodeTest-13571817 None] <== create_volume: return (1235ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:31:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-273806ed-3cfc-4803-8d33-a57ae8b9307b tempest-CinderUnicodeTest-13571817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.240s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:31:02 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7171510-57e5-4288-8b7f-3d70d6180e76]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:31:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-315617bf-e304-49d8-87d7-987608d3d842 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-dd994b0e-0948-4df6-b626-14a94f6b0d5a {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-273806ed-3cfc-4803-8d33-a57ae8b9307b tempest-CinderUnicodeTest-13571817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6047cc30-0b53-40e3-8a3b-f47c521ea5a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d75885a-d3a1-4b76-9c82-b8ee6d1e931e', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:31:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-273806ed-3cfc-4803-8d33-a57ae8b9307b tempest-CinderUnicodeTest-13571817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8be8ae57-05d1-4a4c-a5dc-142b93cdd5ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:31:02 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-273806ed-3cfc-4803-8d33-a57ae8b9307b tempest-CinderUnicodeTest-13571817 None] Volume volume-2d75885a-d3a1-4b76-9c82-b8ee6d1e931e (2d75885a-d3a1-4b76-9c82-b8ee6d1e931e): created successfully Nov 04 12:31:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-273806ed-3cfc-4803-8d33-a57ae8b9307b tempest-CinderUnicodeTest-13571817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8be8ae57-05d1-4a4c-a5dc-142b93cdd5ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:31:02 devstack sudo[107217]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-273806ed-3cfc-4803-8d33-a57ae8b9307b tempest-CinderUnicodeTest-13571817 None] Flow 'volume_create_manager' (417cb0a1-a2e5-4459-a673-7fc78c90c415) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:31:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.332s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:02 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:31:02 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Running periodic task VolumeManager._thread_info {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 12:31:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] thread count: 28 {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 12:31:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] thread info: [<_MainThread(MainThread, started 140610387472512)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 12:31:02 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-273806ed-3cfc-4803-8d33-a57ae8b9307b tempest-CinderUnicodeTest-13571817 None] Created volume successfully. Nov 04 12:31:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-90599f39-8ad8-44ca-8832-d99cc5ddc86b tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:31:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-90599f39-8ad8-44ca-8832-d99cc5ddc86b tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:31:02 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-90599f39-8ad8-44ca-8832-d99cc5ddc86b tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:31:02 devstack sudo[107221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-dd994b0e-0948-4df6-b626-14a94f6b0d5a Nov 04 12:31:02 devstack sudo[107221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:02 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-90599f39-8ad8-44ca-8832-d99cc5ddc86b tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:31:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-90599f39-8ad8-44ca-8832-d99cc5ddc86b tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:31:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-90599f39-8ad8-44ca-8832-d99cc5ddc86b tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:02 devstack sudo[107224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:31:02 devstack sudo[107224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:02 devstack sudo[107224]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-90599f39-8ad8-44ca-8832-d99cc5ddc86b tempest-CreateVolumesFromSourceVolumeTest-759799975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.285s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:02 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-90599f39-8ad8-44ca-8832-d99cc5ddc86b tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:31:02 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-90599f39-8ad8-44ca-8832-d99cc5ddc86b tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Deleted volume successfully. Nov 04 12:31:02 devstack sudo[107221]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-315617bf-e304-49d8-87d7-987608d3d842 tempest-ProjectMemberTests-1539753999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-dd994b0e-0948-4df6-b626-14a94f6b0d5a" returned: 0 in 0.471s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-315617bf-e304-49d8-87d7-987608d3d842 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-dd994b0e-0948-4df6-b626-14a94f6b0d5a.dd302969-4f81-47f0-ab50-37f6984dba3b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:02 devstack sudo[107230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-dd994b0e-0948-4df6-b626-14a94f6b0d5a.dd302969-4f81-47f0-ab50-37f6984dba3b Nov 04 12:31:02 devstack sudo[107230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:02 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-90599f39-8ad8-44ca-8832-d99cc5ddc86b tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Lock "cinder-3dc7aebb-620e-4a57-bac6-81f3d8fb173e-delete_volume" released by "delete_volume" :: held 1.935s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:31:02 devstack sudo[107230]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-315617bf-e304-49d8-87d7-987608d3d842 tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-dd994b0e-0948-4df6-b626-14a94f6b0d5a.dd302969-4f81-47f0-ab50-37f6984dba3b" returned: 0 in 0.394s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-315617bf-e304-49d8-87d7-987608d3d842 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-dd994b0e-0948-4df6-b626-14a94f6b0d5a.dd302969-4f81-47f0-ab50-37f6984dba3b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:02 devstack sudo[107235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-dd994b0e-0948-4df6-b626-14a94f6b0d5a.dd302969-4f81-47f0-ab50-37f6984dba3b Nov 04 12:31:02 devstack sudo[107235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:03 devstack sudo[107235]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-315617bf-e304-49d8-87d7-987608d3d842 tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-dd994b0e-0948-4df6-b626-14a94f6b0d5a.dd302969-4f81-47f0-ab50-37f6984dba3b" returned: 0 in 0.300s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:03 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-2109dfb4-b557-44e8-b49e-feeb042f498e tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Acquiring lock "cinder-78a9d6d1-06cb-4df9-bf05-75e3337f5e4c-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:31:03 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-2109dfb4-b557-44e8-b49e-feeb042f498e tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Lock "cinder-78a9d6d1-06cb-4df9-bf05-75e3337f5e4c-delete_volume" acquired by "delete_volume" :: waited 0.095s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:31:03 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-315617bf-e304-49d8-87d7-987608d3d842 tempest-ProjectMemberTests-1539753999 None] Lock "cinder-quobyte-dd302969-4f81-47f0-ab50-37f6984dba3b" released by "_delete_snapshot" :: held 2.097s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:31:03 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-315617bf-e304-49d8-87d7-987608d3d842 tempest-ProjectMemberTests-1539753999 None] Lock "cinder-quobyte-dd994b0e-0948-4df6-b626-14a94f6b0d5a" released by "delete_snapshot" :: held 2.160s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:31:03 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-2109dfb4-b557-44e8-b49e-feeb042f498e tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Acquiring lock "cinder-quobyte-78a9d6d1-06cb-4df9-bf05-75e3337f5e4c" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:31:03 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-2109dfb4-b557-44e8-b49e-feeb042f498e tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Lock "cinder-quobyte-78a9d6d1-06cb-4df9-bf05-75e3337f5e4c" acquired by "delete_volume" :: waited 0.030s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:31:03 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaad5e82-286e-49a7-afd9-97951504f52f]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:31:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2109dfb4-b557-44e8-b49e-feeb042f498e tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-78a9d6d1-06cb-4df9-bf05-75e3337f5e4c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:03 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-315617bf-e304-49d8-87d7-987608d3d842 tempest-ProjectMemberTests-1539753999 None] Created reservations ['566514cc-f552-470d-8fcb-8cdf30a26b22', 'a6874035-cb6b-4c9c-97fd-6737aa5e5774', 'c7df6d16-2b47-41f1-a48e-09a5baf8c34c', 'f387ff7f-3b4e-4bbe-a3a8-cd84fc92b064'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:31:03 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-315617bf-e304-49d8-87d7-987608d3d842 tempest-ProjectMemberTests-1539753999 None] Delete snapshot completed successfully. Nov 04 12:31:03 devstack sudo[107239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-78a9d6d1-06cb-4df9-bf05-75e3337f5e4c Nov 04 12:31:03 devstack sudo[107239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:03 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-315617bf-e304-49d8-87d7-987608d3d842 tempest-ProjectMemberTests-1539753999 None] Lock "cinder-dd302969-4f81-47f0-ab50-37f6984dba3b-delete_snapshot" released by "delete_snapshot" :: held 2.485s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:31:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d0a1b438-c1db-4aa5-a108-16d92cd08f99 tempest-CinderUnicodeTest-13571817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:31:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d0a1b438-c1db-4aa5-a108-16d92cd08f99 tempest-CinderUnicodeTest-13571817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:31:03 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-d0a1b438-c1db-4aa5-a108-16d92cd08f99 tempest-CinderUnicodeTest-13571817 None] Creating offline snapshot 58982733-e812-4f82-9f2b-e5c82162a310 of volume 2d75885a-d3a1-4b76-9c82-b8ee6d1e931e {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 12:31:03 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[20bb9224-bcd6-4833-b4b9-6e6b047e0e2d]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:31:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d0a1b438-c1db-4aa5-a108-16d92cd08f99 tempest-CinderUnicodeTest-13571817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2d75885a-d3a1-4b76-9c82-b8ee6d1e931e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:03 devstack sudo[107241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2d75885a-d3a1-4b76-9c82-b8ee6d1e931e Nov 04 12:31:03 devstack sudo[107241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:03 devstack sudo[107239]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2109dfb4-b557-44e8-b49e-feeb042f498e tempest-CreateVolumesFromSourceVolumeTest-759799975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-78a9d6d1-06cb-4df9-bf05-75e3337f5e4c" returned: 0 in 0.494s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2109dfb4-b557-44e8-b49e-feeb042f498e tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-78a9d6d1-06cb-4df9-bf05-75e3337f5e4c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:03 devstack sudo[107247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-78a9d6d1-06cb-4df9-bf05-75e3337f5e4c Nov 04 12:31:03 devstack sudo[107247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:04 devstack sudo[107241]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d0a1b438-c1db-4aa5-a108-16d92cd08f99 tempest-CinderUnicodeTest-13571817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2d75885a-d3a1-4b76-9c82-b8ee6d1e931e" returned: 0 in 0.505s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d0a1b438-c1db-4aa5-a108-16d92cd08f99 tempest-CinderUnicodeTest-13571817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2d75885a-d3a1-4b76-9c82-b8ee6d1e931e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2d75885a-d3a1-4b76-9c82-b8ee6d1e931e.58982733-e812-4f82-9f2b-e5c82162a310 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:04 devstack sudo[107253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2d75885a-d3a1-4b76-9c82-b8ee6d1e931e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2d75885a-d3a1-4b76-9c82-b8ee6d1e931e.58982733-e812-4f82-9f2b-e5c82162a310 1G Nov 04 12:31:04 devstack sudo[107253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:04 devstack sudo[107247]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2109dfb4-b557-44e8-b49e-feeb042f498e tempest-CreateVolumesFromSourceVolumeTest-759799975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-78a9d6d1-06cb-4df9-bf05-75e3337f5e4c" returned: 0 in 0.346s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:04 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-2109dfb4-b557-44e8-b49e-feeb042f498e tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Lock "cinder-quobyte-78a9d6d1-06cb-4df9-bf05-75e3337f5e4c" released by "delete_volume" :: held 0.915s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:31:04 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-2109dfb4-b557-44e8-b49e-feeb042f498e tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Created reservations ['8a2d7ae7-8a42-4e48-a586-3480a5662779', '1bccbae6-579a-496d-8e35-a33ba1052e5f', '195c10e5-e676-40b8-82b5-527927dee2e2', 'f2931699-ee13-4ad3-b48c-706a11cc4aa5'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:31:04 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-806a2d94-dc3f-4153-9dd1-ea0c5c727959 tempest-ProjectMemberTests-1539753999 None] Acquiring lock "cinder-dd994b0e-0948-4df6-b626-14a94f6b0d5a-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:31:04 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-806a2d94-dc3f-4153-9dd1-ea0c5c727959 tempest-ProjectMemberTests-1539753999 None] Lock "cinder-dd994b0e-0948-4df6-b626-14a94f6b0d5a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:31:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2109dfb4-b557-44e8-b49e-feeb042f498e tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:31:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2109dfb4-b557-44e8-b49e-feeb042f498e tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:31:04 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2109dfb4-b557-44e8-b49e-feeb042f498e tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:31:04 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2109dfb4-b557-44e8-b49e-feeb042f498e tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:31:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2109dfb4-b557-44e8-b49e-feeb042f498e tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:31:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2109dfb4-b557-44e8-b49e-feeb042f498e tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:04 devstack sudo[107256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:31:04 devstack sudo[107256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:04 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-806a2d94-dc3f-4153-9dd1-ea0c5c727959 tempest-ProjectMemberTests-1539753999 None] Acquiring lock "cinder-quobyte-dd994b0e-0948-4df6-b626-14a94f6b0d5a" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:31:04 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-806a2d94-dc3f-4153-9dd1-ea0c5c727959 tempest-ProjectMemberTests-1539753999 None] Lock "cinder-quobyte-dd994b0e-0948-4df6-b626-14a94f6b0d5a" acquired by "delete_volume" :: waited 0.019s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:31:04 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b612181-e392-47f4-aec7-77c262c399d4]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:31:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-806a2d94-dc3f-4153-9dd1-ea0c5c727959 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-dd994b0e-0948-4df6-b626-14a94f6b0d5a {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:04 devstack sudo[107260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-dd994b0e-0948-4df6-b626-14a94f6b0d5a Nov 04 12:31:04 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:04 devstack sudo[107253]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d0a1b438-c1db-4aa5-a108-16d92cd08f99 tempest-CinderUnicodeTest-13571817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2d75885a-d3a1-4b76-9c82-b8ee6d1e931e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2d75885a-d3a1-4b76-9c82-b8ee6d1e931e.58982733-e812-4f82-9f2b-e5c82162a310 1G" returned: 0 in 0.662s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d0a1b438-c1db-4aa5-a108-16d92cd08f99 tempest-CinderUnicodeTest-13571817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d75885a-d3a1-4b76-9c82-b8ee6d1e931e -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2d75885a-d3a1-4b76-9c82-b8ee6d1e931e.58982733-e812-4f82-9f2b-e5c82162a310 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:04 devstack sudo[107264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d75885a-d3a1-4b76-9c82-b8ee6d1e931e -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2d75885a-d3a1-4b76-9c82-b8ee6d1e931e.58982733-e812-4f82-9f2b-e5c82162a310 Nov 04 12:31:04 devstack sudo[107264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:04 devstack sudo[107256]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2109dfb4-b557-44e8-b49e-feeb042f498e tempest-CreateVolumesFromSourceVolumeTest-759799975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.386s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:04 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-2109dfb4-b557-44e8-b49e-feeb042f498e tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:31:04 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-2109dfb4-b557-44e8-b49e-feeb042f498e tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Deleted volume successfully. Nov 04 12:31:04 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-2109dfb4-b557-44e8-b49e-feeb042f498e tempest-CreateVolumesFromSourceVolumeTest-759799975 None] Lock "cinder-78a9d6d1-06cb-4df9-bf05-75e3337f5e4c-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:31:05 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-806a2d94-dc3f-4153-9dd1-ea0c5c727959 tempest-ProjectMemberTests-1539753999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-dd994b0e-0948-4df6-b626-14a94f6b0d5a" returned: 0 in 0.491s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-806a2d94-dc3f-4153-9dd1-ea0c5c727959 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-dd994b0e-0948-4df6-b626-14a94f6b0d5a {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:05 devstack sudo[107264]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d0a1b438-c1db-4aa5-a108-16d92cd08f99 tempest-CinderUnicodeTest-13571817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d75885a-d3a1-4b76-9c82-b8ee6d1e931e -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2d75885a-d3a1-4b76-9c82-b8ee6d1e931e.58982733-e812-4f82-9f2b-e5c82162a310" returned: 0 in 0.325s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:05 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-d0a1b438-c1db-4aa5-a108-16d92cd08f99 tempest-CinderUnicodeTest-13571817 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2d75885a-d3a1-4b76-9c82-b8ee6d1e931e.58982733-e812-4f82-9f2b-e5c82162a310 is being set with open permissions: ugo+rw Nov 04 12:31:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d0a1b438-c1db-4aa5-a108-16d92cd08f99 tempest-CinderUnicodeTest-13571817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2d75885a-d3a1-4b76-9c82-b8ee6d1e931e.58982733-e812-4f82-9f2b-e5c82162a310 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:05 devstack sudo[107272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-dd994b0e-0948-4df6-b626-14a94f6b0d5a Nov 04 12:31:05 devstack sudo[107272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:05 devstack sudo[107274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2d75885a-d3a1-4b76-9c82-b8ee6d1e931e.58982733-e812-4f82-9f2b-e5c82162a310 Nov 04 12:31:05 devstack sudo[107274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:05 devstack sudo[107272]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-806a2d94-dc3f-4153-9dd1-ea0c5c727959 tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-dd994b0e-0948-4df6-b626-14a94f6b0d5a" returned: 0 in 0.269s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:05 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-806a2d94-dc3f-4153-9dd1-ea0c5c727959 tempest-ProjectMemberTests-1539753999 None] Lock "cinder-quobyte-dd994b0e-0948-4df6-b626-14a94f6b0d5a" released by "delete_volume" :: held 0.864s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:31:05 devstack sudo[107274]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d0a1b438-c1db-4aa5-a108-16d92cd08f99 tempest-CinderUnicodeTest-13571817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2d75885a-d3a1-4b76-9c82-b8ee6d1e931e.58982733-e812-4f82-9f2b-e5c82162a310" returned: 0 in 0.295s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d0a1b438-c1db-4aa5-a108-16d92cd08f99 tempest-CinderUnicodeTest-13571817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2d75885a-d3a1-4b76-9c82-b8ee6d1e931e.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:05 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-806a2d94-dc3f-4153-9dd1-ea0c5c727959 tempest-ProjectMemberTests-1539753999 None] Created reservations ['6096ea34-0923-4dd5-9078-850d7fed7995', 'b4a1c8bf-0a72-4746-8731-4a28ed5e0510', 'e30ae768-d125-4ec3-a500-078e09164e3f', '0aeb0865-7b68-4f58-902e-8717afcac514'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:31:05 devstack sudo[107278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2d75885a-d3a1-4b76-9c82-b8ee6d1e931e.info Nov 04 12:31:05 devstack sudo[107278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-806a2d94-dc3f-4153-9dd1-ea0c5c727959 tempest-ProjectMemberTests-1539753999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:31:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-806a2d94-dc3f-4153-9dd1-ea0c5c727959 tempest-ProjectMemberTests-1539753999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:31:05 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-806a2d94-dc3f-4153-9dd1-ea0c5c727959 tempest-ProjectMemberTests-1539753999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:31:05 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-806a2d94-dc3f-4153-9dd1-ea0c5c727959 tempest-ProjectMemberTests-1539753999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:31:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-806a2d94-dc3f-4153-9dd1-ea0c5c727959 tempest-ProjectMemberTests-1539753999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:31:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-806a2d94-dc3f-4153-9dd1-ea0c5c727959 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:05 devstack sudo[107280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:31:05 devstack sudo[107280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:06 devstack sudo[107278]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d0a1b438-c1db-4aa5-a108-16d92cd08f99 tempest-CinderUnicodeTest-13571817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2d75885a-d3a1-4b76-9c82-b8ee6d1e931e.info" returned: 0 in 0.535s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:06 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-d0a1b438-c1db-4aa5-a108-16d92cd08f99 tempest-CinderUnicodeTest-13571817 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2d75885a-d3a1-4b76-9c82-b8ee6d1e931e.info is being set with open permissions: ugo+rw Nov 04 12:31:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d0a1b438-c1db-4aa5-a108-16d92cd08f99 tempest-CinderUnicodeTest-13571817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2d75885a-d3a1-4b76-9c82-b8ee6d1e931e.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:06 devstack sudo[107284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2d75885a-d3a1-4b76-9c82-b8ee6d1e931e.info Nov 04 12:31:06 devstack sudo[107284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:06 devstack sudo[107280]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-806a2d94-dc3f-4153-9dd1-ea0c5c727959 tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.471s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:06 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-806a2d94-dc3f-4153-9dd1-ea0c5c727959 tempest-ProjectMemberTests-1539753999 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:31:06 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-806a2d94-dc3f-4153-9dd1-ea0c5c727959 tempest-ProjectMemberTests-1539753999 None] Deleted volume successfully. Nov 04 12:31:06 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-806a2d94-dc3f-4153-9dd1-ea0c5c727959 tempest-ProjectMemberTests-1539753999 None] Lock "cinder-dd994b0e-0948-4df6-b626-14a94f6b0d5a-delete_volume" released by "delete_volume" :: held 1.742s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:31:06 devstack sudo[107284]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d0a1b438-c1db-4aa5-a108-16d92cd08f99 tempest-CinderUnicodeTest-13571817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2d75885a-d3a1-4b76-9c82-b8ee6d1e931e.info" returned: 0 in 0.333s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d0a1b438-c1db-4aa5-a108-16d92cd08f99 tempest-CinderUnicodeTest-13571817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.791s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:31:06 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-d0a1b438-c1db-4aa5-a108-16d92cd08f99 tempest-CinderUnicodeTest-13571817 None] Create snapshot completed successfully Nov 04 12:31:06 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff48df74-2070-4e85-9cbc-29e72d0e01d1 tempest-ProjectMemberTests-1539753999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:31:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ff48df74-2070-4e85-9cbc-29e72d0e01d1 tempest-ProjectMemberTests-1539753999 None] Flow 'volume_create_manager' (391783f8-fc27-496e-abea-f621a7ffb686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:31:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ff48df74-2070-4e85-9cbc-29e72d0e01d1 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c7e2274-987a-4377-8eff-9c19f9eacd6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:31:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ff48df74-2070-4e85-9cbc-29e72d0e01d1 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c7e2274-987a-4377-8eff-9c19f9eacd6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:31:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2056765975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1c22f3d-902a-456b-9789-2d965a4d096b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cb67397f4d04f049564f5d284f139d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:31:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:31:06Z,use_quota=True,user_id='091b86592c99419b9c07a685e7933341',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:31:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ff48df74-2070-4e85-9cbc-29e72d0e01d1 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (121fcac3-55dd-4249-b5b7-300e9abdd817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:31:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ff48df74-2070-4e85-9cbc-29e72d0e01d1 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (121fcac3-55dd-4249-b5b7-300e9abdd817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:31:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ff48df74-2070-4e85-9cbc-29e72d0e01d1 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7cd1a7d-6fab-4a07-8b82-724dd263df98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:31:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ff48df74-2070-4e85-9cbc-29e72d0e01d1 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7cd1a7d-6fab-4a07-8b82-724dd263df98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1c22f3d-902a-456b-9789-2d965a4d096b', 'volume_name': 'volume-a1c22f3d-902a-456b-9789-2d965a4d096b', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:31:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ff48df74-2070-4e85-9cbc-29e72d0e01d1 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (754770e2-5d51-4c61-8bb8-e7e384959a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:31:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ff48df74-2070-4e85-9cbc-29e72d0e01d1 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (754770e2-5d51-4c61-8bb8-e7e384959a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:31:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ff48df74-2070-4e85-9cbc-29e72d0e01d1 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4332c6a8-e41c-4072-bf1c-fb84a0507345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:31:06 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-ff48df74-2070-4e85-9cbc-29e72d0e01d1 tempest-ProjectMemberTests-1539753999 None] Volume a1c22f3d-902a-456b-9789-2d965a4d096b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1c22f3d-902a-456b-9789-2d965a4d096b', 'volume_size': 1} Nov 04 12:31:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ff48df74-2070-4e85-9cbc-29e72d0e01d1 tempest-ProjectMemberTests-1539753999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:31:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ff48df74-2070-4e85-9cbc-29e72d0e01d1 tempest-ProjectMemberTests-1539753999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:31:06 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ff48df74-2070-4e85-9cbc-29e72d0e01d1 tempest-ProjectMemberTests-1539753999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:31:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2056765975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1c22f3d-902a-456b-9789-2d965a4d096b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cb67397f4d04f049564f5d284f139d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:31:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:31:06Z,use_quota=True,user_id='091b86592c99419b9c07a685e7933341',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:31:06 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-ff48df74-2070-4e85-9cbc-29e72d0e01d1 tempest-ProjectMemberTests-1539753999 None] Creating volume a1c22f3d-902a-456b-9789-2d965a4d096b {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:31:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ff48df74-2070-4e85-9cbc-29e72d0e01d1 tempest-ProjectMemberTests-1539753999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:31:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ff48df74-2070-4e85-9cbc-29e72d0e01d1 tempest-ProjectMemberTests-1539753999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:31:06 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ff48df74-2070-4e85-9cbc-29e72d0e01d1 tempest-ProjectMemberTests-1539753999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:31:06 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ff48df74-2070-4e85-9cbc-29e72d0e01d1 tempest-ProjectMemberTests-1539753999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:31:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ff48df74-2070-4e85-9cbc-29e72d0e01d1 tempest-ProjectMemberTests-1539753999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:31:06 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ff48df74-2070-4e85-9cbc-29e72d0e01d1 tempest-ProjectMemberTests-1539753999 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:31:06 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-ff48df74-2070-4e85-9cbc-29e72d0e01d1 tempest-ProjectMemberTests-1539753999 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:31:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ff48df74-2070-4e85-9cbc-29e72d0e01d1 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a1c22f3d-902a-456b-9789-2d965a4d096b 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:06 devstack sudo[107287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a1c22f3d-902a-456b-9789-2d965a4d096b 1073741824 Nov 04 12:31:06 devstack sudo[107287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:06 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-be66bfa5-cf49-430a-859f-26234680dcc0 tempest-CinderUnicodeTest-13571817 None] Acquiring lock "cinder-58982733-e812-4f82-9f2b-e5c82162a310-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:31:07 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-be66bfa5-cf49-430a-859f-26234680dcc0 tempest-CinderUnicodeTest-13571817 None] Lock "cinder-58982733-e812-4f82-9f2b-e5c82162a310-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:31:07 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-be66bfa5-cf49-430a-859f-26234680dcc0 tempest-CinderUnicodeTest-13571817 None] Acquiring lock "cinder-quobyte-2d75885a-d3a1-4b76-9c82-b8ee6d1e931e" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:31:07 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-be66bfa5-cf49-430a-859f-26234680dcc0 tempest-CinderUnicodeTest-13571817 None] Lock "cinder-quobyte-2d75885a-d3a1-4b76-9c82-b8ee6d1e931e" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:31:07 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-be66bfa5-cf49-430a-859f-26234680dcc0 tempest-CinderUnicodeTest-13571817 None] Acquiring lock "cinder-quobyte-58982733-e812-4f82-9f2b-e5c82162a310" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:31:07 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-be66bfa5-cf49-430a-859f-26234680dcc0 tempest-CinderUnicodeTest-13571817 None] Lock "cinder-quobyte-58982733-e812-4f82-9f2b-e5c82162a310" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:31:07 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-be66bfa5-cf49-430a-859f-26234680dcc0 tempest-CinderUnicodeTest-13571817 None] Deleting offline snapshot 58982733-e812-4f82-9f2b-e5c82162a310 of volume 2d75885a-d3a1-4b76-9c82-b8ee6d1e931e {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 12:31:07 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-be66bfa5-cf49-430a-859f-26234680dcc0 tempest-CinderUnicodeTest-13571817 None] snapshot_file for this snap is: volume-2d75885a-d3a1-4b76-9c82-b8ee6d1e931e.58982733-e812-4f82-9f2b-e5c82162a310 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 12:31:07 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1d2699-57a1-4fc6-9125-b436739a4311]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:31:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-be66bfa5-cf49-430a-859f-26234680dcc0 tempest-CinderUnicodeTest-13571817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2d75885a-d3a1-4b76-9c82-b8ee6d1e931e.58982733-e812-4f82-9f2b-e5c82162a310 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:07 devstack sudo[107293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2d75885a-d3a1-4b76-9c82-b8ee6d1e931e.58982733-e812-4f82-9f2b-e5c82162a310 Nov 04 12:31:07 devstack sudo[107293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:07 devstack sudo[107287]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ff48df74-2070-4e85-9cbc-29e72d0e01d1 tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a1c22f3d-902a-456b-9789-2d965a4d096b 1073741824" returned: 0 in 0.689s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ff48df74-2070-4e85-9cbc-29e72d0e01d1 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a1c22f3d-902a-456b-9789-2d965a4d096b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:07 devstack sudo[107295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a1c22f3d-902a-456b-9789-2d965a4d096b Nov 04 12:31:07 devstack sudo[107295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:07 devstack sudo[107293]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-be66bfa5-cf49-430a-859f-26234680dcc0 tempest-CinderUnicodeTest-13571817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2d75885a-d3a1-4b76-9c82-b8ee6d1e931e.58982733-e812-4f82-9f2b-e5c82162a310" returned: 0 in 0.512s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:07 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-be66bfa5-cf49-430a-859f-26234680dcc0 tempest-CinderUnicodeTest-13571817 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d75885a-d3a1-4b76-9c82-b8ee6d1e931e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 12:31:07 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb794d7-9d97-4f50-883d-c0b9c076f13b]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:31:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-be66bfa5-cf49-430a-859f-26234680dcc0 tempest-CinderUnicodeTest-13571817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2d75885a-d3a1-4b76-9c82-b8ee6d1e931e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:07 devstack sudo[107300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2d75885a-d3a1-4b76-9c82-b8ee6d1e931e Nov 04 12:31:07 devstack sudo[107300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:07 devstack sudo[107295]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ff48df74-2070-4e85-9cbc-29e72d0e01d1 tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a1c22f3d-902a-456b-9789-2d965a4d096b" returned: 0 in 0.479s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:07 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ff48df74-2070-4e85-9cbc-29e72d0e01d1 tempest-ProjectMemberTests-1539753999 None] <== create_volume: return (1249ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:31:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ff48df74-2070-4e85-9cbc-29e72d0e01d1 tempest-ProjectMemberTests-1539753999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.252s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:31:07 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ff48df74-2070-4e85-9cbc-29e72d0e01d1 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4332c6a8-e41c-4072-bf1c-fb84a0507345) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1c22f3d-902a-456b-9789-2d965a4d096b', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:31:07 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ff48df74-2070-4e85-9cbc-29e72d0e01d1 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6145b9c8-a8e6-4337-a69a-7ff3a51b0ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:31:07 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-ff48df74-2070-4e85-9cbc-29e72d0e01d1 tempest-ProjectMemberTests-1539753999 None] Volume volume-a1c22f3d-902a-456b-9789-2d965a4d096b (a1c22f3d-902a-456b-9789-2d965a4d096b): created successfully Nov 04 12:31:07 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ff48df74-2070-4e85-9cbc-29e72d0e01d1 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6145b9c8-a8e6-4337-a69a-7ff3a51b0ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:31:07 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ff48df74-2070-4e85-9cbc-29e72d0e01d1 tempest-ProjectMemberTests-1539753999 None] Flow 'volume_create_manager' (391783f8-fc27-496e-abea-f621a7ffb686) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:31:08 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-ff48df74-2070-4e85-9cbc-29e72d0e01d1 tempest-ProjectMemberTests-1539753999 None] Created volume successfully. Nov 04 12:31:08 devstack sudo[107300]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-be66bfa5-cf49-430a-859f-26234680dcc0 tempest-CinderUnicodeTest-13571817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2d75885a-d3a1-4b76-9c82-b8ee6d1e931e" returned: 0 in 0.499s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-be66bfa5-cf49-430a-859f-26234680dcc0 tempest-CinderUnicodeTest-13571817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2d75885a-d3a1-4b76-9c82-b8ee6d1e931e.58982733-e812-4f82-9f2b-e5c82162a310 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:08 devstack sudo[107306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2d75885a-d3a1-4b76-9c82-b8ee6d1e931e.58982733-e812-4f82-9f2b-e5c82162a310 Nov 04 12:31:08 devstack sudo[107306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:08 devstack sudo[107306]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-be66bfa5-cf49-430a-859f-26234680dcc0 tempest-CinderUnicodeTest-13571817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2d75885a-d3a1-4b76-9c82-b8ee6d1e931e.58982733-e812-4f82-9f2b-e5c82162a310" returned: 0 in 0.496s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-be66bfa5-cf49-430a-859f-26234680dcc0 tempest-CinderUnicodeTest-13571817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2d75885a-d3a1-4b76-9c82-b8ee6d1e931e.58982733-e812-4f82-9f2b-e5c82162a310 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:08 devstack sudo[107312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2d75885a-d3a1-4b76-9c82-b8ee6d1e931e.58982733-e812-4f82-9f2b-e5c82162a310 Nov 04 12:31:08 devstack sudo[107312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-72b143f5-3669-40e4-b41b-bf7fda0590ac tempest-ProjectMemberTests-1539753999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:31:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-72b143f5-3669-40e4-b41b-bf7fda0590ac tempest-ProjectMemberTests-1539753999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:31:08 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-72b143f5-3669-40e4-b41b-bf7fda0590ac tempest-ProjectMemberTests-1539753999 None] Creating offline snapshot 77180a63-ffae-4167-9565-9e17f444950e of volume a1c22f3d-902a-456b-9789-2d965a4d096b {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 12:31:09 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1fa763-f7d6-4136-9dd7-8e1c9128ec8f]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:31:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-72b143f5-3669-40e4-b41b-bf7fda0590ac tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a1c22f3d-902a-456b-9789-2d965a4d096b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:09 devstack sudo[107312]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-be66bfa5-cf49-430a-859f-26234680dcc0 tempest-CinderUnicodeTest-13571817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2d75885a-d3a1-4b76-9c82-b8ee6d1e931e.58982733-e812-4f82-9f2b-e5c82162a310" returned: 0 in 0.425s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:09 devstack sudo[107314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a1c22f3d-902a-456b-9789-2d965a4d096b Nov 04 12:31:09 devstack sudo[107314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:09 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-be66bfa5-cf49-430a-859f-26234680dcc0 tempest-CinderUnicodeTest-13571817 None] Lock "cinder-quobyte-58982733-e812-4f82-9f2b-e5c82162a310" released by "_delete_snapshot" :: held 2.175s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:31:09 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-be66bfa5-cf49-430a-859f-26234680dcc0 tempest-CinderUnicodeTest-13571817 None] Lock "cinder-quobyte-2d75885a-d3a1-4b76-9c82-b8ee6d1e931e" released by "delete_snapshot" :: held 2.210s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:31:09 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-be66bfa5-cf49-430a-859f-26234680dcc0 tempest-CinderUnicodeTest-13571817 None] Created reservations ['54ec99ac-6434-4e31-a35d-43f674323f30', '8767148f-ece5-4d32-ae49-5fb6896625fd', '6433f1ac-a38b-4255-8871-993aa3cebcfe', 'e42d1dfa-8d0a-4e61-bfbc-a3a8bf499c87'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:31:09 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-be66bfa5-cf49-430a-859f-26234680dcc0 tempest-CinderUnicodeTest-13571817 None] Delete snapshot completed successfully. Nov 04 12:31:09 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-be66bfa5-cf49-430a-859f-26234680dcc0 tempest-CinderUnicodeTest-13571817 None] Lock "cinder-58982733-e812-4f82-9f2b-e5c82162a310-delete_snapshot" released by "delete_snapshot" :: held 2.397s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:31:09 devstack sudo[107314]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-72b143f5-3669-40e4-b41b-bf7fda0590ac tempest-ProjectMemberTests-1539753999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a1c22f3d-902a-456b-9789-2d965a4d096b" returned: 0 in 0.562s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-72b143f5-3669-40e4-b41b-bf7fda0590ac tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a1c22f3d-902a-456b-9789-2d965a4d096b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a1c22f3d-902a-456b-9789-2d965a4d096b.77180a63-ffae-4167-9565-9e17f444950e 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:09 devstack sudo[107320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a1c22f3d-902a-456b-9789-2d965a4d096b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a1c22f3d-902a-456b-9789-2d965a4d096b.77180a63-ffae-4167-9565-9e17f444950e 1G Nov 04 12:31:09 devstack sudo[107320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:10 devstack sudo[107320]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-72b143f5-3669-40e4-b41b-bf7fda0590ac tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a1c22f3d-902a-456b-9789-2d965a4d096b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a1c22f3d-902a-456b-9789-2d965a4d096b.77180a63-ffae-4167-9565-9e17f444950e 1G" returned: 0 in 0.547s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-72b143f5-3669-40e4-b41b-bf7fda0590ac tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1c22f3d-902a-456b-9789-2d965a4d096b -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a1c22f3d-902a-456b-9789-2d965a4d096b.77180a63-ffae-4167-9565-9e17f444950e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:10 devstack sudo[107326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1c22f3d-902a-456b-9789-2d965a4d096b -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a1c22f3d-902a-456b-9789-2d965a4d096b.77180a63-ffae-4167-9565-9e17f444950e Nov 04 12:31:10 devstack sudo[107326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:10 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ac598584-d0f7-4f66-8bfe-8a390bc6b3e8 tempest-CinderUnicodeTest-13571817 None] Acquiring lock "cinder-2d75885a-d3a1-4b76-9c82-b8ee6d1e931e-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:31:10 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ac598584-d0f7-4f66-8bfe-8a390bc6b3e8 tempest-CinderUnicodeTest-13571817 None] Lock "cinder-2d75885a-d3a1-4b76-9c82-b8ee6d1e931e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:31:10 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ac598584-d0f7-4f66-8bfe-8a390bc6b3e8 tempest-CinderUnicodeTest-13571817 None] Acquiring lock "cinder-quobyte-2d75885a-d3a1-4b76-9c82-b8ee6d1e931e" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:31:10 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ac598584-d0f7-4f66-8bfe-8a390bc6b3e8 tempest-CinderUnicodeTest-13571817 None] Lock "cinder-quobyte-2d75885a-d3a1-4b76-9c82-b8ee6d1e931e" acquired by "delete_volume" :: waited 0.027s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:31:10 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[13bf7d97-7fd7-4dd2-b2d8-1dec025af41f]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:31:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ac598584-d0f7-4f66-8bfe-8a390bc6b3e8 tempest-CinderUnicodeTest-13571817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2d75885a-d3a1-4b76-9c82-b8ee6d1e931e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:10 devstack sudo[107326]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-72b143f5-3669-40e4-b41b-bf7fda0590ac tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1c22f3d-902a-456b-9789-2d965a4d096b -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a1c22f3d-902a-456b-9789-2d965a4d096b.77180a63-ffae-4167-9565-9e17f444950e" returned: 0 in 0.380s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:10 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-72b143f5-3669-40e4-b41b-bf7fda0590ac tempest-ProjectMemberTests-1539753999 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a1c22f3d-902a-456b-9789-2d965a4d096b.77180a63-ffae-4167-9565-9e17f444950e is being set with open permissions: ugo+rw Nov 04 12:31:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-72b143f5-3669-40e4-b41b-bf7fda0590ac tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a1c22f3d-902a-456b-9789-2d965a4d096b.77180a63-ffae-4167-9565-9e17f444950e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:10 devstack sudo[107333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a1c22f3d-902a-456b-9789-2d965a4d096b.77180a63-ffae-4167-9565-9e17f444950e Nov 04 12:31:10 devstack sudo[107333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:10 devstack sudo[107331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2d75885a-d3a1-4b76-9c82-b8ee6d1e931e Nov 04 12:31:10 devstack sudo[107331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:10 devstack sudo[107333]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-72b143f5-3669-40e4-b41b-bf7fda0590ac tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a1c22f3d-902a-456b-9789-2d965a4d096b.77180a63-ffae-4167-9565-9e17f444950e" returned: 0 in 0.400s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-72b143f5-3669-40e4-b41b-bf7fda0590ac tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a1c22f3d-902a-456b-9789-2d965a4d096b.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:11 devstack sudo[107340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a1c22f3d-902a-456b-9789-2d965a4d096b.info Nov 04 12:31:11 devstack sudo[107340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:11 devstack sudo[107331]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ac598584-d0f7-4f66-8bfe-8a390bc6b3e8 tempest-CinderUnicodeTest-13571817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2d75885a-d3a1-4b76-9c82-b8ee6d1e931e" returned: 0 in 0.617s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ac598584-d0f7-4f66-8bfe-8a390bc6b3e8 tempest-CinderUnicodeTest-13571817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2d75885a-d3a1-4b76-9c82-b8ee6d1e931e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:11 devstack sudo[107342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2d75885a-d3a1-4b76-9c82-b8ee6d1e931e Nov 04 12:31:11 devstack sudo[107342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:11 devstack sudo[107340]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-72b143f5-3669-40e4-b41b-bf7fda0590ac tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a1c22f3d-902a-456b-9789-2d965a4d096b.info" returned: 0 in 0.442s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:11 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-72b143f5-3669-40e4-b41b-bf7fda0590ac tempest-ProjectMemberTests-1539753999 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a1c22f3d-902a-456b-9789-2d965a4d096b.info is being set with open permissions: ugo+rw Nov 04 12:31:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-72b143f5-3669-40e4-b41b-bf7fda0590ac tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a1c22f3d-902a-456b-9789-2d965a4d096b.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:11 devstack sudo[107342]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ac598584-d0f7-4f66-8bfe-8a390bc6b3e8 tempest-CinderUnicodeTest-13571817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-2d75885a-d3a1-4b76-9c82-b8ee6d1e931e" returned: 0 in 0.382s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:11 devstack sudo[107346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a1c22f3d-902a-456b-9789-2d965a4d096b.info Nov 04 12:31:11 devstack sudo[107346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:11 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ac598584-d0f7-4f66-8bfe-8a390bc6b3e8 tempest-CinderUnicodeTest-13571817 None] Lock "cinder-quobyte-2d75885a-d3a1-4b76-9c82-b8ee6d1e931e" released by "delete_volume" :: held 1.087s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:31:11 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5d61b36-ffc0-4273-a16a-598e838eda0b tempest-VolumeDependencyTests-1891787336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:31:11 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a5d61b36-ffc0-4273-a16a-598e838eda0b tempest-VolumeDependencyTests-1891787336 None] Flow 'volume_create_manager' (8e33249f-498f-4ecd-b3d4-3876eed792d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:31:11 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a5d61b36-ffc0-4273-a16a-598e838eda0b tempest-VolumeDependencyTests-1891787336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb7f1ea4-ea3b-4620-aae6-fd261cbab68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:31:11 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a5d61b36-ffc0-4273-a16a-598e838eda0b tempest-VolumeDependencyTests-1891787336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb7f1ea4-ea3b-4620-aae6-fd261cbab68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:31:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-445543109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c78bed21-094b-4834-bdf5-f1673fa3dfa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b8f8112efad42008b3c48b8979ebb98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:31:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:31:11Z,use_quota=True,user_id='3642cf1706be4f9d85502ee17079b222',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:31:11 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a5d61b36-ffc0-4273-a16a-598e838eda0b tempest-VolumeDependencyTests-1891787336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aeb9225d-ecbb-4440-b9ec-d658d4b7e091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:31:11 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a5d61b36-ffc0-4273-a16a-598e838eda0b tempest-VolumeDependencyTests-1891787336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aeb9225d-ecbb-4440-b9ec-d658d4b7e091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:31:11 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a5d61b36-ffc0-4273-a16a-598e838eda0b tempest-VolumeDependencyTests-1891787336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e34db9b-bf0a-47f8-85a1-f69e13528af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:31:11 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a5d61b36-ffc0-4273-a16a-598e838eda0b tempest-VolumeDependencyTests-1891787336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e34db9b-bf0a-47f8-85a1-f69e13528af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c78bed21-094b-4834-bdf5-f1673fa3dfa3', 'volume_name': 'volume-c78bed21-094b-4834-bdf5-f1673fa3dfa3', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:31:11 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a5d61b36-ffc0-4273-a16a-598e838eda0b tempest-VolumeDependencyTests-1891787336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a127b851-c36e-481d-99a1-7ef78e9eeaa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:31:11 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a5d61b36-ffc0-4273-a16a-598e838eda0b tempest-VolumeDependencyTests-1891787336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a127b851-c36e-481d-99a1-7ef78e9eeaa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:31:11 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a5d61b36-ffc0-4273-a16a-598e838eda0b tempest-VolumeDependencyTests-1891787336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (383b4ffe-5f30-4263-ac74-5cb7cd8525e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:31:11 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-a5d61b36-ffc0-4273-a16a-598e838eda0b tempest-VolumeDependencyTests-1891787336 None] Volume c78bed21-094b-4834-bdf5-f1673fa3dfa3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c78bed21-094b-4834-bdf5-f1673fa3dfa3', 'volume_size': 1} Nov 04 12:31:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a5d61b36-ffc0-4273-a16a-598e838eda0b tempest-VolumeDependencyTests-1891787336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:31:11 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-ac598584-d0f7-4f66-8bfe-8a390bc6b3e8 tempest-CinderUnicodeTest-13571817 None] Created reservations ['1ae93e1a-63e2-438a-9aea-d95b99064c1e', 'fe068975-0b57-44f9-8716-4f52033223a9', '88ae1411-cec3-4f24-84d2-e0eedbdf5ac2', '759cacfa-e599-45ef-9020-0ceb32ef9cf1'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:31:11 devstack sudo[107346]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-72b143f5-3669-40e4-b41b-bf7fda0590ac tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a1c22f3d-902a-456b-9789-2d965a4d096b.info" returned: 0 in 0.268s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-72b143f5-3669-40e4-b41b-bf7fda0590ac tempest-ProjectMemberTests-1539753999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.726s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:31:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a5d61b36-ffc0-4273-a16a-598e838eda0b tempest-VolumeDependencyTests-1891787336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.142s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:31:11 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a5d61b36-ffc0-4273-a16a-598e838eda0b tempest-VolumeDependencyTests-1891787336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:31:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-445543109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c78bed21-094b-4834-bdf5-f1673fa3dfa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b8f8112efad42008b3c48b8979ebb98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:31:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:31:11Z,use_quota=True,user_id='3642cf1706be4f9d85502ee17079b222',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:31:11 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-a5d61b36-ffc0-4273-a16a-598e838eda0b tempest-VolumeDependencyTests-1891787336 None] Creating volume c78bed21-094b-4834-bdf5-f1673fa3dfa3 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:31:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a5d61b36-ffc0-4273-a16a-598e838eda0b tempest-VolumeDependencyTests-1891787336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:31:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a5d61b36-ffc0-4273-a16a-598e838eda0b tempest-VolumeDependencyTests-1891787336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:31:11 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a5d61b36-ffc0-4273-a16a-598e838eda0b tempest-VolumeDependencyTests-1891787336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:31:11 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a5d61b36-ffc0-4273-a16a-598e838eda0b tempest-VolumeDependencyTests-1891787336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:31:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a5d61b36-ffc0-4273-a16a-598e838eda0b tempest-VolumeDependencyTests-1891787336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:31:11 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a5d61b36-ffc0-4273-a16a-598e838eda0b tempest-VolumeDependencyTests-1891787336 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:31:11 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-a5d61b36-ffc0-4273-a16a-598e838eda0b tempest-VolumeDependencyTests-1891787336 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:31:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a5d61b36-ffc0-4273-a16a-598e838eda0b tempest-VolumeDependencyTests-1891787336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c78bed21-094b-4834-bdf5-f1673fa3dfa3 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ac598584-d0f7-4f66-8bfe-8a390bc6b3e8 tempest-CinderUnicodeTest-13571817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:31:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ac598584-d0f7-4f66-8bfe-8a390bc6b3e8 tempest-CinderUnicodeTest-13571817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:31:11 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ac598584-d0f7-4f66-8bfe-8a390bc6b3e8 tempest-CinderUnicodeTest-13571817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:31:11 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ac598584-d0f7-4f66-8bfe-8a390bc6b3e8 tempest-CinderUnicodeTest-13571817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:31:11 devstack sudo[107349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c78bed21-094b-4834-bdf5-f1673fa3dfa3 1073741824 Nov 04 12:31:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ac598584-d0f7-4f66-8bfe-8a390bc6b3e8 tempest-CinderUnicodeTest-13571817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:31:11 devstack sudo[107349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ac598584-d0f7-4f66-8bfe-8a390bc6b3e8 tempest-CinderUnicodeTest-13571817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:11 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-72b143f5-3669-40e4-b41b-bf7fda0590ac tempest-ProjectMemberTests-1539753999 None] Create snapshot completed successfully Nov 04 12:31:11 devstack sudo[107351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:31:11 devstack sudo[107351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:12 devstack sudo[107351]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ac598584-d0f7-4f66-8bfe-8a390bc6b3e8 tempest-CinderUnicodeTest-13571817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.330s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:12 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-ac598584-d0f7-4f66-8bfe-8a390bc6b3e8 tempest-CinderUnicodeTest-13571817 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:31:12 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-ac598584-d0f7-4f66-8bfe-8a390bc6b3e8 tempest-CinderUnicodeTest-13571817 None] Deleted volume successfully. Nov 04 12:31:12 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ac598584-d0f7-4f66-8bfe-8a390bc6b3e8 tempest-CinderUnicodeTest-13571817 None] Lock "cinder-2d75885a-d3a1-4b76-9c82-b8ee6d1e931e-delete_volume" released by "delete_volume" :: held 1.863s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:31:12 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0242aae4-6d23-432e-be8d-f5facbc5e70a tempest-ProjectMemberTests-1539753999 None] Acquiring lock "cinder-77180a63-ffae-4167-9565-9e17f444950e-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:31:12 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0242aae4-6d23-432e-be8d-f5facbc5e70a tempest-ProjectMemberTests-1539753999 None] Lock "cinder-77180a63-ffae-4167-9565-9e17f444950e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:31:12 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0242aae4-6d23-432e-be8d-f5facbc5e70a tempest-ProjectMemberTests-1539753999 None] Acquiring lock "cinder-quobyte-a1c22f3d-902a-456b-9789-2d965a4d096b" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:31:12 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0242aae4-6d23-432e-be8d-f5facbc5e70a tempest-ProjectMemberTests-1539753999 None] Lock "cinder-quobyte-a1c22f3d-902a-456b-9789-2d965a4d096b" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:31:12 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0242aae4-6d23-432e-be8d-f5facbc5e70a tempest-ProjectMemberTests-1539753999 None] Acquiring lock "cinder-quobyte-77180a63-ffae-4167-9565-9e17f444950e" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:31:12 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0242aae4-6d23-432e-be8d-f5facbc5e70a tempest-ProjectMemberTests-1539753999 None] Lock "cinder-quobyte-77180a63-ffae-4167-9565-9e17f444950e" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:31:12 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-0242aae4-6d23-432e-be8d-f5facbc5e70a tempest-ProjectMemberTests-1539753999 None] Deleting offline snapshot 77180a63-ffae-4167-9565-9e17f444950e of volume a1c22f3d-902a-456b-9789-2d965a4d096b {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 12:31:12 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-0242aae4-6d23-432e-be8d-f5facbc5e70a tempest-ProjectMemberTests-1539753999 None] snapshot_file for this snap is: volume-a1c22f3d-902a-456b-9789-2d965a4d096b.77180a63-ffae-4167-9565-9e17f444950e {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 12:31:12 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[45817abd-fc04-4d11-b23a-e91aa070a850]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:31:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0242aae4-6d23-432e-be8d-f5facbc5e70a tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a1c22f3d-902a-456b-9789-2d965a4d096b.77180a63-ffae-4167-9565-9e17f444950e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:12 devstack sudo[107349]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a5d61b36-ffc0-4273-a16a-598e838eda0b tempest-VolumeDependencyTests-1891787336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c78bed21-094b-4834-bdf5-f1673fa3dfa3 1073741824" returned: 0 in 0.643s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a5d61b36-ffc0-4273-a16a-598e838eda0b tempest-VolumeDependencyTests-1891787336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c78bed21-094b-4834-bdf5-f1673fa3dfa3 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:12 devstack sudo[107359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c78bed21-094b-4834-bdf5-f1673fa3dfa3 Nov 04 12:31:12 devstack sudo[107359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:12 devstack sudo[107358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a1c22f3d-902a-456b-9789-2d965a4d096b.77180a63-ffae-4167-9565-9e17f444950e Nov 04 12:31:12 devstack sudo[107358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:12 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ff4808e2-3827-4fa9-b9ac-51ccc4b440cf tempest-CinderUnicodeTest-13571817 None] Acquiring lock "cinder-ab0f1aaa-1ad3-49ad-974f-a6f79a2b80a4-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:31:12 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ff4808e2-3827-4fa9-b9ac-51ccc4b440cf tempest-CinderUnicodeTest-13571817 None] Lock "cinder-ab0f1aaa-1ad3-49ad-974f-a6f79a2b80a4-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:31:12 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ff4808e2-3827-4fa9-b9ac-51ccc4b440cf tempest-CinderUnicodeTest-13571817 None] Acquiring lock "cinder-quobyte-ab0f1aaa-1ad3-49ad-974f-a6f79a2b80a4" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:31:12 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ff4808e2-3827-4fa9-b9ac-51ccc4b440cf tempest-CinderUnicodeTest-13571817 None] Lock "cinder-quobyte-ab0f1aaa-1ad3-49ad-974f-a6f79a2b80a4" acquired by "delete_volume" :: waited 0.020s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:31:12 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e07eb7c-d7ce-43a3-be5d-16055d51d8ba]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:31:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ff4808e2-3827-4fa9-b9ac-51ccc4b440cf tempest-CinderUnicodeTest-13571817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ab0f1aaa-1ad3-49ad-974f-a6f79a2b80a4 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:12 devstack sudo[107359]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a5d61b36-ffc0-4273-a16a-598e838eda0b tempest-VolumeDependencyTests-1891787336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c78bed21-094b-4834-bdf5-f1673fa3dfa3" returned: 0 in 0.311s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:12 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a5d61b36-ffc0-4273-a16a-598e838eda0b tempest-VolumeDependencyTests-1891787336 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:31:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a5d61b36-ffc0-4273-a16a-598e838eda0b tempest-VolumeDependencyTests-1891787336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:31:12 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a5d61b36-ffc0-4273-a16a-598e838eda0b tempest-VolumeDependencyTests-1891787336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (383b4ffe-5f30-4263-ac74-5cb7cd8525e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c78bed21-094b-4834-bdf5-f1673fa3dfa3', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:31:12 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a5d61b36-ffc0-4273-a16a-598e838eda0b tempest-VolumeDependencyTests-1891787336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00f894e7-a8d8-49a9-99ab-de8bae9915da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:31:12 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-a5d61b36-ffc0-4273-a16a-598e838eda0b tempest-VolumeDependencyTests-1891787336 None] Volume volume-c78bed21-094b-4834-bdf5-f1673fa3dfa3 (c78bed21-094b-4834-bdf5-f1673fa3dfa3): created successfully Nov 04 12:31:12 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a5d61b36-ffc0-4273-a16a-598e838eda0b tempest-VolumeDependencyTests-1891787336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00f894e7-a8d8-49a9-99ab-de8bae9915da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:31:12 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a5d61b36-ffc0-4273-a16a-598e838eda0b tempest-VolumeDependencyTests-1891787336 None] Flow 'volume_create_manager' (8e33249f-498f-4ecd-b3d4-3876eed792d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:31:12 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-a5d61b36-ffc0-4273-a16a-598e838eda0b tempest-VolumeDependencyTests-1891787336 None] Created volume successfully. Nov 04 12:31:12 devstack sudo[107363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ab0f1aaa-1ad3-49ad-974f-a6f79a2b80a4 Nov 04 12:31:12 devstack sudo[107363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:12 devstack sudo[107358]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0242aae4-6d23-432e-be8d-f5facbc5e70a tempest-ProjectMemberTests-1539753999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a1c22f3d-902a-456b-9789-2d965a4d096b.77180a63-ffae-4167-9565-9e17f444950e" returned: 0 in 0.504s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:12 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-0242aae4-6d23-432e-be8d-f5facbc5e70a tempest-ProjectMemberTests-1539753999 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1c22f3d-902a-456b-9789-2d965a4d096b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 12:31:12 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b4eb926-11e5-4219-b5db-3f09decb926b]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:31:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0242aae4-6d23-432e-be8d-f5facbc5e70a tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a1c22f3d-902a-456b-9789-2d965a4d096b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:12 devstack sudo[107369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a1c22f3d-902a-456b-9789-2d965a4d096b Nov 04 12:31:12 devstack sudo[107369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:13 devstack sudo[107363]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ff4808e2-3827-4fa9-b9ac-51ccc4b440cf tempest-CinderUnicodeTest-13571817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ab0f1aaa-1ad3-49ad-974f-a6f79a2b80a4" returned: 0 in 0.450s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ff4808e2-3827-4fa9-b9ac-51ccc4b440cf tempest-CinderUnicodeTest-13571817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ab0f1aaa-1ad3-49ad-974f-a6f79a2b80a4 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:13 devstack sudo[107374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ab0f1aaa-1ad3-49ad-974f-a6f79a2b80a4 Nov 04 12:31:13 devstack sudo[107374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:13 devstack sudo[107369]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0242aae4-6d23-432e-be8d-f5facbc5e70a tempest-ProjectMemberTests-1539753999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a1c22f3d-902a-456b-9789-2d965a4d096b" returned: 0 in 0.394s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0242aae4-6d23-432e-be8d-f5facbc5e70a tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a1c22f3d-902a-456b-9789-2d965a4d096b.77180a63-ffae-4167-9565-9e17f444950e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:13 devstack sudo[107380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a1c22f3d-902a-456b-9789-2d965a4d096b.77180a63-ffae-4167-9565-9e17f444950e Nov 04 12:31:13 devstack sudo[107380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:13 devstack sudo[107374]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ff4808e2-3827-4fa9-b9ac-51ccc4b440cf tempest-CinderUnicodeTest-13571817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ab0f1aaa-1ad3-49ad-974f-a6f79a2b80a4" returned: 0 in 0.319s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:13 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ff4808e2-3827-4fa9-b9ac-51ccc4b440cf tempest-CinderUnicodeTest-13571817 None] Lock "cinder-quobyte-ab0f1aaa-1ad3-49ad-974f-a6f79a2b80a4" released by "delete_volume" :: held 0.824s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:31:13 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-ff4808e2-3827-4fa9-b9ac-51ccc4b440cf tempest-CinderUnicodeTest-13571817 None] Created reservations ['bf323f14-9118-41bd-bdbd-99348b147561', '35123980-7777-4dab-9017-dc4f5a2ae328', '7b2fc554-1cbd-4b70-a9b7-35b860adb7e5', 'a55b5ced-dd96-4c03-8cca-f585fcd126ea'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:31:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ff4808e2-3827-4fa9-b9ac-51ccc4b440cf tempest-CinderUnicodeTest-13571817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:31:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ff4808e2-3827-4fa9-b9ac-51ccc4b440cf tempest-CinderUnicodeTest-13571817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:31:13 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ff4808e2-3827-4fa9-b9ac-51ccc4b440cf tempest-CinderUnicodeTest-13571817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:31:13 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ff4808e2-3827-4fa9-b9ac-51ccc4b440cf tempest-CinderUnicodeTest-13571817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:31:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ff4808e2-3827-4fa9-b9ac-51ccc4b440cf tempest-CinderUnicodeTest-13571817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:31:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ff4808e2-3827-4fa9-b9ac-51ccc4b440cf tempest-CinderUnicodeTest-13571817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:13 devstack sudo[107387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:31:13 devstack sudo[107387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0242aae4-6d23-432e-be8d-f5facbc5e70a tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a1c22f3d-902a-456b-9789-2d965a4d096b.77180a63-ffae-4167-9565-9e17f444950e" returned: 0 in 0.532s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0242aae4-6d23-432e-be8d-f5facbc5e70a tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a1c22f3d-902a-456b-9789-2d965a4d096b.77180a63-ffae-4167-9565-9e17f444950e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:13 devstack sudo[107380]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:13 devstack sudo[107389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a1c22f3d-902a-456b-9789-2d965a4d096b.77180a63-ffae-4167-9565-9e17f444950e Nov 04 12:31:13 devstack sudo[107389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b8ef9b1a-7180-41b9-8186-72ef4d07581a tempest-VolumeDependencyTests-1891787336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:31:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b8ef9b1a-7180-41b9-8186-72ef4d07581a tempest-VolumeDependencyTests-1891787336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:31:13 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-b8ef9b1a-7180-41b9-8186-72ef4d07581a tempest-VolumeDependencyTests-1891787336 None] Creating offline snapshot 9c2bea89-b474-4ee7-af37-774476943bd3 of volume c78bed21-094b-4834-bdf5-f1673fa3dfa3 {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 12:31:13 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d2446bb-ec80-4b8b-8f01-289462fe807c]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:31:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b8ef9b1a-7180-41b9-8186-72ef4d07581a tempest-VolumeDependencyTests-1891787336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c78bed21-094b-4834-bdf5-f1673fa3dfa3 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:14 devstack sudo[107387]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ff4808e2-3827-4fa9-b9ac-51ccc4b440cf tempest-CinderUnicodeTest-13571817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.390s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:14 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-ff4808e2-3827-4fa9-b9ac-51ccc4b440cf tempest-CinderUnicodeTest-13571817 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:31:14 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-ff4808e2-3827-4fa9-b9ac-51ccc4b440cf tempest-CinderUnicodeTest-13571817 None] Deleted volume successfully. Nov 04 12:31:14 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ff4808e2-3827-4fa9-b9ac-51ccc4b440cf tempest-CinderUnicodeTest-13571817 None] Lock "cinder-ab0f1aaa-1ad3-49ad-974f-a6f79a2b80a4-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:31:14 devstack sudo[107391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c78bed21-094b-4834-bdf5-f1673fa3dfa3 Nov 04 12:31:14 devstack sudo[107391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:14 devstack sudo[107389]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0242aae4-6d23-432e-be8d-f5facbc5e70a tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a1c22f3d-902a-456b-9789-2d965a4d096b.77180a63-ffae-4167-9565-9e17f444950e" returned: 0 in 0.400s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:14 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0242aae4-6d23-432e-be8d-f5facbc5e70a tempest-ProjectMemberTests-1539753999 None] Lock "cinder-quobyte-77180a63-ffae-4167-9565-9e17f444950e" released by "_delete_snapshot" :: held 1.968s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:31:14 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0242aae4-6d23-432e-be8d-f5facbc5e70a tempest-ProjectMemberTests-1539753999 None] Lock "cinder-quobyte-a1c22f3d-902a-456b-9789-2d965a4d096b" released by "delete_snapshot" :: held 1.999s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:31:14 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-0242aae4-6d23-432e-be8d-f5facbc5e70a tempest-ProjectMemberTests-1539753999 None] Created reservations ['90833d97-a171-4a55-b1a2-71cc904102d9', '9683df17-8ffc-4415-8cfc-7d02d2760dfa', 'ddeaf0dc-7f59-4c9c-b791-096aeddd0c3c', '658d8620-1c4e-4c7b-b9f2-0677b7d543d8'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:31:14 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-0242aae4-6d23-432e-be8d-f5facbc5e70a tempest-ProjectMemberTests-1539753999 None] Delete snapshot completed successfully. Nov 04 12:31:14 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0242aae4-6d23-432e-be8d-f5facbc5e70a tempest-ProjectMemberTests-1539753999 None] Lock "cinder-77180a63-ffae-4167-9565-9e17f444950e-delete_snapshot" released by "delete_snapshot" :: held 2.195s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:31:14 devstack sudo[107391]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b8ef9b1a-7180-41b9-8186-72ef4d07581a tempest-VolumeDependencyTests-1891787336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c78bed21-094b-4834-bdf5-f1673fa3dfa3" returned: 0 in 0.541s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b8ef9b1a-7180-41b9-8186-72ef4d07581a tempest-VolumeDependencyTests-1891787336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c78bed21-094b-4834-bdf5-f1673fa3dfa3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c78bed21-094b-4834-bdf5-f1673fa3dfa3.9c2bea89-b474-4ee7-af37-774476943bd3 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:14 devstack sudo[107398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c78bed21-094b-4834-bdf5-f1673fa3dfa3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c78bed21-094b-4834-bdf5-f1673fa3dfa3.9c2bea89-b474-4ee7-af37-774476943bd3 1G Nov 04 12:31:14 devstack sudo[107398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:14 devstack sudo[107398]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b8ef9b1a-7180-41b9-8186-72ef4d07581a tempest-VolumeDependencyTests-1891787336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c78bed21-094b-4834-bdf5-f1673fa3dfa3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c78bed21-094b-4834-bdf5-f1673fa3dfa3.9c2bea89-b474-4ee7-af37-774476943bd3 1G" returned: 0 in 0.512s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b8ef9b1a-7180-41b9-8186-72ef4d07581a tempest-VolumeDependencyTests-1891787336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c78bed21-094b-4834-bdf5-f1673fa3dfa3 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c78bed21-094b-4834-bdf5-f1673fa3dfa3.9c2bea89-b474-4ee7-af37-774476943bd3 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:15 devstack sudo[107404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c78bed21-094b-4834-bdf5-f1673fa3dfa3 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c78bed21-094b-4834-bdf5-f1673fa3dfa3.9c2bea89-b474-4ee7-af37-774476943bd3 Nov 04 12:31:15 devstack sudo[107404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:15 devstack sudo[107404]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b8ef9b1a-7180-41b9-8186-72ef4d07581a tempest-VolumeDependencyTests-1891787336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c78bed21-094b-4834-bdf5-f1673fa3dfa3 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c78bed21-094b-4834-bdf5-f1673fa3dfa3.9c2bea89-b474-4ee7-af37-774476943bd3" returned: 0 in 0.366s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:15 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-b8ef9b1a-7180-41b9-8186-72ef4d07581a tempest-VolumeDependencyTests-1891787336 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c78bed21-094b-4834-bdf5-f1673fa3dfa3.9c2bea89-b474-4ee7-af37-774476943bd3 is being set with open permissions: ugo+rw Nov 04 12:31:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b8ef9b1a-7180-41b9-8186-72ef4d07581a tempest-VolumeDependencyTests-1891787336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c78bed21-094b-4834-bdf5-f1673fa3dfa3.9c2bea89-b474-4ee7-af37-774476943bd3 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:15 devstack sudo[107409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c78bed21-094b-4834-bdf5-f1673fa3dfa3.9c2bea89-b474-4ee7-af37-774476943bd3 Nov 04 12:31:15 devstack sudo[107409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:15 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0c712612-f7ee-4e5a-8001-97736927545d tempest-ProjectMemberTests-1539753999 None] Acquiring lock "cinder-a1c22f3d-902a-456b-9789-2d965a4d096b-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:31:15 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0c712612-f7ee-4e5a-8001-97736927545d tempest-ProjectMemberTests-1539753999 None] Lock "cinder-a1c22f3d-902a-456b-9789-2d965a4d096b-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:31:15 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0c712612-f7ee-4e5a-8001-97736927545d tempest-ProjectMemberTests-1539753999 None] Acquiring lock "cinder-quobyte-a1c22f3d-902a-456b-9789-2d965a4d096b" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:31:15 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0c712612-f7ee-4e5a-8001-97736927545d tempest-ProjectMemberTests-1539753999 None] Lock "cinder-quobyte-a1c22f3d-902a-456b-9789-2d965a4d096b" acquired by "delete_volume" :: waited 0.026s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:31:15 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a32dc4-7fd6-4889-ac7b-118d36bb2547]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:31:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0c712612-f7ee-4e5a-8001-97736927545d tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a1c22f3d-902a-456b-9789-2d965a4d096b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:15 devstack sudo[107409]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b8ef9b1a-7180-41b9-8186-72ef4d07581a tempest-VolumeDependencyTests-1891787336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c78bed21-094b-4834-bdf5-f1673fa3dfa3.9c2bea89-b474-4ee7-af37-774476943bd3" returned: 0 in 0.374s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b8ef9b1a-7180-41b9-8186-72ef4d07581a tempest-VolumeDependencyTests-1891787336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c78bed21-094b-4834-bdf5-f1673fa3dfa3.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:15 devstack sudo[107414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c78bed21-094b-4834-bdf5-f1673fa3dfa3.info Nov 04 12:31:15 devstack sudo[107414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:15 devstack sudo[107413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a1c22f3d-902a-456b-9789-2d965a4d096b Nov 04 12:31:15 devstack sudo[107413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:16 devstack sudo[107414]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b8ef9b1a-7180-41b9-8186-72ef4d07581a tempest-VolumeDependencyTests-1891787336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c78bed21-094b-4834-bdf5-f1673fa3dfa3.info" returned: 0 in 0.296s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:16 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-b8ef9b1a-7180-41b9-8186-72ef4d07581a tempest-VolumeDependencyTests-1891787336 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c78bed21-094b-4834-bdf5-f1673fa3dfa3.info is being set with open permissions: ugo+rw Nov 04 12:31:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b8ef9b1a-7180-41b9-8186-72ef4d07581a tempest-VolumeDependencyTests-1891787336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c78bed21-094b-4834-bdf5-f1673fa3dfa3.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:16 devstack sudo[107418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c78bed21-094b-4834-bdf5-f1673fa3dfa3.info Nov 04 12:31:16 devstack sudo[107418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:16 devstack sudo[107413]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0c712612-f7ee-4e5a-8001-97736927545d tempest-ProjectMemberTests-1539753999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a1c22f3d-902a-456b-9789-2d965a4d096b" returned: 0 in 0.538s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0c712612-f7ee-4e5a-8001-97736927545d tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a1c22f3d-902a-456b-9789-2d965a4d096b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:16 devstack sudo[107423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a1c22f3d-902a-456b-9789-2d965a4d096b Nov 04 12:31:16 devstack sudo[107423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:16 devstack sudo[107418]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b8ef9b1a-7180-41b9-8186-72ef4d07581a tempest-VolumeDependencyTests-1891787336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c78bed21-094b-4834-bdf5-f1673fa3dfa3.info" returned: 0 in 0.308s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b8ef9b1a-7180-41b9-8186-72ef4d07581a tempest-VolumeDependencyTests-1891787336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.541s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:31:16 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-b8ef9b1a-7180-41b9-8186-72ef4d07581a tempest-VolumeDependencyTests-1891787336 None] Create snapshot completed successfully Nov 04 12:31:16 devstack sudo[107423]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0c712612-f7ee-4e5a-8001-97736927545d tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a1c22f3d-902a-456b-9789-2d965a4d096b" returned: 0 in 0.362s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:16 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0c712612-f7ee-4e5a-8001-97736927545d tempest-ProjectMemberTests-1539753999 None] Lock "cinder-quobyte-a1c22f3d-902a-456b-9789-2d965a4d096b" released by "delete_volume" :: held 1.004s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:31:16 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-0c712612-f7ee-4e5a-8001-97736927545d tempest-ProjectMemberTests-1539753999 None] Created reservations ['d72ac14f-971a-45a8-afda-86af3d9228f7', 'fd733f2b-7646-482c-8e4f-79713d7df564', '8216d744-921c-4eb6-9c13-06391800e430', '89b42130-37f4-44d7-8ae3-9286b796d413'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:31:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0c712612-f7ee-4e5a-8001-97736927545d tempest-ProjectMemberTests-1539753999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:31:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0c712612-f7ee-4e5a-8001-97736927545d tempest-ProjectMemberTests-1539753999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:31:16 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0c712612-f7ee-4e5a-8001-97736927545d tempest-ProjectMemberTests-1539753999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:31:16 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0c712612-f7ee-4e5a-8001-97736927545d tempest-ProjectMemberTests-1539753999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:31:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0c712612-f7ee-4e5a-8001-97736927545d tempest-ProjectMemberTests-1539753999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:31:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0c712612-f7ee-4e5a-8001-97736927545d tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:16 devstack sudo[107427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:31:16 devstack sudo[107427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:17 devstack sudo[107427]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0c712612-f7ee-4e5a-8001-97736927545d tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.349s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:17 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-0c712612-f7ee-4e5a-8001-97736927545d tempest-ProjectMemberTests-1539753999 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:31:17 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-0c712612-f7ee-4e5a-8001-97736927545d tempest-ProjectMemberTests-1539753999 None] Deleted volume successfully. Nov 04 12:31:17 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0c712612-f7ee-4e5a-8001-97736927545d tempest-ProjectMemberTests-1539753999 None] Lock "cinder-a1c22f3d-902a-456b-9789-2d965a4d096b-delete_volume" released by "delete_volume" :: held 1.696s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:31:17 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d58c330-f25a-4f57-8771-fa30a464272a tempest-VolumeDependencyTests-1891787336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:31:17 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3d58c330-f25a-4f57-8771-fa30a464272a tempest-VolumeDependencyTests-1891787336 None] Flow 'volume_create_manager' (09c18c13-aa63-4bf0-8a9f-79cd40690ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:31:17 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3d58c330-f25a-4f57-8771-fa30a464272a tempest-VolumeDependencyTests-1891787336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc956ea4-8a72-42db-9cf3-9714300b1fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:31:18 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3d58c330-f25a-4f57-8771-fa30a464272a tempest-VolumeDependencyTests-1891787336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc956ea4-8a72-42db-9cf3-9714300b1fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:31:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-612905912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9282fa43-19d5-472a-b892-e81f040ee59e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b8f8112efad42008b3c48b8979ebb98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:31:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9c2bea89-b474-4ee7-af37-774476943bd3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:31:18Z,use_quota=True,user_id='3642cf1706be4f9d85502ee17079b222',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:31:18 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3d58c330-f25a-4f57-8771-fa30a464272a tempest-VolumeDependencyTests-1891787336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c2ebd8f-cd87-4bf9-8706-473a855d5f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:31:18 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3d58c330-f25a-4f57-8771-fa30a464272a tempest-VolumeDependencyTests-1891787336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c2ebd8f-cd87-4bf9-8706-473a855d5f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:31:18 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3d58c330-f25a-4f57-8771-fa30a464272a tempest-VolumeDependencyTests-1891787336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e877f12f-2846-46a9-9475-e69866e130d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:31:18 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3d58c330-f25a-4f57-8771-fa30a464272a tempest-VolumeDependencyTests-1891787336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e877f12f-2846-46a9-9475-e69866e130d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9282fa43-19d5-472a-b892-e81f040ee59e', 'volume_name': 'volume-9282fa43-19d5-472a-b892-e81f040ee59e', 'volume_size': 1, 'snapshot_id': '9c2bea89-b474-4ee7-af37-774476943bd3'}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:31:18 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3d58c330-f25a-4f57-8771-fa30a464272a tempest-VolumeDependencyTests-1891787336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2aba861-f8fd-4435-a232-3c4ea7e12aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:31:18 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3d58c330-f25a-4f57-8771-fa30a464272a tempest-VolumeDependencyTests-1891787336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2aba861-f8fd-4435-a232-3c4ea7e12aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:31:18 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3d58c330-f25a-4f57-8771-fa30a464272a tempest-VolumeDependencyTests-1891787336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eadc673-4978-413a-8848-89d0559c5654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:31:18 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-3d58c330-f25a-4f57-8771-fa30a464272a tempest-VolumeDependencyTests-1891787336 None] Volume 9282fa43-19d5-472a-b892-e81f040ee59e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9282fa43-19d5-472a-b892-e81f040ee59e', 'volume_size': 1, 'snapshot_id': '9c2bea89-b474-4ee7-af37-774476943bd3'} Nov 04 12:31:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d58c330-f25a-4f57-8771-fa30a464272a tempest-VolumeDependencyTests-1891787336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:31:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d58c330-f25a-4f57-8771-fa30a464272a tempest-VolumeDependencyTests-1891787336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:31:18 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3d58c330-f25a-4f57-8771-fa30a464272a tempest-VolumeDependencyTests-1891787336 None] Acquiring lock "cinder-quobyte-9c2bea89-b474-4ee7-af37-774476943bd3-9282fa43-19d5-472a-b892-e81f040ee59e" by "_create_volume_from_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:31:18 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3d58c330-f25a-4f57-8771-fa30a464272a tempest-VolumeDependencyTests-1891787336 None] Lock "cinder-quobyte-9c2bea89-b474-4ee7-af37-774476943bd3-9282fa43-19d5-472a-b892-e81f040ee59e" acquired by "_create_volume_from_snapshot" :: waited 0.038s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:31:18 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3d58c330-f25a-4f57-8771-fa30a464272a tempest-VolumeDependencyTests-1891787336 None] Creating volume 9282fa43-19d5-472a-b892-e81f040ee59e from snapshot 9c2bea89-b474-4ee7-af37-774476943bd3 {{(pid=87095) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 04 12:31:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d58c330-f25a-4f57-8771-fa30a464272a tempest-VolumeDependencyTests-1891787336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:31:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d58c330-f25a-4f57-8771-fa30a464272a tempest-VolumeDependencyTests-1891787336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:31:18 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3d58c330-f25a-4f57-8771-fa30a464272a tempest-VolumeDependencyTests-1891787336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:31:18 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3d58c330-f25a-4f57-8771-fa30a464272a tempest-VolumeDependencyTests-1891787336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:31:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d58c330-f25a-4f57-8771-fa30a464272a tempest-VolumeDependencyTests-1891787336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:31:18 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3d58c330-f25a-4f57-8771-fa30a464272a tempest-VolumeDependencyTests-1891787336 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:31:18 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3d58c330-f25a-4f57-8771-fa30a464272a tempest-VolumeDependencyTests-1891787336 None] Acquiring lock "cinder-quobyte-9282fa43-19d5-472a-b892-e81f040ee59e" by "_copy_volume_from_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:31:18 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3d58c330-f25a-4f57-8771-fa30a464272a tempest-VolumeDependencyTests-1891787336 None] Lock "cinder-quobyte-9282fa43-19d5-472a-b892-e81f040ee59e" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:31:18 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3d58c330-f25a-4f57-8771-fa30a464272a tempest-VolumeDependencyTests-1891787336 None] snapshot: 9c2bea89-b474-4ee7-af37-774476943bd3, volume: 9282fa43-19d5-472a-b892-e81f040ee59e, {{(pid=87095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 12:31:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d58c330-f25a-4f57-8771-fa30a464272a tempest-VolumeDependencyTests-1891787336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:31:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d58c330-f25a-4f57-8771-fa30a464272a tempest-VolumeDependencyTests-1891787336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:31:18 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3d58c330-f25a-4f57-8771-fa30a464272a tempest-VolumeDependencyTests-1891787336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:31:18 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3d58c330-f25a-4f57-8771-fa30a464272a tempest-VolumeDependencyTests-1891787336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:31:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d58c330-f25a-4f57-8771-fa30a464272a tempest-VolumeDependencyTests-1891787336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:31:18 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e89e01-46af-4637-975d-27541024b01c]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:31:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3d58c330-f25a-4f57-8771-fa30a464272a tempest-VolumeDependencyTests-1891787336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c78bed21-094b-4834-bdf5-f1673fa3dfa3.9c2bea89-b474-4ee7-af37-774476943bd3 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:18 devstack sudo[107431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c78bed21-094b-4834-bdf5-f1673fa3dfa3.9c2bea89-b474-4ee7-af37-774476943bd3 Nov 04 12:31:18 devstack sudo[107431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:18 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-7308f28b-ce2c-4d28-a03a-e46a8edd444b tempest-ProjectMemberTests-1539753999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:31:18 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7308f28b-ce2c-4d28-a03a-e46a8edd444b tempest-ProjectMemberTests-1539753999 None] Flow 'volume_create_manager' (8b1f09f9-efa5-44e4-8f86-222aa91f5f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:31:18 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7308f28b-ce2c-4d28-a03a-e46a8edd444b tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb474b88-9308-4e3d-8e43-adba307e062d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:31:18 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7308f28b-ce2c-4d28-a03a-e46a8edd444b tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb474b88-9308-4e3d-8e43-adba307e062d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:31:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-402552438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=083fddde-aeaa-4ee8-a591-28cb4bfed82c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cb67397f4d04f049564f5d284f139d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:31:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:31:19Z,use_quota=True,user_id='091b86592c99419b9c07a685e7933341',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:31:18 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7308f28b-ce2c-4d28-a03a-e46a8edd444b tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (490f6703-4574-41ad-a9fd-c5c0ef446a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:31:18 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7308f28b-ce2c-4d28-a03a-e46a8edd444b tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (490f6703-4574-41ad-a9fd-c5c0ef446a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:31:18 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7308f28b-ce2c-4d28-a03a-e46a8edd444b tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (296d9275-e05e-449a-98e6-ed9ab395a1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:31:18 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7308f28b-ce2c-4d28-a03a-e46a8edd444b tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (296d9275-e05e-449a-98e6-ed9ab395a1d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '083fddde-aeaa-4ee8-a591-28cb4bfed82c', 'volume_name': 'volume-083fddde-aeaa-4ee8-a591-28cb4bfed82c', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:31:18 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7308f28b-ce2c-4d28-a03a-e46a8edd444b tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9439a64e-77f2-43ce-a7cf-09719d6c3766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:31:18 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7308f28b-ce2c-4d28-a03a-e46a8edd444b tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9439a64e-77f2-43ce-a7cf-09719d6c3766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:31:18 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7308f28b-ce2c-4d28-a03a-e46a8edd444b tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9857551-41df-4f8b-b90f-fd5ef8127a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:31:18 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-7308f28b-ce2c-4d28-a03a-e46a8edd444b tempest-ProjectMemberTests-1539753999 None] Volume 083fddde-aeaa-4ee8-a591-28cb4bfed82c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-083fddde-aeaa-4ee8-a591-28cb4bfed82c', 'volume_size': 1} Nov 04 12:31:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7308f28b-ce2c-4d28-a03a-e46a8edd444b tempest-ProjectMemberTests-1539753999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:31:18 devstack sudo[107431]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3d58c330-f25a-4f57-8771-fa30a464272a tempest-VolumeDependencyTests-1891787336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c78bed21-094b-4834-bdf5-f1673fa3dfa3.9c2bea89-b474-4ee7-af37-774476943bd3" returned: 0 in 0.627s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:18 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-3d58c330-f25a-4f57-8771-fa30a464272a tempest-VolumeDependencyTests-1891787336 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c78bed21-094b-4834-bdf5-f1673fa3dfa3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 12:31:18 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37b133b-9f06-4232-8c56-cad8c24feb27]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:31:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3d58c330-f25a-4f57-8771-fa30a464272a tempest-VolumeDependencyTests-1891787336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c78bed21-094b-4834-bdf5-f1673fa3dfa3 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:19 devstack sudo[107437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c78bed21-094b-4834-bdf5-f1673fa3dfa3 Nov 04 12:31:19 devstack sudo[107437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:19 devstack sudo[107437]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3d58c330-f25a-4f57-8771-fa30a464272a tempest-VolumeDependencyTests-1891787336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c78bed21-094b-4834-bdf5-f1673fa3dfa3" returned: 0 in 0.419s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:19 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3d58c330-f25a-4f57-8771-fa30a464272a tempest-VolumeDependencyTests-1891787336 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c78bed21-094b-4834-bdf5-f1673fa3dfa3 {{(pid=87095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 12:31:19 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3d58c330-f25a-4f57-8771-fa30a464272a tempest-VolumeDependencyTests-1891787336 None] Creating direct copy from snapshot {{(pid=87095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 12:31:19 devstack cinder-volume[87095]: DEBUG cinder.utils [None req-3d58c330-f25a-4f57-8771-fa30a464272a tempest-VolumeDependencyTests-1891787336 None] Path /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9282fa43-19d5-472a-b892-e81f040ee59e not found in is_blk_device check {{(pid=87095) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 04 12:31:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3d58c330-f25a-4f57-8771-fa30a464272a tempest-VolumeDependencyTests-1891787336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c78bed21-094b-4834-bdf5-f1673fa3dfa3 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9282fa43-19d5-472a-b892-e81f040ee59e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:19 devstack sudo[107442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c78bed21-094b-4834-bdf5-f1673fa3dfa3 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9282fa43-19d5-472a-b892-e81f040ee59e Nov 04 12:31:19 devstack sudo[107442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:24 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=245,cinder:UPDATE=294,cinder:INSERT=79,cinder:DELETE=29 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 12:31:24 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:UPDATE=322,cinder:SELECT=216,cinder:INSERT=87,cinder:DELETE=26 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 12:31:24 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-17150d72-1cad-4414-bc93-a286ab413ba6 tempest-SnapshotDependencyTests-2006240278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:31:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-17150d72-1cad-4414-bc93-a286ab413ba6 tempest-SnapshotDependencyTests-2006240278 None] Flow 'volume_create_manager' (2815eb79-2126-4008-8cb8-db3d0ed323e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:31:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-17150d72-1cad-4414-bc93-a286ab413ba6 tempest-SnapshotDependencyTests-2006240278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0abd80e8-433a-42d3-872d-323d640621a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:31:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-17150d72-1cad-4414-bc93-a286ab413ba6 tempest-SnapshotDependencyTests-2006240278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0abd80e8-433a-42d3-872d-323d640621a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:31:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1086299516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09cc60d7-39fc-430e-9250-7dea3db224b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58f9b407c58d4166875ab0fb5ace95e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:31:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:31:25Z,use_quota=True,user_id='93f274a8868c437898886f3e6a1370e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:31:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-17150d72-1cad-4414-bc93-a286ab413ba6 tempest-SnapshotDependencyTests-2006240278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (084d9600-8c57-43aa-b617-14c730959bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:31:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-17150d72-1cad-4414-bc93-a286ab413ba6 tempest-SnapshotDependencyTests-2006240278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (084d9600-8c57-43aa-b617-14c730959bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:31:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-17150d72-1cad-4414-bc93-a286ab413ba6 tempest-SnapshotDependencyTests-2006240278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6040890-1ed6-456b-b5a5-0b953d3e291b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:31:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-17150d72-1cad-4414-bc93-a286ab413ba6 tempest-SnapshotDependencyTests-2006240278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6040890-1ed6-456b-b5a5-0b953d3e291b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09cc60d7-39fc-430e-9250-7dea3db224b4', 'volume_name': 'volume-09cc60d7-39fc-430e-9250-7dea3db224b4', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:31:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-17150d72-1cad-4414-bc93-a286ab413ba6 tempest-SnapshotDependencyTests-2006240278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57fbb22b-9948-4795-b48e-7244800a646a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:31:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-17150d72-1cad-4414-bc93-a286ab413ba6 tempest-SnapshotDependencyTests-2006240278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57fbb22b-9948-4795-b48e-7244800a646a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:31:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-17150d72-1cad-4414-bc93-a286ab413ba6 tempest-SnapshotDependencyTests-2006240278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2c7426a-04de-4d7b-aeed-8c87de49bcd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:31:25 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-17150d72-1cad-4414-bc93-a286ab413ba6 tempest-SnapshotDependencyTests-2006240278 None] Volume 09cc60d7-39fc-430e-9250-7dea3db224b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09cc60d7-39fc-430e-9250-7dea3db224b4', 'volume_size': 1} Nov 04 12:31:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-17150d72-1cad-4414-bc93-a286ab413ba6 tempest-SnapshotDependencyTests-2006240278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:31:27 devstack sudo[107442]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3d58c330-f25a-4f57-8771-fa30a464272a tempest-VolumeDependencyTests-1891787336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c78bed21-094b-4834-bdf5-f1673fa3dfa3 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9282fa43-19d5-472a-b892-e81f040ee59e" returned: 0 in 7.971s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:27 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-3d58c330-f25a-4f57-8771-fa30a464272a tempest-VolumeDependencyTests-1891787336 None] Image conversion details: src /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c78bed21-094b-4834-bdf5-f1673fa3dfa3, size 1024.00 MB, duration 7.97 sec, destination /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9282fa43-19d5-472a-b892-e81f040ee59e {{(pid=87095) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 12:31:27 devstack cinder-volume[87095]: INFO cinder.image.image_utils [None req-3d58c330-f25a-4f57-8771-fa30a464272a tempest-VolumeDependencyTests-1891787336 None] Converted 1024.00 MB image at 128.45 MB/s Nov 04 12:31:27 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-3d58c330-f25a-4f57-8771-fa30a464272a tempest-VolumeDependencyTests-1891787336 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9282fa43-19d5-472a-b892-e81f040ee59e is being set with open permissions: ugo+rw Nov 04 12:31:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3d58c330-f25a-4f57-8771-fa30a464272a tempest-VolumeDependencyTests-1891787336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9282fa43-19d5-472a-b892-e81f040ee59e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:27 devstack sudo[107456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9282fa43-19d5-472a-b892-e81f040ee59e Nov 04 12:31:27 devstack sudo[107456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:27 devstack sudo[107456]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3d58c330-f25a-4f57-8771-fa30a464272a tempest-VolumeDependencyTests-1891787336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9282fa43-19d5-472a-b892-e81f040ee59e" returned: 0 in 0.242s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:27 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3d58c330-f25a-4f57-8771-fa30a464272a tempest-VolumeDependencyTests-1891787336 None] Lock "cinder-quobyte-9282fa43-19d5-472a-b892-e81f040ee59e" released by "_copy_volume_from_snapshot" :: held 9.389s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:31:27 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3d58c330-f25a-4f57-8771-fa30a464272a tempest-VolumeDependencyTests-1891787336 None] Lock "cinder-quobyte-9c2bea89-b474-4ee7-af37-774476943bd3-9282fa43-19d5-472a-b892-e81f040ee59e" released by "_create_volume_from_snapshot" :: held 9.485s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:31:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d58c330-f25a-4f57-8771-fa30a464272a tempest-VolumeDependencyTests-1891787336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.526s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:31:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7308f28b-ce2c-4d28-a03a-e46a8edd444b tempest-ProjectMemberTests-1539753999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.850s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:31:27 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7308f28b-ce2c-4d28-a03a-e46a8edd444b tempest-ProjectMemberTests-1539753999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:31:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-402552438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=083fddde-aeaa-4ee8-a591-28cb4bfed82c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cb67397f4d04f049564f5d284f139d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:31:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:31:19Z,use_quota=True,user_id='091b86592c99419b9c07a685e7933341',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:31:27 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-7308f28b-ce2c-4d28-a03a-e46a8edd444b tempest-ProjectMemberTests-1539753999 None] Creating volume 083fddde-aeaa-4ee8-a591-28cb4bfed82c {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:31:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7308f28b-ce2c-4d28-a03a-e46a8edd444b tempest-ProjectMemberTests-1539753999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:31:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7308f28b-ce2c-4d28-a03a-e46a8edd444b tempest-ProjectMemberTests-1539753999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:31:27 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7308f28b-ce2c-4d28-a03a-e46a8edd444b tempest-ProjectMemberTests-1539753999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:31:27 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7308f28b-ce2c-4d28-a03a-e46a8edd444b tempest-ProjectMemberTests-1539753999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:31:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7308f28b-ce2c-4d28-a03a-e46a8edd444b tempest-ProjectMemberTests-1539753999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:31:27 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7308f28b-ce2c-4d28-a03a-e46a8edd444b tempest-ProjectMemberTests-1539753999 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:31:27 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-7308f28b-ce2c-4d28-a03a-e46a8edd444b tempest-ProjectMemberTests-1539753999 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:31:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7308f28b-ce2c-4d28-a03a-e46a8edd444b tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-083fddde-aeaa-4ee8-a591-28cb4bfed82c 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:27 devstack sudo[107459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-083fddde-aeaa-4ee8-a591-28cb4bfed82c 1073741824 Nov 04 12:31:27 devstack sudo[107459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3d58c330-f25a-4f57-8771-fa30a464272a tempest-VolumeDependencyTests-1891787336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eadc673-4978-413a-8848-89d0559c5654) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9282fa43-19d5-472a-b892-e81f040ee59e', 'volume_size': 1, 'snapshot_id': '9c2bea89-b474-4ee7-af37-774476943bd3'}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:31:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3d58c330-f25a-4f57-8771-fa30a464272a tempest-VolumeDependencyTests-1891787336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (727b5b28-46fc-4b91-be04-0ddf098f213d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:31:27 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-3d58c330-f25a-4f57-8771-fa30a464272a tempest-VolumeDependencyTests-1891787336 None] Volume volume-9282fa43-19d5-472a-b892-e81f040ee59e (9282fa43-19d5-472a-b892-e81f040ee59e): created successfully Nov 04 12:31:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3d58c330-f25a-4f57-8771-fa30a464272a tempest-VolumeDependencyTests-1891787336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (727b5b28-46fc-4b91-be04-0ddf098f213d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:31:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3d58c330-f25a-4f57-8771-fa30a464272a tempest-VolumeDependencyTests-1891787336 None] Flow 'volume_create_manager' (09c18c13-aa63-4bf0-8a9f-79cd40690ff0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:31:27 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-3d58c330-f25a-4f57-8771-fa30a464272a tempest-VolumeDependencyTests-1891787336 None] Created volume successfully. Nov 04 12:31:28 devstack sudo[107459]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7308f28b-ce2c-4d28-a03a-e46a8edd444b tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-083fddde-aeaa-4ee8-a591-28cb4bfed82c 1073741824" returned: 0 in 0.474s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7308f28b-ce2c-4d28-a03a-e46a8edd444b tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-083fddde-aeaa-4ee8-a591-28cb4bfed82c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:28 devstack sudo[107465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-083fddde-aeaa-4ee8-a591-28cb4bfed82c Nov 04 12:31:28 devstack sudo[107465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:28 devstack sudo[107465]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7308f28b-ce2c-4d28-a03a-e46a8edd444b tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-083fddde-aeaa-4ee8-a591-28cb4bfed82c" returned: 0 in 0.258s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:28 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7308f28b-ce2c-4d28-a03a-e46a8edd444b tempest-ProjectMemberTests-1539753999 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:31:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7308f28b-ce2c-4d28-a03a-e46a8edd444b tempest-ProjectMemberTests-1539753999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:31:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-17150d72-1cad-4414-bc93-a286ab413ba6 tempest-SnapshotDependencyTests-2006240278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.306s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:31:28 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-17150d72-1cad-4414-bc93-a286ab413ba6 tempest-SnapshotDependencyTests-2006240278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:31:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1086299516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09cc60d7-39fc-430e-9250-7dea3db224b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58f9b407c58d4166875ab0fb5ace95e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:31:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:31:25Z,use_quota=True,user_id='93f274a8868c437898886f3e6a1370e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:31:28 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-17150d72-1cad-4414-bc93-a286ab413ba6 tempest-SnapshotDependencyTests-2006240278 None] Creating volume 09cc60d7-39fc-430e-9250-7dea3db224b4 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:31:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-17150d72-1cad-4414-bc93-a286ab413ba6 tempest-SnapshotDependencyTests-2006240278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:31:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-17150d72-1cad-4414-bc93-a286ab413ba6 tempest-SnapshotDependencyTests-2006240278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:31:28 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-17150d72-1cad-4414-bc93-a286ab413ba6 tempest-SnapshotDependencyTests-2006240278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:31:28 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-17150d72-1cad-4414-bc93-a286ab413ba6 tempest-SnapshotDependencyTests-2006240278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:31:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-17150d72-1cad-4414-bc93-a286ab413ba6 tempest-SnapshotDependencyTests-2006240278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:31:28 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-17150d72-1cad-4414-bc93-a286ab413ba6 tempest-SnapshotDependencyTests-2006240278 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:31:28 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-17150d72-1cad-4414-bc93-a286ab413ba6 tempest-SnapshotDependencyTests-2006240278 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:31:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-17150d72-1cad-4414-bc93-a286ab413ba6 tempest-SnapshotDependencyTests-2006240278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-09cc60d7-39fc-430e-9250-7dea3db224b4 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:28 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7308f28b-ce2c-4d28-a03a-e46a8edd444b tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9857551-41df-4f8b-b90f-fd5ef8127a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-083fddde-aeaa-4ee8-a591-28cb4bfed82c', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:31:28 devstack sudo[107468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-09cc60d7-39fc-430e-9250-7dea3db224b4 1073741824 Nov 04 12:31:28 devstack sudo[107468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:28 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7308f28b-ce2c-4d28-a03a-e46a8edd444b tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f56bf844-0f33-47c8-a140-3a5d826b5ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:31:28 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-7308f28b-ce2c-4d28-a03a-e46a8edd444b tempest-ProjectMemberTests-1539753999 None] Volume volume-083fddde-aeaa-4ee8-a591-28cb4bfed82c (083fddde-aeaa-4ee8-a591-28cb4bfed82c): created successfully Nov 04 12:31:28 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7308f28b-ce2c-4d28-a03a-e46a8edd444b tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f56bf844-0f33-47c8-a140-3a5d826b5ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:31:28 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7308f28b-ce2c-4d28-a03a-e46a8edd444b tempest-ProjectMemberTests-1539753999 None] Flow 'volume_create_manager' (8b1f09f9-efa5-44e4-8f86-222aa91f5f38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:31:28 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-7308f28b-ce2c-4d28-a03a-e46a8edd444b tempest-ProjectMemberTests-1539753999 None] Created volume successfully. Nov 04 12:31:28 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-db88e144-c0ba-4631-a141-efae43036a3d tempest-VolumeDependencyTests-1891787336 None] Acquiring lock "cinder-9c2bea89-b474-4ee7-af37-774476943bd3-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:31:28 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-db88e144-c0ba-4631-a141-efae43036a3d tempest-VolumeDependencyTests-1891787336 None] Lock "cinder-9c2bea89-b474-4ee7-af37-774476943bd3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:31:28 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-db88e144-c0ba-4631-a141-efae43036a3d tempest-VolumeDependencyTests-1891787336 None] Acquiring lock "cinder-quobyte-c78bed21-094b-4834-bdf5-f1673fa3dfa3" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:31:28 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-db88e144-c0ba-4631-a141-efae43036a3d tempest-VolumeDependencyTests-1891787336 None] Lock "cinder-quobyte-c78bed21-094b-4834-bdf5-f1673fa3dfa3" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:31:28 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-db88e144-c0ba-4631-a141-efae43036a3d tempest-VolumeDependencyTests-1891787336 None] Acquiring lock "cinder-quobyte-9c2bea89-b474-4ee7-af37-774476943bd3" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:31:28 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-db88e144-c0ba-4631-a141-efae43036a3d tempest-VolumeDependencyTests-1891787336 None] Lock "cinder-quobyte-9c2bea89-b474-4ee7-af37-774476943bd3" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:31:28 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-db88e144-c0ba-4631-a141-efae43036a3d tempest-VolumeDependencyTests-1891787336 None] Deleting offline snapshot 9c2bea89-b474-4ee7-af37-774476943bd3 of volume c78bed21-094b-4834-bdf5-f1673fa3dfa3 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 12:31:28 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-db88e144-c0ba-4631-a141-efae43036a3d tempest-VolumeDependencyTests-1891787336 None] snapshot_file for this snap is: volume-c78bed21-094b-4834-bdf5-f1673fa3dfa3.9c2bea89-b474-4ee7-af37-774476943bd3 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 12:31:29 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[abca0ef1-a886-447e-bfd9-fd2415cf677c]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:31:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-db88e144-c0ba-4631-a141-efae43036a3d tempest-VolumeDependencyTests-1891787336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c78bed21-094b-4834-bdf5-f1673fa3dfa3.9c2bea89-b474-4ee7-af37-774476943bd3 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:29 devstack sudo[107468]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-17150d72-1cad-4414-bc93-a286ab413ba6 tempest-SnapshotDependencyTests-2006240278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-09cc60d7-39fc-430e-9250-7dea3db224b4 1073741824" returned: 0 in 0.559s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-17150d72-1cad-4414-bc93-a286ab413ba6 tempest-SnapshotDependencyTests-2006240278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-09cc60d7-39fc-430e-9250-7dea3db224b4 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:29 devstack sudo[107481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-09cc60d7-39fc-430e-9250-7dea3db224b4 Nov 04 12:31:29 devstack sudo[107481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:29 devstack sudo[107480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c78bed21-094b-4834-bdf5-f1673fa3dfa3.9c2bea89-b474-4ee7-af37-774476943bd3 Nov 04 12:31:29 devstack sudo[107480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:29 devstack sudo[107481]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-17150d72-1cad-4414-bc93-a286ab413ba6 tempest-SnapshotDependencyTests-2006240278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-09cc60d7-39fc-430e-9250-7dea3db224b4" returned: 0 in 0.271s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:29 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-17150d72-1cad-4414-bc93-a286ab413ba6 tempest-SnapshotDependencyTests-2006240278 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:31:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-17150d72-1cad-4414-bc93-a286ab413ba6 tempest-SnapshotDependencyTests-2006240278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:31:29 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-17150d72-1cad-4414-bc93-a286ab413ba6 tempest-SnapshotDependencyTests-2006240278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2c7426a-04de-4d7b-aeed-8c87de49bcd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09cc60d7-39fc-430e-9250-7dea3db224b4', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:31:29 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-17150d72-1cad-4414-bc93-a286ab413ba6 tempest-SnapshotDependencyTests-2006240278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65666706-c46f-4c37-8d51-845749656d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:31:29 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-17150d72-1cad-4414-bc93-a286ab413ba6 tempest-SnapshotDependencyTests-2006240278 None] Volume volume-09cc60d7-39fc-430e-9250-7dea3db224b4 (09cc60d7-39fc-430e-9250-7dea3db224b4): created successfully Nov 04 12:31:29 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-17150d72-1cad-4414-bc93-a286ab413ba6 tempest-SnapshotDependencyTests-2006240278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65666706-c46f-4c37-8d51-845749656d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:31:29 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-17150d72-1cad-4414-bc93-a286ab413ba6 tempest-SnapshotDependencyTests-2006240278 None] Flow 'volume_create_manager' (2815eb79-2126-4008-8cb8-db3d0ed323e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:31:29 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-17150d72-1cad-4414-bc93-a286ab413ba6 tempest-SnapshotDependencyTests-2006240278 None] Created volume successfully. Nov 04 12:31:29 devstack sudo[107480]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-db88e144-c0ba-4631-a141-efae43036a3d tempest-VolumeDependencyTests-1891787336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c78bed21-094b-4834-bdf5-f1673fa3dfa3.9c2bea89-b474-4ee7-af37-774476943bd3" returned: 0 in 0.439s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:29 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-db88e144-c0ba-4631-a141-efae43036a3d tempest-VolumeDependencyTests-1891787336 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c78bed21-094b-4834-bdf5-f1673fa3dfa3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 12:31:29 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4969ca-d557-41a4-8479-e94d4a793e1a]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:31:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-db88e144-c0ba-4631-a141-efae43036a3d tempest-VolumeDependencyTests-1891787336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c78bed21-094b-4834-bdf5-f1673fa3dfa3 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:29 devstack sudo[107488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c78bed21-094b-4834-bdf5-f1673fa3dfa3 Nov 04 12:31:29 devstack sudo[107488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-aeba9889-263a-464a-9198-662b0b2b4567 tempest-ProjectMemberTests-1539753999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:31:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-aeba9889-263a-464a-9198-662b0b2b4567 tempest-ProjectMemberTests-1539753999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:31:29 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-aeba9889-263a-464a-9198-662b0b2b4567 tempest-ProjectMemberTests-1539753999 None] Creating offline snapshot b4fd7d37-111a-4c8d-8d33-a41a4f34c6ca of volume 083fddde-aeaa-4ee8-a591-28cb4bfed82c {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 12:31:29 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d900179c-70aa-4041-9d2d-4c22d0bd375a]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:31:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-aeba9889-263a-464a-9198-662b0b2b4567 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-083fddde-aeaa-4ee8-a591-28cb4bfed82c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:29 devstack sudo[107492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-083fddde-aeaa-4ee8-a591-28cb4bfed82c Nov 04 12:31:29 devstack sudo[107492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:30 devstack sudo[107488]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-db88e144-c0ba-4631-a141-efae43036a3d tempest-VolumeDependencyTests-1891787336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c78bed21-094b-4834-bdf5-f1673fa3dfa3" returned: 0 in 0.658s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-db88e144-c0ba-4631-a141-efae43036a3d tempest-VolumeDependencyTests-1891787336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c78bed21-094b-4834-bdf5-f1673fa3dfa3.9c2bea89-b474-4ee7-af37-774476943bd3 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:30 devstack sudo[107495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c78bed21-094b-4834-bdf5-f1673fa3dfa3.9c2bea89-b474-4ee7-af37-774476943bd3 Nov 04 12:31:30 devstack sudo[107495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:30 devstack sudo[107492]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-aeba9889-263a-464a-9198-662b0b2b4567 tempest-ProjectMemberTests-1539753999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-083fddde-aeaa-4ee8-a591-28cb4bfed82c" returned: 0 in 0.440s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-aeba9889-263a-464a-9198-662b0b2b4567 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-083fddde-aeaa-4ee8-a591-28cb4bfed82c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-083fddde-aeaa-4ee8-a591-28cb4bfed82c.b4fd7d37-111a-4c8d-8d33-a41a4f34c6ca 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:30 devstack sudo[107500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-083fddde-aeaa-4ee8-a591-28cb4bfed82c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-083fddde-aeaa-4ee8-a591-28cb4bfed82c.b4fd7d37-111a-4c8d-8d33-a41a4f34c6ca 1G Nov 04 12:31:30 devstack sudo[107500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-040704df-5b49-453f-9ef2-c9a0433bbff9 tempest-SnapshotDependencyTests-2006240278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:31:30 devstack sudo[107495]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-db88e144-c0ba-4631-a141-efae43036a3d tempest-VolumeDependencyTests-1891787336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c78bed21-094b-4834-bdf5-f1673fa3dfa3.9c2bea89-b474-4ee7-af37-774476943bd3" returned: 0 in 0.423s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-db88e144-c0ba-4631-a141-efae43036a3d tempest-VolumeDependencyTests-1891787336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c78bed21-094b-4834-bdf5-f1673fa3dfa3.9c2bea89-b474-4ee7-af37-774476943bd3 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:30 devstack sudo[107506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c78bed21-094b-4834-bdf5-f1673fa3dfa3.9c2bea89-b474-4ee7-af37-774476943bd3 Nov 04 12:31:30 devstack sudo[107506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:30 devstack sudo[107500]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-aeba9889-263a-464a-9198-662b0b2b4567 tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-083fddde-aeaa-4ee8-a591-28cb4bfed82c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-083fddde-aeaa-4ee8-a591-28cb4bfed82c.b4fd7d37-111a-4c8d-8d33-a41a4f34c6ca 1G" returned: 0 in 0.544s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-aeba9889-263a-464a-9198-662b0b2b4567 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-083fddde-aeaa-4ee8-a591-28cb4bfed82c -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-083fddde-aeaa-4ee8-a591-28cb4bfed82c.b4fd7d37-111a-4c8d-8d33-a41a4f34c6ca {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:30 devstack sudo[107506]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-db88e144-c0ba-4631-a141-efae43036a3d tempest-VolumeDependencyTests-1891787336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c78bed21-094b-4834-bdf5-f1673fa3dfa3.9c2bea89-b474-4ee7-af37-774476943bd3" returned: 0 in 0.295s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:30 devstack sudo[107513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-083fddde-aeaa-4ee8-a591-28cb4bfed82c -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-083fddde-aeaa-4ee8-a591-28cb4bfed82c.b4fd7d37-111a-4c8d-8d33-a41a4f34c6ca Nov 04 12:31:30 devstack sudo[107513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:30 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-db88e144-c0ba-4631-a141-efae43036a3d tempest-VolumeDependencyTests-1891787336 None] Lock "cinder-quobyte-9c2bea89-b474-4ee7-af37-774476943bd3" released by "_delete_snapshot" :: held 1.986s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:31:30 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-db88e144-c0ba-4631-a141-efae43036a3d tempest-VolumeDependencyTests-1891787336 None] Lock "cinder-quobyte-c78bed21-094b-4834-bdf5-f1673fa3dfa3" released by "delete_snapshot" :: held 2.018s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:31:31 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-db88e144-c0ba-4631-a141-efae43036a3d tempest-VolumeDependencyTests-1891787336 None] Created reservations ['36dbb3fe-36bc-4f7e-a2be-d5bcb9173b89', 'be97267d-33f5-4c5a-bb11-072e3b564d10', '4e9cb5f6-4c56-4cba-83b4-824e082d9788', '65e1f864-591e-4fe9-91b1-1cfce7ca14f7'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:31:31 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-db88e144-c0ba-4631-a141-efae43036a3d tempest-VolumeDependencyTests-1891787336 None] Delete snapshot completed successfully. Nov 04 12:31:31 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-db88e144-c0ba-4631-a141-efae43036a3d tempest-VolumeDependencyTests-1891787336 None] Lock "cinder-9c2bea89-b474-4ee7-af37-774476943bd3-delete_snapshot" released by "delete_snapshot" :: held 2.185s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:31:31 devstack sudo[107513]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-aeba9889-263a-464a-9198-662b0b2b4567 tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-083fddde-aeaa-4ee8-a591-28cb4bfed82c -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-083fddde-aeaa-4ee8-a591-28cb4bfed82c.b4fd7d37-111a-4c8d-8d33-a41a4f34c6ca" returned: 0 in 0.346s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:31 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-aeba9889-263a-464a-9198-662b0b2b4567 tempest-ProjectMemberTests-1539753999 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-083fddde-aeaa-4ee8-a591-28cb4bfed82c.b4fd7d37-111a-4c8d-8d33-a41a4f34c6ca is being set with open permissions: ugo+rw Nov 04 12:31:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-aeba9889-263a-464a-9198-662b0b2b4567 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-083fddde-aeaa-4ee8-a591-28cb4bfed82c.b4fd7d37-111a-4c8d-8d33-a41a4f34c6ca {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:31 devstack sudo[107518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-083fddde-aeaa-4ee8-a591-28cb4bfed82c.b4fd7d37-111a-4c8d-8d33-a41a4f34c6ca Nov 04 12:31:31 devstack sudo[107518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:31 devstack sudo[107518]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-aeba9889-263a-464a-9198-662b0b2b4567 tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-083fddde-aeaa-4ee8-a591-28cb4bfed82c.b4fd7d37-111a-4c8d-8d33-a41a4f34c6ca" returned: 0 in 0.267s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-aeba9889-263a-464a-9198-662b0b2b4567 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-083fddde-aeaa-4ee8-a591-28cb4bfed82c.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:31 devstack sudo[107521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-083fddde-aeaa-4ee8-a591-28cb4bfed82c.info Nov 04 12:31:31 devstack sudo[107521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:31 devstack sudo[107521]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-aeba9889-263a-464a-9198-662b0b2b4567 tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-083fddde-aeaa-4ee8-a591-28cb4bfed82c.info" returned: 0 in 0.265s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:31 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-aeba9889-263a-464a-9198-662b0b2b4567 tempest-ProjectMemberTests-1539753999 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-083fddde-aeaa-4ee8-a591-28cb4bfed82c.info is being set with open permissions: ugo+rw Nov 04 12:31:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-aeba9889-263a-464a-9198-662b0b2b4567 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-083fddde-aeaa-4ee8-a591-28cb4bfed82c.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:31 devstack sudo[107524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-083fddde-aeaa-4ee8-a591-28cb4bfed82c.info Nov 04 12:31:31 devstack sudo[107524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:32 devstack sudo[107524]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-aeba9889-263a-464a-9198-662b0b2b4567 tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-083fddde-aeaa-4ee8-a591-28cb4bfed82c.info" returned: 0 in 0.275s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-aeba9889-263a-464a-9198-662b0b2b4567 tempest-ProjectMemberTests-1539753999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.240s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:31:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-040704df-5b49-453f-9ef2-c9a0433bbff9 tempest-SnapshotDependencyTests-2006240278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.559s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:31:32 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-040704df-5b49-453f-9ef2-c9a0433bbff9 tempest-SnapshotDependencyTests-2006240278 None] Creating offline snapshot 5a6bee95-7a06-4424-aea9-08834f1b18c5 of volume 09cc60d7-39fc-430e-9250-7dea3db224b4 {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 12:31:32 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-aeba9889-263a-464a-9198-662b0b2b4567 tempest-ProjectMemberTests-1539753999 None] Create snapshot completed successfully Nov 04 12:31:32 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5bc281a-5979-40c7-872e-75a9117e1b0f]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:31:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-040704df-5b49-453f-9ef2-c9a0433bbff9 tempest-SnapshotDependencyTests-2006240278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-09cc60d7-39fc-430e-9250-7dea3db224b4 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:32 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-936a615d-8b25-46de-acbb-1a07ebe5b65b tempest-VolumeDependencyTests-1891787336 None] Acquiring lock "cinder-c78bed21-094b-4834-bdf5-f1673fa3dfa3-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:31:32 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-936a615d-8b25-46de-acbb-1a07ebe5b65b tempest-VolumeDependencyTests-1891787336 None] Lock "cinder-c78bed21-094b-4834-bdf5-f1673fa3dfa3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:31:32 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-936a615d-8b25-46de-acbb-1a07ebe5b65b tempest-VolumeDependencyTests-1891787336 None] Acquiring lock "cinder-quobyte-c78bed21-094b-4834-bdf5-f1673fa3dfa3" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:31:32 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-936a615d-8b25-46de-acbb-1a07ebe5b65b tempest-VolumeDependencyTests-1891787336 None] Lock "cinder-quobyte-c78bed21-094b-4834-bdf5-f1673fa3dfa3" acquired by "delete_volume" :: waited 0.020s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:31:32 devstack sudo[107527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-09cc60d7-39fc-430e-9250-7dea3db224b4 Nov 04 12:31:32 devstack sudo[107527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:32 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae571ff-026e-4b79-9b7a-9b33155bed2c]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:31:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-936a615d-8b25-46de-acbb-1a07ebe5b65b tempest-VolumeDependencyTests-1891787336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c78bed21-094b-4834-bdf5-f1673fa3dfa3 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:32 devstack sudo[107529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c78bed21-094b-4834-bdf5-f1673fa3dfa3 Nov 04 12:31:32 devstack sudo[107529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:32 devstack sudo[107527]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-040704df-5b49-453f-9ef2-c9a0433bbff9 tempest-SnapshotDependencyTests-2006240278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-09cc60d7-39fc-430e-9250-7dea3db224b4" returned: 0 in 0.409s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-040704df-5b49-453f-9ef2-c9a0433bbff9 tempest-SnapshotDependencyTests-2006240278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-09cc60d7-39fc-430e-9250-7dea3db224b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-09cc60d7-39fc-430e-9250-7dea3db224b4.5a6bee95-7a06-4424-aea9-08834f1b18c5 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:32 devstack sudo[107534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-09cc60d7-39fc-430e-9250-7dea3db224b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-09cc60d7-39fc-430e-9250-7dea3db224b4.5a6bee95-7a06-4424-aea9-08834f1b18c5 1G Nov 04 12:31:32 devstack sudo[107534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:32 devstack sudo[107529]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-936a615d-8b25-46de-acbb-1a07ebe5b65b tempest-VolumeDependencyTests-1891787336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c78bed21-094b-4834-bdf5-f1673fa3dfa3" returned: 0 in 0.418s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-936a615d-8b25-46de-acbb-1a07ebe5b65b tempest-VolumeDependencyTests-1891787336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c78bed21-094b-4834-bdf5-f1673fa3dfa3 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:32 devstack sudo[107573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c78bed21-094b-4834-bdf5-f1673fa3dfa3 Nov 04 12:31:32 devstack sudo[107573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:32 devstack sudo[107573]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-936a615d-8b25-46de-acbb-1a07ebe5b65b tempest-VolumeDependencyTests-1891787336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c78bed21-094b-4834-bdf5-f1673fa3dfa3" returned: 0 in 0.320s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:33 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-936a615d-8b25-46de-acbb-1a07ebe5b65b tempest-VolumeDependencyTests-1891787336 None] Lock "cinder-quobyte-c78bed21-094b-4834-bdf5-f1673fa3dfa3" released by "delete_volume" :: held 0.817s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:31:33 devstack sudo[107534]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-040704df-5b49-453f-9ef2-c9a0433bbff9 tempest-SnapshotDependencyTests-2006240278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-09cc60d7-39fc-430e-9250-7dea3db224b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-09cc60d7-39fc-430e-9250-7dea3db224b4.5a6bee95-7a06-4424-aea9-08834f1b18c5 1G" returned: 0 in 0.559s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-040704df-5b49-453f-9ef2-c9a0433bbff9 tempest-SnapshotDependencyTests-2006240278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09cc60d7-39fc-430e-9250-7dea3db224b4 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-09cc60d7-39fc-430e-9250-7dea3db224b4.5a6bee95-7a06-4424-aea9-08834f1b18c5 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:33 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-bc74eff4-0425-4c5f-960d-5cfad1ac2b10 tempest-ProjectMemberTests-1539753999 None] Acquiring lock "cinder-b4fd7d37-111a-4c8d-8d33-a41a4f34c6ca-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:31:33 devstack sudo[107581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09cc60d7-39fc-430e-9250-7dea3db224b4 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-09cc60d7-39fc-430e-9250-7dea3db224b4.5a6bee95-7a06-4424-aea9-08834f1b18c5 Nov 04 12:31:33 devstack sudo[107581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:33 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-bc74eff4-0425-4c5f-960d-5cfad1ac2b10 tempest-ProjectMemberTests-1539753999 None] Lock "cinder-b4fd7d37-111a-4c8d-8d33-a41a4f34c6ca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:31:33 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-bc74eff4-0425-4c5f-960d-5cfad1ac2b10 tempest-ProjectMemberTests-1539753999 None] Acquiring lock "cinder-quobyte-083fddde-aeaa-4ee8-a591-28cb4bfed82c" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:31:33 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-bc74eff4-0425-4c5f-960d-5cfad1ac2b10 tempest-ProjectMemberTests-1539753999 None] Lock "cinder-quobyte-083fddde-aeaa-4ee8-a591-28cb4bfed82c" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:31:33 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-bc74eff4-0425-4c5f-960d-5cfad1ac2b10 tempest-ProjectMemberTests-1539753999 None] Acquiring lock "cinder-quobyte-b4fd7d37-111a-4c8d-8d33-a41a4f34c6ca" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:31:33 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-936a615d-8b25-46de-acbb-1a07ebe5b65b tempest-VolumeDependencyTests-1891787336 None] Created reservations ['0465e9e7-baae-4b89-a981-fa6908d99232', 'f87ea2a1-7421-4c8d-aa9a-4a4c78fb27aa', 'ed6af77f-c4d2-4ae8-b225-b65f1f08bba0', '12b01ddd-4be5-4e90-9405-90425eed502c'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:31:33 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-bc74eff4-0425-4c5f-960d-5cfad1ac2b10 tempest-ProjectMemberTests-1539753999 None] Lock "cinder-quobyte-b4fd7d37-111a-4c8d-8d33-a41a4f34c6ca" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:31:33 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-bc74eff4-0425-4c5f-960d-5cfad1ac2b10 tempest-ProjectMemberTests-1539753999 None] Deleting offline snapshot b4fd7d37-111a-4c8d-8d33-a41a4f34c6ca of volume 083fddde-aeaa-4ee8-a591-28cb4bfed82c {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 12:31:33 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-bc74eff4-0425-4c5f-960d-5cfad1ac2b10 tempest-ProjectMemberTests-1539753999 None] snapshot_file for this snap is: volume-083fddde-aeaa-4ee8-a591-28cb4bfed82c.b4fd7d37-111a-4c8d-8d33-a41a4f34c6ca {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 12:31:33 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b7fde5-a89f-41d0-bc0e-694b2973134f]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:31:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-bc74eff4-0425-4c5f-960d-5cfad1ac2b10 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-083fddde-aeaa-4ee8-a591-28cb4bfed82c.b4fd7d37-111a-4c8d-8d33-a41a4f34c6ca {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-936a615d-8b25-46de-acbb-1a07ebe5b65b tempest-VolumeDependencyTests-1891787336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:31:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-936a615d-8b25-46de-acbb-1a07ebe5b65b tempest-VolumeDependencyTests-1891787336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:31:33 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-936a615d-8b25-46de-acbb-1a07ebe5b65b tempest-VolumeDependencyTests-1891787336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:31:33 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-936a615d-8b25-46de-acbb-1a07ebe5b65b tempest-VolumeDependencyTests-1891787336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:31:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-936a615d-8b25-46de-acbb-1a07ebe5b65b tempest-VolumeDependencyTests-1891787336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:31:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-936a615d-8b25-46de-acbb-1a07ebe5b65b tempest-VolumeDependencyTests-1891787336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:33 devstack sudo[107584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:31:33 devstack sudo[107584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:33 devstack sudo[107583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-083fddde-aeaa-4ee8-a591-28cb4bfed82c.b4fd7d37-111a-4c8d-8d33-a41a4f34c6ca Nov 04 12:31:33 devstack sudo[107583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:33 devstack sudo[107581]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-040704df-5b49-453f-9ef2-c9a0433bbff9 tempest-SnapshotDependencyTests-2006240278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09cc60d7-39fc-430e-9250-7dea3db224b4 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-09cc60d7-39fc-430e-9250-7dea3db224b4.5a6bee95-7a06-4424-aea9-08834f1b18c5" returned: 0 in 0.455s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:33 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-040704df-5b49-453f-9ef2-c9a0433bbff9 tempest-SnapshotDependencyTests-2006240278 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-09cc60d7-39fc-430e-9250-7dea3db224b4.5a6bee95-7a06-4424-aea9-08834f1b18c5 is being set with open permissions: ugo+rw Nov 04 12:31:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-040704df-5b49-453f-9ef2-c9a0433bbff9 tempest-SnapshotDependencyTests-2006240278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-09cc60d7-39fc-430e-9250-7dea3db224b4.5a6bee95-7a06-4424-aea9-08834f1b18c5 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:33 devstack sudo[107591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-09cc60d7-39fc-430e-9250-7dea3db224b4.5a6bee95-7a06-4424-aea9-08834f1b18c5 Nov 04 12:31:33 devstack sudo[107591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:33 devstack sudo[107584]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-936a615d-8b25-46de-acbb-1a07ebe5b65b tempest-VolumeDependencyTests-1891787336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.294s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:33 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-936a615d-8b25-46de-acbb-1a07ebe5b65b tempest-VolumeDependencyTests-1891787336 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:31:33 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-936a615d-8b25-46de-acbb-1a07ebe5b65b tempest-VolumeDependencyTests-1891787336 None] Deleted volume successfully. Nov 04 12:31:33 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-936a615d-8b25-46de-acbb-1a07ebe5b65b tempest-VolumeDependencyTests-1891787336 None] Lock "cinder-c78bed21-094b-4834-bdf5-f1673fa3dfa3-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:31:33 devstack sudo[107583]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-bc74eff4-0425-4c5f-960d-5cfad1ac2b10 tempest-ProjectMemberTests-1539753999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-083fddde-aeaa-4ee8-a591-28cb4bfed82c.b4fd7d37-111a-4c8d-8d33-a41a4f34c6ca" returned: 0 in 0.516s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:33 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-bc74eff4-0425-4c5f-960d-5cfad1ac2b10 tempest-ProjectMemberTests-1539753999 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-083fddde-aeaa-4ee8-a591-28cb4bfed82c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 12:31:33 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2fcdd54-eea3-4689-958d-28cf1379c01d]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:31:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-bc74eff4-0425-4c5f-960d-5cfad1ac2b10 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-083fddde-aeaa-4ee8-a591-28cb4bfed82c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:33 devstack sudo[107591]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-040704df-5b49-453f-9ef2-c9a0433bbff9 tempest-SnapshotDependencyTests-2006240278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-09cc60d7-39fc-430e-9250-7dea3db224b4.5a6bee95-7a06-4424-aea9-08834f1b18c5" returned: 0 in 0.354s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-040704df-5b49-453f-9ef2-c9a0433bbff9 tempest-SnapshotDependencyTests-2006240278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-09cc60d7-39fc-430e-9250-7dea3db224b4.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:33 devstack sudo[107599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-083fddde-aeaa-4ee8-a591-28cb4bfed82c Nov 04 12:31:33 devstack sudo[107599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:33 devstack sudo[107600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-09cc60d7-39fc-430e-9250-7dea3db224b4.info Nov 04 12:31:33 devstack sudo[107600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:34 devstack sudo[107600]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-040704df-5b49-453f-9ef2-c9a0433bbff9 tempest-SnapshotDependencyTests-2006240278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-09cc60d7-39fc-430e-9250-7dea3db224b4.info" returned: 0 in 0.288s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:34 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-040704df-5b49-453f-9ef2-c9a0433bbff9 tempest-SnapshotDependencyTests-2006240278 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-09cc60d7-39fc-430e-9250-7dea3db224b4.info is being set with open permissions: ugo+rw Nov 04 12:31:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-040704df-5b49-453f-9ef2-c9a0433bbff9 tempest-SnapshotDependencyTests-2006240278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-09cc60d7-39fc-430e-9250-7dea3db224b4.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:34 devstack sudo[107607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-09cc60d7-39fc-430e-9250-7dea3db224b4.info Nov 04 12:31:34 devstack sudo[107607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:34 devstack sudo[107599]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-bc74eff4-0425-4c5f-960d-5cfad1ac2b10 tempest-ProjectMemberTests-1539753999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-083fddde-aeaa-4ee8-a591-28cb4bfed82c" returned: 0 in 0.428s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-bc74eff4-0425-4c5f-960d-5cfad1ac2b10 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-083fddde-aeaa-4ee8-a591-28cb4bfed82c.b4fd7d37-111a-4c8d-8d33-a41a4f34c6ca {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:34 devstack sudo[107609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-083fddde-aeaa-4ee8-a591-28cb4bfed82c.b4fd7d37-111a-4c8d-8d33-a41a4f34c6ca Nov 04 12:31:34 devstack sudo[107609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:34 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-1e6d2bf7-8278-4f01-9b01-902b92743575 tempest-VolumeDependencyTests-1891787336 None] Acquiring lock "cinder-9282fa43-19d5-472a-b892-e81f040ee59e-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:31:34 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-1e6d2bf7-8278-4f01-9b01-902b92743575 tempest-VolumeDependencyTests-1891787336 None] Lock "cinder-9282fa43-19d5-472a-b892-e81f040ee59e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:31:34 devstack sudo[107607]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:34 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-1e6d2bf7-8278-4f01-9b01-902b92743575 tempest-VolumeDependencyTests-1891787336 None] Acquiring lock "cinder-quobyte-9282fa43-19d5-472a-b892-e81f040ee59e" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:31:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-040704df-5b49-453f-9ef2-c9a0433bbff9 tempest-SnapshotDependencyTests-2006240278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-09cc60d7-39fc-430e-9250-7dea3db224b4.info" returned: 0 in 0.278s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-040704df-5b49-453f-9ef2-c9a0433bbff9 tempest-SnapshotDependencyTests-2006240278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.485s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:31:34 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-1e6d2bf7-8278-4f01-9b01-902b92743575 tempest-VolumeDependencyTests-1891787336 None] Lock "cinder-quobyte-9282fa43-19d5-472a-b892-e81f040ee59e" acquired by "delete_volume" :: waited 0.043s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:31:34 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[74249aaa-1b66-42f9-8e0a-889fcee653c1]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:31:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1e6d2bf7-8278-4f01-9b01-902b92743575 tempest-VolumeDependencyTests-1891787336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9282fa43-19d5-472a-b892-e81f040ee59e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:34 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-040704df-5b49-453f-9ef2-c9a0433bbff9 tempest-SnapshotDependencyTests-2006240278 None] Create snapshot completed successfully Nov 04 12:31:34 devstack sudo[107616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9282fa43-19d5-472a-b892-e81f040ee59e Nov 04 12:31:34 devstack sudo[107616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:34 devstack sudo[107609]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-bc74eff4-0425-4c5f-960d-5cfad1ac2b10 tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-083fddde-aeaa-4ee8-a591-28cb4bfed82c.b4fd7d37-111a-4c8d-8d33-a41a4f34c6ca" returned: 0 in 0.445s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-bc74eff4-0425-4c5f-960d-5cfad1ac2b10 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-083fddde-aeaa-4ee8-a591-28cb4bfed82c.b4fd7d37-111a-4c8d-8d33-a41a4f34c6ca {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:34 devstack sudo[107618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-083fddde-aeaa-4ee8-a591-28cb4bfed82c.b4fd7d37-111a-4c8d-8d33-a41a4f34c6ca Nov 04 12:31:34 devstack sudo[107618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:34 devstack sudo[107616]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1e6d2bf7-8278-4f01-9b01-902b92743575 tempest-VolumeDependencyTests-1891787336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9282fa43-19d5-472a-b892-e81f040ee59e" returned: 0 in 0.401s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1e6d2bf7-8278-4f01-9b01-902b92743575 tempest-VolumeDependencyTests-1891787336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9282fa43-19d5-472a-b892-e81f040ee59e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:35 devstack sudo[107618]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-bc74eff4-0425-4c5f-960d-5cfad1ac2b10 tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-083fddde-aeaa-4ee8-a591-28cb4bfed82c.b4fd7d37-111a-4c8d-8d33-a41a4f34c6ca" returned: 0 in 0.299s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:35 devstack sudo[107624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9282fa43-19d5-472a-b892-e81f040ee59e Nov 04 12:31:35 devstack sudo[107624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:35 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-bc74eff4-0425-4c5f-960d-5cfad1ac2b10 tempest-ProjectMemberTests-1539753999 None] Lock "cinder-quobyte-b4fd7d37-111a-4c8d-8d33-a41a4f34c6ca" released by "_delete_snapshot" :: held 1.872s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:31:35 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-bc74eff4-0425-4c5f-960d-5cfad1ac2b10 tempest-ProjectMemberTests-1539753999 None] Lock "cinder-quobyte-083fddde-aeaa-4ee8-a591-28cb4bfed82c" released by "delete_snapshot" :: held 1.913s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:31:35 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-bc74eff4-0425-4c5f-960d-5cfad1ac2b10 tempest-ProjectMemberTests-1539753999 None] Created reservations ['b89c1c0d-7b40-4aab-94c1-a4fd27d29749', 'ced54b92-50c5-4993-920a-60d3c34ade18', '2a84bbeb-1a42-4bb9-a3e0-ba3bb564b6e8', '8209a6ac-e202-43aa-b34e-d36b6177987a'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:31:35 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-bc74eff4-0425-4c5f-960d-5cfad1ac2b10 tempest-ProjectMemberTests-1539753999 None] Delete snapshot completed successfully. Nov 04 12:31:35 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-bc74eff4-0425-4c5f-960d-5cfad1ac2b10 tempest-ProjectMemberTests-1539753999 None] Lock "cinder-b4fd7d37-111a-4c8d-8d33-a41a4f34c6ca-delete_snapshot" released by "delete_snapshot" :: held 2.135s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:31:35 devstack sudo[107624]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1e6d2bf7-8278-4f01-9b01-902b92743575 tempest-VolumeDependencyTests-1891787336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9282fa43-19d5-472a-b892-e81f040ee59e" returned: 0 in 0.355s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:35 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-1e6d2bf7-8278-4f01-9b01-902b92743575 tempest-VolumeDependencyTests-1891787336 None] Lock "cinder-quobyte-9282fa43-19d5-472a-b892-e81f040ee59e" released by "delete_volume" :: held 0.810s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:31:35 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-a87f31d6-9322-45cb-8dba-0f6682d9fb1d tempest-SnapshotDependencyTests-2006240278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:31:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a87f31d6-9322-45cb-8dba-0f6682d9fb1d tempest-SnapshotDependencyTests-2006240278 None] Flow 'volume_create_manager' (180605ae-a511-4af1-878a-d98d8a9a3804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:31:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a87f31d6-9322-45cb-8dba-0f6682d9fb1d tempest-SnapshotDependencyTests-2006240278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb2bafed-7117-46c4-a42f-80369dd27545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:31:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a87f31d6-9322-45cb-8dba-0f6682d9fb1d tempest-SnapshotDependencyTests-2006240278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb2bafed-7117-46c4-a42f-80369dd27545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:31:35Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2e339f8-71db-4f65-8894-620856ce2e74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58f9b407c58d4166875ab0fb5ace95e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:31:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5a6bee95-7a06-4424-aea9-08834f1b18c5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:31:35Z,use_quota=True,user_id='93f274a8868c437898886f3e6a1370e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:31:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a87f31d6-9322-45cb-8dba-0f6682d9fb1d tempest-SnapshotDependencyTests-2006240278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3fab0e9-6ab1-4c79-8d56-b6665ae0ec1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:31:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a87f31d6-9322-45cb-8dba-0f6682d9fb1d tempest-SnapshotDependencyTests-2006240278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3fab0e9-6ab1-4c79-8d56-b6665ae0ec1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:31:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a87f31d6-9322-45cb-8dba-0f6682d9fb1d tempest-SnapshotDependencyTests-2006240278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0382fe9-c133-455d-b9be-aa9359f312cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:31:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a87f31d6-9322-45cb-8dba-0f6682d9fb1d tempest-SnapshotDependencyTests-2006240278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0382fe9-c133-455d-b9be-aa9359f312cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c2e339f8-71db-4f65-8894-620856ce2e74', 'volume_name': 'volume-c2e339f8-71db-4f65-8894-620856ce2e74', 'volume_size': 1, 'snapshot_id': '5a6bee95-7a06-4424-aea9-08834f1b18c5'}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:31:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a87f31d6-9322-45cb-8dba-0f6682d9fb1d tempest-SnapshotDependencyTests-2006240278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fad7e9cc-597c-43d0-84ff-63ac2a36c719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:31:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a87f31d6-9322-45cb-8dba-0f6682d9fb1d tempest-SnapshotDependencyTests-2006240278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fad7e9cc-597c-43d0-84ff-63ac2a36c719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:31:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a87f31d6-9322-45cb-8dba-0f6682d9fb1d tempest-SnapshotDependencyTests-2006240278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e5e6a59-c772-4c2f-8b20-32e1d127ec2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:31:35 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-a87f31d6-9322-45cb-8dba-0f6682d9fb1d tempest-SnapshotDependencyTests-2006240278 None] Volume c2e339f8-71db-4f65-8894-620856ce2e74: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c2e339f8-71db-4f65-8894-620856ce2e74', 'volume_size': 1, 'snapshot_id': '5a6bee95-7a06-4424-aea9-08834f1b18c5'} Nov 04 12:31:35 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-1e6d2bf7-8278-4f01-9b01-902b92743575 tempest-VolumeDependencyTests-1891787336 None] Created reservations ['8a350edf-318f-4357-8ef3-6669c682c57a', '23797aad-8674-4510-9116-dae146bcd0ea', 'b0797703-e4d4-46d7-b6a8-fa7c32f1a95b', 'a8e77018-85f7-47fb-aa8f-2c332d419356'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:31:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a87f31d6-9322-45cb-8dba-0f6682d9fb1d tempest-SnapshotDependencyTests-2006240278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:31:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a87f31d6-9322-45cb-8dba-0f6682d9fb1d tempest-SnapshotDependencyTests-2006240278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:31:35 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a87f31d6-9322-45cb-8dba-0f6682d9fb1d tempest-SnapshotDependencyTests-2006240278 None] Acquiring lock "cinder-quobyte-5a6bee95-7a06-4424-aea9-08834f1b18c5-c2e339f8-71db-4f65-8894-620856ce2e74" by "_create_volume_from_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:31:35 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a87f31d6-9322-45cb-8dba-0f6682d9fb1d tempest-SnapshotDependencyTests-2006240278 None] Lock "cinder-quobyte-5a6bee95-7a06-4424-aea9-08834f1b18c5-c2e339f8-71db-4f65-8894-620856ce2e74" acquired by "_create_volume_from_snapshot" :: waited 0.037s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:31:35 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a87f31d6-9322-45cb-8dba-0f6682d9fb1d tempest-SnapshotDependencyTests-2006240278 None] Creating volume c2e339f8-71db-4f65-8894-620856ce2e74 from snapshot 5a6bee95-7a06-4424-aea9-08834f1b18c5 {{(pid=87095) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 04 12:31:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a87f31d6-9322-45cb-8dba-0f6682d9fb1d tempest-SnapshotDependencyTests-2006240278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:31:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a87f31d6-9322-45cb-8dba-0f6682d9fb1d tempest-SnapshotDependencyTests-2006240278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:31:35 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a87f31d6-9322-45cb-8dba-0f6682d9fb1d tempest-SnapshotDependencyTests-2006240278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:31:35 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a87f31d6-9322-45cb-8dba-0f6682d9fb1d tempest-SnapshotDependencyTests-2006240278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:31:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a87f31d6-9322-45cb-8dba-0f6682d9fb1d tempest-SnapshotDependencyTests-2006240278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:31:35 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a87f31d6-9322-45cb-8dba-0f6682d9fb1d tempest-SnapshotDependencyTests-2006240278 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:31:35 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a87f31d6-9322-45cb-8dba-0f6682d9fb1d tempest-SnapshotDependencyTests-2006240278 None] Acquiring lock "cinder-quobyte-c2e339f8-71db-4f65-8894-620856ce2e74" by "_copy_volume_from_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:31:35 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a87f31d6-9322-45cb-8dba-0f6682d9fb1d tempest-SnapshotDependencyTests-2006240278 None] Lock "cinder-quobyte-c2e339f8-71db-4f65-8894-620856ce2e74" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:31:35 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a87f31d6-9322-45cb-8dba-0f6682d9fb1d tempest-SnapshotDependencyTests-2006240278 None] snapshot: 5a6bee95-7a06-4424-aea9-08834f1b18c5, volume: c2e339f8-71db-4f65-8894-620856ce2e74, {{(pid=87095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 12:31:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a87f31d6-9322-45cb-8dba-0f6682d9fb1d tempest-SnapshotDependencyTests-2006240278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:31:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a87f31d6-9322-45cb-8dba-0f6682d9fb1d tempest-SnapshotDependencyTests-2006240278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:31:35 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a87f31d6-9322-45cb-8dba-0f6682d9fb1d tempest-SnapshotDependencyTests-2006240278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:31:35 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a87f31d6-9322-45cb-8dba-0f6682d9fb1d tempest-SnapshotDependencyTests-2006240278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:31:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a87f31d6-9322-45cb-8dba-0f6682d9fb1d tempest-SnapshotDependencyTests-2006240278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:31:35 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68209cd-2db0-4724-bf33-36195a5e7080]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:31:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a87f31d6-9322-45cb-8dba-0f6682d9fb1d tempest-SnapshotDependencyTests-2006240278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-09cc60d7-39fc-430e-9250-7dea3db224b4.5a6bee95-7a06-4424-aea9-08834f1b18c5 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1e6d2bf7-8278-4f01-9b01-902b92743575 tempest-VolumeDependencyTests-1891787336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:31:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1e6d2bf7-8278-4f01-9b01-902b92743575 tempest-VolumeDependencyTests-1891787336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:31:35 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1e6d2bf7-8278-4f01-9b01-902b92743575 tempest-VolumeDependencyTests-1891787336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:31:35 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1e6d2bf7-8278-4f01-9b01-902b92743575 tempest-VolumeDependencyTests-1891787336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:31:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1e6d2bf7-8278-4f01-9b01-902b92743575 tempest-VolumeDependencyTests-1891787336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:31:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1e6d2bf7-8278-4f01-9b01-902b92743575 tempest-VolumeDependencyTests-1891787336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:35 devstack sudo[107629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:31:35 devstack sudo[107629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:35 devstack sudo[107628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-09cc60d7-39fc-430e-9250-7dea3db224b4.5a6bee95-7a06-4424-aea9-08834f1b18c5 Nov 04 12:31:35 devstack sudo[107628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:36 devstack sudo[107629]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1e6d2bf7-8278-4f01-9b01-902b92743575 tempest-VolumeDependencyTests-1891787336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.338s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:36 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-1e6d2bf7-8278-4f01-9b01-902b92743575 tempest-VolumeDependencyTests-1891787336 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:31:36 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-1e6d2bf7-8278-4f01-9b01-902b92743575 tempest-VolumeDependencyTests-1891787336 None] Deleted volume successfully. Nov 04 12:31:36 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-1e6d2bf7-8278-4f01-9b01-902b92743575 tempest-VolumeDependencyTests-1891787336 None] Lock "cinder-9282fa43-19d5-472a-b892-e81f040ee59e-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:31:36 devstack sudo[107628]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a87f31d6-9322-45cb-8dba-0f6682d9fb1d tempest-SnapshotDependencyTests-2006240278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-09cc60d7-39fc-430e-9250-7dea3db224b4.5a6bee95-7a06-4424-aea9-08834f1b18c5" returned: 0 in 0.473s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:36 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-a87f31d6-9322-45cb-8dba-0f6682d9fb1d tempest-SnapshotDependencyTests-2006240278 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-09cc60d7-39fc-430e-9250-7dea3db224b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 12:31:36 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff6fd72-4162-47ef-84c2-a4706be0ba5c]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:31:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a87f31d6-9322-45cb-8dba-0f6682d9fb1d tempest-SnapshotDependencyTests-2006240278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-09cc60d7-39fc-430e-9250-7dea3db224b4 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:36 devstack sudo[107636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-09cc60d7-39fc-430e-9250-7dea3db224b4 Nov 04 12:31:36 devstack sudo[107636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:36 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9911124a-4837-49c1-95f3-c301bc19eeb5 tempest-ProjectMemberTests-1539753999 None] Acquiring lock "cinder-083fddde-aeaa-4ee8-a591-28cb4bfed82c-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:31:36 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9911124a-4837-49c1-95f3-c301bc19eeb5 tempest-ProjectMemberTests-1539753999 None] Lock "cinder-083fddde-aeaa-4ee8-a591-28cb4bfed82c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:31:36 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9911124a-4837-49c1-95f3-c301bc19eeb5 tempest-ProjectMemberTests-1539753999 None] Acquiring lock "cinder-quobyte-083fddde-aeaa-4ee8-a591-28cb4bfed82c" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:31:36 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9911124a-4837-49c1-95f3-c301bc19eeb5 tempest-ProjectMemberTests-1539753999 None] Lock "cinder-quobyte-083fddde-aeaa-4ee8-a591-28cb4bfed82c" acquired by "delete_volume" :: waited 0.014s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:31:36 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a1c372-9242-4e99-8d29-cde9c069a590]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:31:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9911124a-4837-49c1-95f3-c301bc19eeb5 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-083fddde-aeaa-4ee8-a591-28cb4bfed82c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:36 devstack sudo[107636]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a87f31d6-9322-45cb-8dba-0f6682d9fb1d tempest-SnapshotDependencyTests-2006240278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-09cc60d7-39fc-430e-9250-7dea3db224b4" returned: 0 in 0.379s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:36 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a87f31d6-9322-45cb-8dba-0f6682d9fb1d tempest-SnapshotDependencyTests-2006240278 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-09cc60d7-39fc-430e-9250-7dea3db224b4 {{(pid=87095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 12:31:36 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a87f31d6-9322-45cb-8dba-0f6682d9fb1d tempest-SnapshotDependencyTests-2006240278 None] Creating direct copy from snapshot {{(pid=87095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 12:31:36 devstack cinder-volume[87095]: DEBUG cinder.utils [None req-a87f31d6-9322-45cb-8dba-0f6682d9fb1d tempest-SnapshotDependencyTests-2006240278 None] Path /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c2e339f8-71db-4f65-8894-620856ce2e74 not found in is_blk_device check {{(pid=87095) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 04 12:31:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a87f31d6-9322-45cb-8dba-0f6682d9fb1d tempest-SnapshotDependencyTests-2006240278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-09cc60d7-39fc-430e-9250-7dea3db224b4 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c2e339f8-71db-4f65-8894-620856ce2e74 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:36 devstack sudo[107638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-083fddde-aeaa-4ee8-a591-28cb4bfed82c Nov 04 12:31:36 devstack sudo[107638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:36 devstack sudo[107643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-09cc60d7-39fc-430e-9250-7dea3db224b4 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c2e339f8-71db-4f65-8894-620856ce2e74 Nov 04 12:31:36 devstack sudo[107643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:36 devstack sudo[107638]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9911124a-4837-49c1-95f3-c301bc19eeb5 tempest-ProjectMemberTests-1539753999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-083fddde-aeaa-4ee8-a591-28cb4bfed82c" returned: 0 in 0.422s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9911124a-4837-49c1-95f3-c301bc19eeb5 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-083fddde-aeaa-4ee8-a591-28cb4bfed82c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:36 devstack sudo[107654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-083fddde-aeaa-4ee8-a591-28cb4bfed82c Nov 04 12:31:36 devstack sudo[107654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:37 devstack sudo[107654]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9911124a-4837-49c1-95f3-c301bc19eeb5 tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-083fddde-aeaa-4ee8-a591-28cb4bfed82c" returned: 0 in 0.405s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:37 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9911124a-4837-49c1-95f3-c301bc19eeb5 tempest-ProjectMemberTests-1539753999 None] Lock "cinder-quobyte-083fddde-aeaa-4ee8-a591-28cb4bfed82c" released by "delete_volume" :: held 0.951s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:31:37 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-9911124a-4837-49c1-95f3-c301bc19eeb5 tempest-ProjectMemberTests-1539753999 None] Created reservations ['112f55c9-402a-4cfb-906a-d692c8407ae8', '280c21ad-91ce-4163-bab5-d5de43553293', '80470413-96f1-4923-a07b-a04644a63148', '356c48ba-5666-4462-9c99-8686c3a9f9e8'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:31:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9911124a-4837-49c1-95f3-c301bc19eeb5 tempest-ProjectMemberTests-1539753999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:31:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9911124a-4837-49c1-95f3-c301bc19eeb5 tempest-ProjectMemberTests-1539753999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:31:37 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9911124a-4837-49c1-95f3-c301bc19eeb5 tempest-ProjectMemberTests-1539753999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:31:37 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9911124a-4837-49c1-95f3-c301bc19eeb5 tempest-ProjectMemberTests-1539753999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:31:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9911124a-4837-49c1-95f3-c301bc19eeb5 tempest-ProjectMemberTests-1539753999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:31:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9911124a-4837-49c1-95f3-c301bc19eeb5 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:37 devstack sudo[107664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:31:37 devstack sudo[107664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:38 devstack sudo[107664]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9911124a-4837-49c1-95f3-c301bc19eeb5 tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.529s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:38 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-9911124a-4837-49c1-95f3-c301bc19eeb5 tempest-ProjectMemberTests-1539753999 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:31:38 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-9911124a-4837-49c1-95f3-c301bc19eeb5 tempest-ProjectMemberTests-1539753999 None] Deleted volume successfully. Nov 04 12:31:38 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9911124a-4837-49c1-95f3-c301bc19eeb5 tempest-ProjectMemberTests-1539753999 None] Lock "cinder-083fddde-aeaa-4ee8-a591-28cb4bfed82c-delete_volume" released by "delete_volume" :: held 2.114s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:31:40 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-125a1a29-0cdb-4b70-a102-a3111a3046b5 tempest-ProjectMemberTests-1539753999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:31:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-125a1a29-0cdb-4b70-a102-a3111a3046b5 tempest-ProjectMemberTests-1539753999 None] Flow 'volume_create_manager' (c96ec914-3c6b-4348-906c-946fd2b23bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:31:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-125a1a29-0cdb-4b70-a102-a3111a3046b5 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (972b556e-6689-4421-86d6-cbc9cafc7196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:31:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-125a1a29-0cdb-4b70-a102-a3111a3046b5 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (972b556e-6689-4421-86d6-cbc9cafc7196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:31:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-443098826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a073b98-be25-468e-9274-d16348796ec3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cb67397f4d04f049564f5d284f139d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:31:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:31:40Z,use_quota=True,user_id='091b86592c99419b9c07a685e7933341',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:31:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-125a1a29-0cdb-4b70-a102-a3111a3046b5 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6922d34-8132-4691-b2bb-ee3a612583e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:31:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-125a1a29-0cdb-4b70-a102-a3111a3046b5 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6922d34-8132-4691-b2bb-ee3a612583e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:31:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-125a1a29-0cdb-4b70-a102-a3111a3046b5 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1f2d8ba-6d45-4d28-869f-b83db7751219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:31:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-125a1a29-0cdb-4b70-a102-a3111a3046b5 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1f2d8ba-6d45-4d28-869f-b83db7751219) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a073b98-be25-468e-9274-d16348796ec3', 'volume_name': 'volume-6a073b98-be25-468e-9274-d16348796ec3', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:31:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-125a1a29-0cdb-4b70-a102-a3111a3046b5 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28a9dccd-d08a-4dc9-b289-6576fefc7d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:31:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-125a1a29-0cdb-4b70-a102-a3111a3046b5 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28a9dccd-d08a-4dc9-b289-6576fefc7d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:31:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-125a1a29-0cdb-4b70-a102-a3111a3046b5 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d6d1db3-8d73-4987-a104-7129b34cf380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:31:40 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-125a1a29-0cdb-4b70-a102-a3111a3046b5 tempest-ProjectMemberTests-1539753999 None] Volume 6a073b98-be25-468e-9274-d16348796ec3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a073b98-be25-468e-9274-d16348796ec3', 'volume_size': 1} Nov 04 12:31:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-125a1a29-0cdb-4b70-a102-a3111a3046b5 tempest-ProjectMemberTests-1539753999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:31:45 devstack sudo[107643]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a87f31d6-9322-45cb-8dba-0f6682d9fb1d tempest-SnapshotDependencyTests-2006240278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-09cc60d7-39fc-430e-9250-7dea3db224b4 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c2e339f8-71db-4f65-8894-620856ce2e74" returned: 0 in 8.544s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:45 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-a87f31d6-9322-45cb-8dba-0f6682d9fb1d tempest-SnapshotDependencyTests-2006240278 None] Image conversion details: src /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-09cc60d7-39fc-430e-9250-7dea3db224b4, size 1024.00 MB, duration 8.55 sec, destination /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c2e339f8-71db-4f65-8894-620856ce2e74 {{(pid=87095) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 12:31:45 devstack cinder-volume[87095]: INFO cinder.image.image_utils [None req-a87f31d6-9322-45cb-8dba-0f6682d9fb1d tempest-SnapshotDependencyTests-2006240278 None] Converted 1024.00 MB image at 119.83 MB/s Nov 04 12:31:45 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-a87f31d6-9322-45cb-8dba-0f6682d9fb1d tempest-SnapshotDependencyTests-2006240278 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c2e339f8-71db-4f65-8894-620856ce2e74 is being set with open permissions: ugo+rw Nov 04 12:31:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a87f31d6-9322-45cb-8dba-0f6682d9fb1d tempest-SnapshotDependencyTests-2006240278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c2e339f8-71db-4f65-8894-620856ce2e74 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:45 devstack sudo[107670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c2e339f8-71db-4f65-8894-620856ce2e74 Nov 04 12:31:45 devstack sudo[107670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:45 devstack sudo[107670]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a87f31d6-9322-45cb-8dba-0f6682d9fb1d tempest-SnapshotDependencyTests-2006240278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c2e339f8-71db-4f65-8894-620856ce2e74" returned: 0 in 0.303s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:45 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a87f31d6-9322-45cb-8dba-0f6682d9fb1d tempest-SnapshotDependencyTests-2006240278 None] Lock "cinder-quobyte-c2e339f8-71db-4f65-8894-620856ce2e74" released by "_copy_volume_from_snapshot" :: held 9.825s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:31:45 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a87f31d6-9322-45cb-8dba-0f6682d9fb1d tempest-SnapshotDependencyTests-2006240278 None] Lock "cinder-quobyte-5a6bee95-7a06-4424-aea9-08834f1b18c5-c2e339f8-71db-4f65-8894-620856ce2e74" released by "_create_volume_from_snapshot" :: held 9.912s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:31:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a87f31d6-9322-45cb-8dba-0f6682d9fb1d tempest-SnapshotDependencyTests-2006240278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.950s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:31:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-125a1a29-0cdb-4b70-a102-a3111a3046b5 tempest-ProjectMemberTests-1539753999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.074s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:31:45 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-125a1a29-0cdb-4b70-a102-a3111a3046b5 tempest-ProjectMemberTests-1539753999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:31:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-443098826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a073b98-be25-468e-9274-d16348796ec3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cb67397f4d04f049564f5d284f139d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:31:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:31:40Z,use_quota=True,user_id='091b86592c99419b9c07a685e7933341',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:31:45 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-125a1a29-0cdb-4b70-a102-a3111a3046b5 tempest-ProjectMemberTests-1539753999 None] Creating volume 6a073b98-be25-468e-9274-d16348796ec3 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:31:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-125a1a29-0cdb-4b70-a102-a3111a3046b5 tempest-ProjectMemberTests-1539753999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:31:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-125a1a29-0cdb-4b70-a102-a3111a3046b5 tempest-ProjectMemberTests-1539753999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:31:45 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-125a1a29-0cdb-4b70-a102-a3111a3046b5 tempest-ProjectMemberTests-1539753999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:31:45 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-125a1a29-0cdb-4b70-a102-a3111a3046b5 tempest-ProjectMemberTests-1539753999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:31:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-125a1a29-0cdb-4b70-a102-a3111a3046b5 tempest-ProjectMemberTests-1539753999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:31:45 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-125a1a29-0cdb-4b70-a102-a3111a3046b5 tempest-ProjectMemberTests-1539753999 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:31:45 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-125a1a29-0cdb-4b70-a102-a3111a3046b5 tempest-ProjectMemberTests-1539753999 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:31:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-125a1a29-0cdb-4b70-a102-a3111a3046b5 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6a073b98-be25-468e-9274-d16348796ec3 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:45 devstack sudo[107673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6a073b98-be25-468e-9274-d16348796ec3 1073741824 Nov 04 12:31:45 devstack sudo[107673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a87f31d6-9322-45cb-8dba-0f6682d9fb1d tempest-SnapshotDependencyTests-2006240278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e5e6a59-c772-4c2f-8b20-32e1d127ec2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2e339f8-71db-4f65-8894-620856ce2e74', 'volume_size': 1, 'snapshot_id': '5a6bee95-7a06-4424-aea9-08834f1b18c5'}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:31:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a87f31d6-9322-45cb-8dba-0f6682d9fb1d tempest-SnapshotDependencyTests-2006240278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d800f8a7-db64-4d40-9317-46f290d0b269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:31:45 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4e6e1cb-8f3d-4f96-b5ab-9ddeb8d7db8d tempest-ProjectReaderTests-34452203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:31:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f4e6e1cb-8f3d-4f96-b5ab-9ddeb8d7db8d tempest-ProjectReaderTests-34452203 None] Flow 'volume_create_manager' (aa389d08-8505-4140-84ec-268a131b7173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:31:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f4e6e1cb-8f3d-4f96-b5ab-9ddeb8d7db8d tempest-ProjectReaderTests-34452203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51a6cacf-e1a0-446b-ab09-bc79c60c8ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:31:45 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-a87f31d6-9322-45cb-8dba-0f6682d9fb1d tempest-SnapshotDependencyTests-2006240278 None] Volume volume-c2e339f8-71db-4f65-8894-620856ce2e74 (c2e339f8-71db-4f65-8894-620856ce2e74): created successfully Nov 04 12:31:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a87f31d6-9322-45cb-8dba-0f6682d9fb1d tempest-SnapshotDependencyTests-2006240278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d800f8a7-db64-4d40-9317-46f290d0b269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:31:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a87f31d6-9322-45cb-8dba-0f6682d9fb1d tempest-SnapshotDependencyTests-2006240278 None] Flow 'volume_create_manager' (180605ae-a511-4af1-878a-d98d8a9a3804) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:31:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f4e6e1cb-8f3d-4f96-b5ab-9ddeb8d7db8d tempest-ProjectReaderTests-34452203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51a6cacf-e1a0-446b-ab09-bc79c60c8ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:31:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1286796077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6fdbc6f-3bc4-4b46-a997-83d0da9ee1a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb954983f7c64fe388fdbeaf1cdc0a5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:31:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:31:46Z,use_quota=True,user_id='f3d9809a097943a5b1cd27d05f8ff1ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:31:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f4e6e1cb-8f3d-4f96-b5ab-9ddeb8d7db8d tempest-ProjectReaderTests-34452203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3c5193e-09db-41f6-a9ee-1f9ce179fff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:31:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f4e6e1cb-8f3d-4f96-b5ab-9ddeb8d7db8d tempest-ProjectReaderTests-34452203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3c5193e-09db-41f6-a9ee-1f9ce179fff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:31:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f4e6e1cb-8f3d-4f96-b5ab-9ddeb8d7db8d tempest-ProjectReaderTests-34452203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (448fe07d-4774-4079-939a-985bba6b490f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:31:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f4e6e1cb-8f3d-4f96-b5ab-9ddeb8d7db8d tempest-ProjectReaderTests-34452203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (448fe07d-4774-4079-939a-985bba6b490f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6fdbc6f-3bc4-4b46-a997-83d0da9ee1a0', 'volume_name': 'volume-f6fdbc6f-3bc4-4b46-a997-83d0da9ee1a0', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:31:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f4e6e1cb-8f3d-4f96-b5ab-9ddeb8d7db8d tempest-ProjectReaderTests-34452203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c70d79b-19d6-420c-813b-b2407e36bed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:31:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f4e6e1cb-8f3d-4f96-b5ab-9ddeb8d7db8d tempest-ProjectReaderTests-34452203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c70d79b-19d6-420c-813b-b2407e36bed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:31:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f4e6e1cb-8f3d-4f96-b5ab-9ddeb8d7db8d tempest-ProjectReaderTests-34452203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c792ec6-13c6-46fc-a625-d4e306141af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:31:45 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-f4e6e1cb-8f3d-4f96-b5ab-9ddeb8d7db8d tempest-ProjectReaderTests-34452203 None] Volume f6fdbc6f-3bc4-4b46-a997-83d0da9ee1a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6fdbc6f-3bc4-4b46-a997-83d0da9ee1a0', 'volume_size': 1} Nov 04 12:31:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f4e6e1cb-8f3d-4f96-b5ab-9ddeb8d7db8d tempest-ProjectReaderTests-34452203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:31:45 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-a87f31d6-9322-45cb-8dba-0f6682d9fb1d tempest-SnapshotDependencyTests-2006240278 None] Created volume successfully. Nov 04 12:31:46 devstack sudo[107673]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-125a1a29-0cdb-4b70-a102-a3111a3046b5 tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6a073b98-be25-468e-9274-d16348796ec3 1073741824" returned: 0 in 0.520s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-125a1a29-0cdb-4b70-a102-a3111a3046b5 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6a073b98-be25-468e-9274-d16348796ec3 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:46 devstack sudo[107679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6a073b98-be25-468e-9274-d16348796ec3 Nov 04 12:31:46 devstack sudo[107679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:46 devstack sudo[107679]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-125a1a29-0cdb-4b70-a102-a3111a3046b5 tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6a073b98-be25-468e-9274-d16348796ec3" returned: 0 in 0.241s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:46 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-125a1a29-0cdb-4b70-a102-a3111a3046b5 tempest-ProjectMemberTests-1539753999 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:31:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-125a1a29-0cdb-4b70-a102-a3111a3046b5 tempest-ProjectMemberTests-1539753999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:31:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f4e6e1cb-8f3d-4f96-b5ab-9ddeb8d7db8d tempest-ProjectReaderTests-34452203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.559s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:31:46 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f4e6e1cb-8f3d-4f96-b5ab-9ddeb8d7db8d tempest-ProjectReaderTests-34452203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:31:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1286796077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6fdbc6f-3bc4-4b46-a997-83d0da9ee1a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb954983f7c64fe388fdbeaf1cdc0a5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:31:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:31:46Z,use_quota=True,user_id='f3d9809a097943a5b1cd27d05f8ff1ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:31:46 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-f4e6e1cb-8f3d-4f96-b5ab-9ddeb8d7db8d tempest-ProjectReaderTests-34452203 None] Creating volume f6fdbc6f-3bc4-4b46-a997-83d0da9ee1a0 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:31:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f4e6e1cb-8f3d-4f96-b5ab-9ddeb8d7db8d tempest-ProjectReaderTests-34452203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:31:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f4e6e1cb-8f3d-4f96-b5ab-9ddeb8d7db8d tempest-ProjectReaderTests-34452203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:31:46 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f4e6e1cb-8f3d-4f96-b5ab-9ddeb8d7db8d tempest-ProjectReaderTests-34452203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:31:46 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f4e6e1cb-8f3d-4f96-b5ab-9ddeb8d7db8d tempest-ProjectReaderTests-34452203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:31:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f4e6e1cb-8f3d-4f96-b5ab-9ddeb8d7db8d tempest-ProjectReaderTests-34452203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:31:46 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f4e6e1cb-8f3d-4f96-b5ab-9ddeb8d7db8d tempest-ProjectReaderTests-34452203 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:31:46 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-f4e6e1cb-8f3d-4f96-b5ab-9ddeb8d7db8d tempest-ProjectReaderTests-34452203 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:31:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f4e6e1cb-8f3d-4f96-b5ab-9ddeb8d7db8d tempest-ProjectReaderTests-34452203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f6fdbc6f-3bc4-4b46-a997-83d0da9ee1a0 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:46 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-125a1a29-0cdb-4b70-a102-a3111a3046b5 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d6d1db3-8d73-4987-a104-7129b34cf380) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a073b98-be25-468e-9274-d16348796ec3', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:31:46 devstack sudo[107682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f6fdbc6f-3bc4-4b46-a997-83d0da9ee1a0 1073741824 Nov 04 12:31:46 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-125a1a29-0cdb-4b70-a102-a3111a3046b5 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79271f10-955d-467f-8875-3212104d0c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:31:46 devstack sudo[107682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:46 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-125a1a29-0cdb-4b70-a102-a3111a3046b5 tempest-ProjectMemberTests-1539753999 None] Volume volume-6a073b98-be25-468e-9274-d16348796ec3 (6a073b98-be25-468e-9274-d16348796ec3): created successfully Nov 04 12:31:46 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-125a1a29-0cdb-4b70-a102-a3111a3046b5 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79271f10-955d-467f-8875-3212104d0c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:31:46 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-125a1a29-0cdb-4b70-a102-a3111a3046b5 tempest-ProjectMemberTests-1539753999 None] Flow 'volume_create_manager' (c96ec914-3c6b-4348-906c-946fd2b23bb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:31:46 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-125a1a29-0cdb-4b70-a102-a3111a3046b5 tempest-ProjectMemberTests-1539753999 None] Created volume successfully. Nov 04 12:31:46 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c68a7281-6491-4d36-b826-5820f1f04c97 tempest-SnapshotDependencyTests-2006240278 None] Acquiring lock "cinder-5a6bee95-7a06-4424-aea9-08834f1b18c5-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:31:46 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c68a7281-6491-4d36-b826-5820f1f04c97 tempest-SnapshotDependencyTests-2006240278 None] Lock "cinder-5a6bee95-7a06-4424-aea9-08834f1b18c5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:31:46 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c68a7281-6491-4d36-b826-5820f1f04c97 tempest-SnapshotDependencyTests-2006240278 None] Acquiring lock "cinder-quobyte-09cc60d7-39fc-430e-9250-7dea3db224b4" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:31:46 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c68a7281-6491-4d36-b826-5820f1f04c97 tempest-SnapshotDependencyTests-2006240278 None] Lock "cinder-quobyte-09cc60d7-39fc-430e-9250-7dea3db224b4" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:31:46 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c68a7281-6491-4d36-b826-5820f1f04c97 tempest-SnapshotDependencyTests-2006240278 None] Acquiring lock "cinder-quobyte-5a6bee95-7a06-4424-aea9-08834f1b18c5" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:31:46 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c68a7281-6491-4d36-b826-5820f1f04c97 tempest-SnapshotDependencyTests-2006240278 None] Lock "cinder-quobyte-5a6bee95-7a06-4424-aea9-08834f1b18c5" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:31:46 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-c68a7281-6491-4d36-b826-5820f1f04c97 tempest-SnapshotDependencyTests-2006240278 None] Deleting offline snapshot 5a6bee95-7a06-4424-aea9-08834f1b18c5 of volume 09cc60d7-39fc-430e-9250-7dea3db224b4 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 12:31:46 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-c68a7281-6491-4d36-b826-5820f1f04c97 tempest-SnapshotDependencyTests-2006240278 None] snapshot_file for this snap is: volume-09cc60d7-39fc-430e-9250-7dea3db224b4.5a6bee95-7a06-4424-aea9-08834f1b18c5 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 12:31:46 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c7e741-b0c5-41fe-8b2d-7db86104d531]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:31:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c68a7281-6491-4d36-b826-5820f1f04c97 tempest-SnapshotDependencyTests-2006240278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-09cc60d7-39fc-430e-9250-7dea3db224b4.5a6bee95-7a06-4424-aea9-08834f1b18c5 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:46 devstack sudo[107682]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f4e6e1cb-8f3d-4f96-b5ab-9ddeb8d7db8d tempest-ProjectReaderTests-34452203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f6fdbc6f-3bc4-4b46-a997-83d0da9ee1a0 1073741824" returned: 0 in 0.480s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f4e6e1cb-8f3d-4f96-b5ab-9ddeb8d7db8d tempest-ProjectReaderTests-34452203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f6fdbc6f-3bc4-4b46-a997-83d0da9ee1a0 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:46 devstack sudo[107688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-09cc60d7-39fc-430e-9250-7dea3db224b4.5a6bee95-7a06-4424-aea9-08834f1b18c5 Nov 04 12:31:46 devstack sudo[107688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:46 devstack sudo[107690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f6fdbc6f-3bc4-4b46-a997-83d0da9ee1a0 Nov 04 12:31:46 devstack sudo[107690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-14969434-6957-4517-be88-ec9b65b1e049 tempest-ProjectMemberTests-1539753999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:31:47 devstack sudo[107690]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f4e6e1cb-8f3d-4f96-b5ab-9ddeb8d7db8d tempest-ProjectReaderTests-34452203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f6fdbc6f-3bc4-4b46-a997-83d0da9ee1a0" returned: 0 in 0.329s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:47 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f4e6e1cb-8f3d-4f96-b5ab-9ddeb8d7db8d tempest-ProjectReaderTests-34452203 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:31:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f4e6e1cb-8f3d-4f96-b5ab-9ddeb8d7db8d tempest-ProjectReaderTests-34452203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:31:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-14969434-6957-4517-be88-ec9b65b1e049 tempest-ProjectMemberTests-1539753999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.170s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:31:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f4e6e1cb-8f3d-4f96-b5ab-9ddeb8d7db8d tempest-ProjectReaderTests-34452203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c792ec6-13c6-46fc-a625-d4e306141af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6fdbc6f-3bc4-4b46-a997-83d0da9ee1a0', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:31:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f4e6e1cb-8f3d-4f96-b5ab-9ddeb8d7db8d tempest-ProjectReaderTests-34452203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac0721a0-01ac-4112-b67c-52bf2a7b777b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:31:47 devstack sudo[107688]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c68a7281-6491-4d36-b826-5820f1f04c97 tempest-SnapshotDependencyTests-2006240278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-09cc60d7-39fc-430e-9250-7dea3db224b4.5a6bee95-7a06-4424-aea9-08834f1b18c5" returned: 0 in 0.486s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:47 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-c68a7281-6491-4d36-b826-5820f1f04c97 tempest-SnapshotDependencyTests-2006240278 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-09cc60d7-39fc-430e-9250-7dea3db224b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 12:31:47 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-14969434-6957-4517-be88-ec9b65b1e049 tempest-ProjectMemberTests-1539753999 None] Creating offline snapshot 65e19d1f-a3f4-48c7-8682-8984858dae71 of volume 6a073b98-be25-468e-9274-d16348796ec3 {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 12:31:47 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-f4e6e1cb-8f3d-4f96-b5ab-9ddeb8d7db8d tempest-ProjectReaderTests-34452203 None] Volume volume-f6fdbc6f-3bc4-4b46-a997-83d0da9ee1a0 (f6fdbc6f-3bc4-4b46-a997-83d0da9ee1a0): created successfully Nov 04 12:31:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f4e6e1cb-8f3d-4f96-b5ab-9ddeb8d7db8d tempest-ProjectReaderTests-34452203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac0721a0-01ac-4112-b67c-52bf2a7b777b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:31:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f4e6e1cb-8f3d-4f96-b5ab-9ddeb8d7db8d tempest-ProjectReaderTests-34452203 None] Flow 'volume_create_manager' (aa389d08-8505-4140-84ec-268a131b7173) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:31:47 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[32bc18e7-a7cc-4c19-bfee-dd38664953c9]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:31:47 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5161ce6-429f-4fd0-8808-84ea04bfbbec]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:31:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c68a7281-6491-4d36-b826-5820f1f04c97 tempest-SnapshotDependencyTests-2006240278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-09cc60d7-39fc-430e-9250-7dea3db224b4 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-14969434-6957-4517-be88-ec9b65b1e049 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6a073b98-be25-468e-9274-d16348796ec3 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:47 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-f4e6e1cb-8f3d-4f96-b5ab-9ddeb8d7db8d tempest-ProjectReaderTests-34452203 None] Created volume successfully. Nov 04 12:31:47 devstack sudo[107696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-09cc60d7-39fc-430e-9250-7dea3db224b4 Nov 04 12:31:47 devstack sudo[107696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:47 devstack sudo[107697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6a073b98-be25-468e-9274-d16348796ec3 Nov 04 12:31:47 devstack sudo[107697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:47 devstack sudo[107697]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-14969434-6957-4517-be88-ec9b65b1e049 tempest-ProjectMemberTests-1539753999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6a073b98-be25-468e-9274-d16348796ec3" returned: 0 in 0.430s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-14969434-6957-4517-be88-ec9b65b1e049 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6a073b98-be25-468e-9274-d16348796ec3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6a073b98-be25-468e-9274-d16348796ec3.65e19d1f-a3f4-48c7-8682-8984858dae71 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:47 devstack sudo[107705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6a073b98-be25-468e-9274-d16348796ec3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6a073b98-be25-468e-9274-d16348796ec3.65e19d1f-a3f4-48c7-8682-8984858dae71 1G Nov 04 12:31:47 devstack sudo[107705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:47 devstack sudo[107696]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c68a7281-6491-4d36-b826-5820f1f04c97 tempest-SnapshotDependencyTests-2006240278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-09cc60d7-39fc-430e-9250-7dea3db224b4" returned: 0 in 0.604s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c68a7281-6491-4d36-b826-5820f1f04c97 tempest-SnapshotDependencyTests-2006240278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-09cc60d7-39fc-430e-9250-7dea3db224b4.5a6bee95-7a06-4424-aea9-08834f1b18c5 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:47 devstack sudo[107709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-09cc60d7-39fc-430e-9250-7dea3db224b4.5a6bee95-7a06-4424-aea9-08834f1b18c5 Nov 04 12:31:47 devstack sudo[107709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9abc85a8-583a-438f-9009-6e18f85f384a tempest-ProjectReaderTests-34452203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:31:48 devstack sudo[107705]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-14969434-6957-4517-be88-ec9b65b1e049 tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6a073b98-be25-468e-9274-d16348796ec3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6a073b98-be25-468e-9274-d16348796ec3.65e19d1f-a3f4-48c7-8682-8984858dae71 1G" returned: 0 in 0.553s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-14969434-6957-4517-be88-ec9b65b1e049 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a073b98-be25-468e-9274-d16348796ec3 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6a073b98-be25-468e-9274-d16348796ec3.65e19d1f-a3f4-48c7-8682-8984858dae71 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:48 devstack sudo[107718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a073b98-be25-468e-9274-d16348796ec3 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6a073b98-be25-468e-9274-d16348796ec3.65e19d1f-a3f4-48c7-8682-8984858dae71 Nov 04 12:31:48 devstack sudo[107718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:48 devstack sudo[107709]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c68a7281-6491-4d36-b826-5820f1f04c97 tempest-SnapshotDependencyTests-2006240278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-09cc60d7-39fc-430e-9250-7dea3db224b4.5a6bee95-7a06-4424-aea9-08834f1b18c5" returned: 0 in 0.453s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c68a7281-6491-4d36-b826-5820f1f04c97 tempest-SnapshotDependencyTests-2006240278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-09cc60d7-39fc-430e-9250-7dea3db224b4.5a6bee95-7a06-4424-aea9-08834f1b18c5 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:48 devstack sudo[107720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-09cc60d7-39fc-430e-9250-7dea3db224b4.5a6bee95-7a06-4424-aea9-08834f1b18c5 Nov 04 12:31:48 devstack sudo[107720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:48 devstack sudo[107718]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-14969434-6957-4517-be88-ec9b65b1e049 tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a073b98-be25-468e-9274-d16348796ec3 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6a073b98-be25-468e-9274-d16348796ec3.65e19d1f-a3f4-48c7-8682-8984858dae71" returned: 0 in 0.303s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:48 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-14969434-6957-4517-be88-ec9b65b1e049 tempest-ProjectMemberTests-1539753999 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6a073b98-be25-468e-9274-d16348796ec3.65e19d1f-a3f4-48c7-8682-8984858dae71 is being set with open permissions: ugo+rw Nov 04 12:31:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-14969434-6957-4517-be88-ec9b65b1e049 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6a073b98-be25-468e-9274-d16348796ec3.65e19d1f-a3f4-48c7-8682-8984858dae71 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:48 devstack sudo[107720]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c68a7281-6491-4d36-b826-5820f1f04c97 tempest-SnapshotDependencyTests-2006240278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-09cc60d7-39fc-430e-9250-7dea3db224b4.5a6bee95-7a06-4424-aea9-08834f1b18c5" returned: 0 in 0.262s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:48 devstack sudo[107726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6a073b98-be25-468e-9274-d16348796ec3.65e19d1f-a3f4-48c7-8682-8984858dae71 Nov 04 12:31:48 devstack sudo[107726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:48 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c68a7281-6491-4d36-b826-5820f1f04c97 tempest-SnapshotDependencyTests-2006240278 None] Lock "cinder-quobyte-5a6bee95-7a06-4424-aea9-08834f1b18c5" released by "_delete_snapshot" :: held 1.939s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:31:48 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c68a7281-6491-4d36-b826-5820f1f04c97 tempest-SnapshotDependencyTests-2006240278 None] Lock "cinder-quobyte-09cc60d7-39fc-430e-9250-7dea3db224b4" released by "delete_snapshot" :: held 1.972s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:31:48 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-c68a7281-6491-4d36-b826-5820f1f04c97 tempest-SnapshotDependencyTests-2006240278 None] Created reservations ['1f1d533c-a4f9-4b32-b2f9-d23f7d0c8f78', 'cd432a1c-ddeb-488f-b4b1-beb09e97e35c', 'd0b928b0-93ef-42e6-9f07-a3ebeb859968', '86fed9f9-e9be-4f74-9959-c1429910d8b2'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:31:48 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-c68a7281-6491-4d36-b826-5820f1f04c97 tempest-SnapshotDependencyTests-2006240278 None] Delete snapshot completed successfully. Nov 04 12:31:48 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c68a7281-6491-4d36-b826-5820f1f04c97 tempest-SnapshotDependencyTests-2006240278 None] Lock "cinder-5a6bee95-7a06-4424-aea9-08834f1b18c5-delete_snapshot" released by "delete_snapshot" :: held 2.112s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:31:48 devstack sudo[107726]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-14969434-6957-4517-be88-ec9b65b1e049 tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6a073b98-be25-468e-9274-d16348796ec3.65e19d1f-a3f4-48c7-8682-8984858dae71" returned: 0 in 0.244s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-14969434-6957-4517-be88-ec9b65b1e049 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6a073b98-be25-468e-9274-d16348796ec3.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:48 devstack sudo[107729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6a073b98-be25-468e-9274-d16348796ec3.info Nov 04 12:31:48 devstack sudo[107729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:49 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a4ba8090-123a-4df2-a6b7-98595fe699ab tempest-SnapshotDependencyTests-2006240278 None] Acquiring lock "cinder-09cc60d7-39fc-430e-9250-7dea3db224b4-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:31:49 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a4ba8090-123a-4df2-a6b7-98595fe699ab tempest-SnapshotDependencyTests-2006240278 None] Lock "cinder-09cc60d7-39fc-430e-9250-7dea3db224b4-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:31:49 devstack sudo[107729]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-14969434-6957-4517-be88-ec9b65b1e049 tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6a073b98-be25-468e-9274-d16348796ec3.info" returned: 0 in 0.298s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:49 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-14969434-6957-4517-be88-ec9b65b1e049 tempest-ProjectMemberTests-1539753999 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6a073b98-be25-468e-9274-d16348796ec3.info is being set with open permissions: ugo+rw Nov 04 12:31:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-14969434-6957-4517-be88-ec9b65b1e049 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6a073b98-be25-468e-9274-d16348796ec3.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:49 devstack sudo[107732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6a073b98-be25-468e-9274-d16348796ec3.info Nov 04 12:31:49 devstack sudo[107732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:49 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a4ba8090-123a-4df2-a6b7-98595fe699ab tempest-SnapshotDependencyTests-2006240278 None] Acquiring lock "cinder-quobyte-09cc60d7-39fc-430e-9250-7dea3db224b4" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:31:49 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a4ba8090-123a-4df2-a6b7-98595fe699ab tempest-SnapshotDependencyTests-2006240278 None] Lock "cinder-quobyte-09cc60d7-39fc-430e-9250-7dea3db224b4" acquired by "delete_volume" :: waited 0.019s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:31:49 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba6dcd0-6362-4682-9c0e-bb29894e2cfa]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:31:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a4ba8090-123a-4df2-a6b7-98595fe699ab tempest-SnapshotDependencyTests-2006240278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-09cc60d7-39fc-430e-9250-7dea3db224b4 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:49 devstack sudo[107734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-09cc60d7-39fc-430e-9250-7dea3db224b4 Nov 04 12:31:49 devstack sudo[107734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:49 devstack sudo[107732]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-14969434-6957-4517-be88-ec9b65b1e049 tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6a073b98-be25-468e-9274-d16348796ec3.info" returned: 0 in 0.286s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-14969434-6957-4517-be88-ec9b65b1e049 tempest-ProjectMemberTests-1539753999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.267s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:31:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9abc85a8-583a-438f-9009-6e18f85f384a tempest-ProjectReaderTests-34452203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.365s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:31:49 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-9abc85a8-583a-438f-9009-6e18f85f384a tempest-ProjectReaderTests-34452203 None] Creating offline snapshot 7fce0392-6988-4123-89ab-77c6d939d73e of volume f6fdbc6f-3bc4-4b46-a997-83d0da9ee1a0 {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 12:31:49 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a88c0e-8e99-4732-b704-b987a15860f7]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:31:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9abc85a8-583a-438f-9009-6e18f85f384a tempest-ProjectReaderTests-34452203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f6fdbc6f-3bc4-4b46-a997-83d0da9ee1a0 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:49 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-14969434-6957-4517-be88-ec9b65b1e049 tempest-ProjectMemberTests-1539753999 None] Create snapshot completed successfully Nov 04 12:31:49 devstack sudo[107737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f6fdbc6f-3bc4-4b46-a997-83d0da9ee1a0 Nov 04 12:31:49 devstack sudo[107737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:49 devstack sudo[107734]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a4ba8090-123a-4df2-a6b7-98595fe699ab tempest-SnapshotDependencyTests-2006240278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-09cc60d7-39fc-430e-9250-7dea3db224b4" returned: 0 in 0.431s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a4ba8090-123a-4df2-a6b7-98595fe699ab tempest-SnapshotDependencyTests-2006240278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-09cc60d7-39fc-430e-9250-7dea3db224b4 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:49 devstack sudo[107742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-09cc60d7-39fc-430e-9250-7dea3db224b4 Nov 04 12:31:49 devstack sudo[107742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:49 devstack sudo[107737]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9abc85a8-583a-438f-9009-6e18f85f384a tempest-ProjectReaderTests-34452203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f6fdbc6f-3bc4-4b46-a997-83d0da9ee1a0" returned: 0 in 0.432s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9abc85a8-583a-438f-9009-6e18f85f384a tempest-ProjectReaderTests-34452203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f6fdbc6f-3bc4-4b46-a997-83d0da9ee1a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f6fdbc6f-3bc4-4b46-a997-83d0da9ee1a0.7fce0392-6988-4123-89ab-77c6d939d73e 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:49 devstack sudo[107749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f6fdbc6f-3bc4-4b46-a997-83d0da9ee1a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f6fdbc6f-3bc4-4b46-a997-83d0da9ee1a0.7fce0392-6988-4123-89ab-77c6d939d73e 1G Nov 04 12:31:49 devstack sudo[107749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:49 devstack sudo[107742]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a4ba8090-123a-4df2-a6b7-98595fe699ab tempest-SnapshotDependencyTests-2006240278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-09cc60d7-39fc-430e-9250-7dea3db224b4" returned: 0 in 0.300s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:50 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a4ba8090-123a-4df2-a6b7-98595fe699ab tempest-SnapshotDependencyTests-2006240278 None] Lock "cinder-quobyte-09cc60d7-39fc-430e-9250-7dea3db224b4" released by "delete_volume" :: held 0.827s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:31:50 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-a4ba8090-123a-4df2-a6b7-98595fe699ab tempest-SnapshotDependencyTests-2006240278 None] Created reservations ['ee5ec2e9-3e21-41f2-9fb6-8049af27349e', 'aea11ce5-e9e1-4b52-9ef8-a7d8eb753087', '668fac64-231e-4677-8010-7b3b1001c3bb', '25a82777-6127-407f-b3c6-c61b7c236ac0'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:31:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a4ba8090-123a-4df2-a6b7-98595fe699ab tempest-SnapshotDependencyTests-2006240278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:31:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a4ba8090-123a-4df2-a6b7-98595fe699ab tempest-SnapshotDependencyTests-2006240278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:31:50 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a4ba8090-123a-4df2-a6b7-98595fe699ab tempest-SnapshotDependencyTests-2006240278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:31:50 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a4ba8090-123a-4df2-a6b7-98595fe699ab tempest-SnapshotDependencyTests-2006240278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:31:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a4ba8090-123a-4df2-a6b7-98595fe699ab tempest-SnapshotDependencyTests-2006240278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:31:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a4ba8090-123a-4df2-a6b7-98595fe699ab tempest-SnapshotDependencyTests-2006240278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:50 devstack sudo[107753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:31:50 devstack sudo[107753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:50 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-777ee3a0-2b77-4f40-8921-441854d96bd8 tempest-ProjectMemberTests-1539753999 None] Acquiring lock "cinder-65e19d1f-a3f4-48c7-8682-8984858dae71-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:31:50 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-777ee3a0-2b77-4f40-8921-441854d96bd8 tempest-ProjectMemberTests-1539753999 None] Lock "cinder-65e19d1f-a3f4-48c7-8682-8984858dae71-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:31:50 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-777ee3a0-2b77-4f40-8921-441854d96bd8 tempest-ProjectMemberTests-1539753999 None] Acquiring lock "cinder-quobyte-6a073b98-be25-468e-9274-d16348796ec3" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:31:50 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-bb658a10-302b-4bd2-a013-f6f804087630 tempest-SnapshotDependencyTests-2006240278 None] Acquiring lock "cinder-c2e339f8-71db-4f65-8894-620856ce2e74-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:31:50 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-777ee3a0-2b77-4f40-8921-441854d96bd8 tempest-ProjectMemberTests-1539753999 None] Lock "cinder-quobyte-6a073b98-be25-468e-9274-d16348796ec3" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:31:50 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-777ee3a0-2b77-4f40-8921-441854d96bd8 tempest-ProjectMemberTests-1539753999 None] Acquiring lock "cinder-quobyte-65e19d1f-a3f4-48c7-8682-8984858dae71" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:31:50 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-bb658a10-302b-4bd2-a013-f6f804087630 tempest-SnapshotDependencyTests-2006240278 None] Lock "cinder-c2e339f8-71db-4f65-8894-620856ce2e74-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:31:50 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-777ee3a0-2b77-4f40-8921-441854d96bd8 tempest-ProjectMemberTests-1539753999 None] Lock "cinder-quobyte-65e19d1f-a3f4-48c7-8682-8984858dae71" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:31:50 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-777ee3a0-2b77-4f40-8921-441854d96bd8 tempest-ProjectMemberTests-1539753999 None] Deleting offline snapshot 65e19d1f-a3f4-48c7-8682-8984858dae71 of volume 6a073b98-be25-468e-9274-d16348796ec3 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 12:31:50 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-777ee3a0-2b77-4f40-8921-441854d96bd8 tempest-ProjectMemberTests-1539753999 None] snapshot_file for this snap is: volume-6a073b98-be25-468e-9274-d16348796ec3.65e19d1f-a3f4-48c7-8682-8984858dae71 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 12:31:50 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ed97fe-4a36-46c9-8438-4182240734a0]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:31:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-777ee3a0-2b77-4f40-8921-441854d96bd8 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6a073b98-be25-468e-9274-d16348796ec3.65e19d1f-a3f4-48c7-8682-8984858dae71 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:50 devstack sudo[107749]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:50 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-bb658a10-302b-4bd2-a013-f6f804087630 tempest-SnapshotDependencyTests-2006240278 None] Acquiring lock "cinder-quobyte-c2e339f8-71db-4f65-8894-620856ce2e74" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:31:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9abc85a8-583a-438f-9009-6e18f85f384a tempest-ProjectReaderTests-34452203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f6fdbc6f-3bc4-4b46-a997-83d0da9ee1a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f6fdbc6f-3bc4-4b46-a997-83d0da9ee1a0.7fce0392-6988-4123-89ab-77c6d939d73e 1G" returned: 0 in 0.542s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9abc85a8-583a-438f-9009-6e18f85f384a tempest-ProjectReaderTests-34452203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6fdbc6f-3bc4-4b46-a997-83d0da9ee1a0 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f6fdbc6f-3bc4-4b46-a997-83d0da9ee1a0.7fce0392-6988-4123-89ab-77c6d939d73e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:50 devstack sudo[107753]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a4ba8090-123a-4df2-a6b7-98595fe699ab tempest-SnapshotDependencyTests-2006240278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.316s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:50 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-a4ba8090-123a-4df2-a6b7-98595fe699ab tempest-SnapshotDependencyTests-2006240278 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:31:50 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-bb658a10-302b-4bd2-a013-f6f804087630 tempest-SnapshotDependencyTests-2006240278 None] Lock "cinder-quobyte-c2e339f8-71db-4f65-8894-620856ce2e74" acquired by "delete_volume" :: waited 0.034s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:31:50 devstack sudo[107759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6fdbc6f-3bc4-4b46-a997-83d0da9ee1a0 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f6fdbc6f-3bc4-4b46-a997-83d0da9ee1a0.7fce0392-6988-4123-89ab-77c6d939d73e Nov 04 12:31:50 devstack sudo[107759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:50 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-a4ba8090-123a-4df2-a6b7-98595fe699ab tempest-SnapshotDependencyTests-2006240278 None] Deleted volume successfully. Nov 04 12:31:50 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a4ba8090-123a-4df2-a6b7-98595fe699ab tempest-SnapshotDependencyTests-2006240278 None] Lock "cinder-09cc60d7-39fc-430e-9250-7dea3db224b4-delete_volume" released by "delete_volume" :: held 1.440s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:31:50 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[206b751f-6d11-4a37-a42a-611eeb6e1013]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:31:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-bb658a10-302b-4bd2-a013-f6f804087630 tempest-SnapshotDependencyTests-2006240278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c2e339f8-71db-4f65-8894-620856ce2e74 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:50 devstack sudo[107758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6a073b98-be25-468e-9274-d16348796ec3.65e19d1f-a3f4-48c7-8682-8984858dae71 Nov 04 12:31:50 devstack sudo[107758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:50 devstack sudo[107761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c2e339f8-71db-4f65-8894-620856ce2e74 Nov 04 12:31:50 devstack sudo[107761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:50 devstack sudo[107759]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9abc85a8-583a-438f-9009-6e18f85f384a tempest-ProjectReaderTests-34452203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6fdbc6f-3bc4-4b46-a997-83d0da9ee1a0 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f6fdbc6f-3bc4-4b46-a997-83d0da9ee1a0.7fce0392-6988-4123-89ab-77c6d939d73e" returned: 0 in 0.316s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:50 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-9abc85a8-583a-438f-9009-6e18f85f384a tempest-ProjectReaderTests-34452203 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f6fdbc6f-3bc4-4b46-a997-83d0da9ee1a0.7fce0392-6988-4123-89ab-77c6d939d73e is being set with open permissions: ugo+rw Nov 04 12:31:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9abc85a8-583a-438f-9009-6e18f85f384a tempest-ProjectReaderTests-34452203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f6fdbc6f-3bc4-4b46-a997-83d0da9ee1a0.7fce0392-6988-4123-89ab-77c6d939d73e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:50 devstack sudo[107770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f6fdbc6f-3bc4-4b46-a997-83d0da9ee1a0.7fce0392-6988-4123-89ab-77c6d939d73e Nov 04 12:31:50 devstack sudo[107770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:50 devstack sudo[107758]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-777ee3a0-2b77-4f40-8921-441854d96bd8 tempest-ProjectMemberTests-1539753999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6a073b98-be25-468e-9274-d16348796ec3.65e19d1f-a3f4-48c7-8682-8984858dae71" returned: 0 in 0.424s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:50 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-777ee3a0-2b77-4f40-8921-441854d96bd8 tempest-ProjectMemberTests-1539753999 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a073b98-be25-468e-9274-d16348796ec3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 12:31:50 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d49f15f-fda6-4271-89e1-7f979a0b401a]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:31:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-777ee3a0-2b77-4f40-8921-441854d96bd8 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6a073b98-be25-468e-9274-d16348796ec3 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:50 devstack sudo[107761]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-bb658a10-302b-4bd2-a013-f6f804087630 tempest-SnapshotDependencyTests-2006240278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c2e339f8-71db-4f65-8894-620856ce2e74" returned: 0 in 0.438s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-bb658a10-302b-4bd2-a013-f6f804087630 tempest-SnapshotDependencyTests-2006240278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c2e339f8-71db-4f65-8894-620856ce2e74 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:51 devstack sudo[107776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c2e339f8-71db-4f65-8894-620856ce2e74 Nov 04 12:31:51 devstack sudo[107776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:51 devstack sudo[107774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6a073b98-be25-468e-9274-d16348796ec3 Nov 04 12:31:51 devstack sudo[107774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:51 devstack sudo[107770]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9abc85a8-583a-438f-9009-6e18f85f384a tempest-ProjectReaderTests-34452203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f6fdbc6f-3bc4-4b46-a997-83d0da9ee1a0.7fce0392-6988-4123-89ab-77c6d939d73e" returned: 0 in 0.303s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9abc85a8-583a-438f-9009-6e18f85f384a tempest-ProjectReaderTests-34452203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f6fdbc6f-3bc4-4b46-a997-83d0da9ee1a0.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:51 devstack sudo[107780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f6fdbc6f-3bc4-4b46-a997-83d0da9ee1a0.info Nov 04 12:31:51 devstack sudo[107780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:51 devstack sudo[107776]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-bb658a10-302b-4bd2-a013-f6f804087630 tempest-SnapshotDependencyTests-2006240278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c2e339f8-71db-4f65-8894-620856ce2e74" returned: 0 in 0.329s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:51 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-bb658a10-302b-4bd2-a013-f6f804087630 tempest-SnapshotDependencyTests-2006240278 None] Lock "cinder-quobyte-c2e339f8-71db-4f65-8894-620856ce2e74" released by "delete_volume" :: held 0.856s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:31:51 devstack sudo[107774]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-777ee3a0-2b77-4f40-8921-441854d96bd8 tempest-ProjectMemberTests-1539753999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6a073b98-be25-468e-9274-d16348796ec3" returned: 0 in 0.494s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-777ee3a0-2b77-4f40-8921-441854d96bd8 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6a073b98-be25-468e-9274-d16348796ec3.65e19d1f-a3f4-48c7-8682-8984858dae71 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:51 devstack sudo[107780]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:51 devstack sudo[107788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6a073b98-be25-468e-9274-d16348796ec3.65e19d1f-a3f4-48c7-8682-8984858dae71 Nov 04 12:31:51 devstack sudo[107788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9abc85a8-583a-438f-9009-6e18f85f384a tempest-ProjectReaderTests-34452203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f6fdbc6f-3bc4-4b46-a997-83d0da9ee1a0.info" returned: 0 in 0.304s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:51 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-9abc85a8-583a-438f-9009-6e18f85f384a tempest-ProjectReaderTests-34452203 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f6fdbc6f-3bc4-4b46-a997-83d0da9ee1a0.info is being set with open permissions: ugo+rw Nov 04 12:31:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9abc85a8-583a-438f-9009-6e18f85f384a tempest-ProjectReaderTests-34452203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f6fdbc6f-3bc4-4b46-a997-83d0da9ee1a0.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:51 devstack sudo[107790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f6fdbc6f-3bc4-4b46-a997-83d0da9ee1a0.info Nov 04 12:31:51 devstack sudo[107790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:51 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-bb658a10-302b-4bd2-a013-f6f804087630 tempest-SnapshotDependencyTests-2006240278 None] Created reservations ['303e972e-27c6-4fd1-b0a2-cdc5c8bc58aa', '3ab07812-8d70-40e1-aeba-8a44a0184172', '152bc7e4-285d-4814-8225-ace733c81458', '20657222-4b6e-41cc-9346-5325493c7766'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:31:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-bb658a10-302b-4bd2-a013-f6f804087630 tempest-SnapshotDependencyTests-2006240278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:31:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-bb658a10-302b-4bd2-a013-f6f804087630 tempest-SnapshotDependencyTests-2006240278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:31:51 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-bb658a10-302b-4bd2-a013-f6f804087630 tempest-SnapshotDependencyTests-2006240278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:31:51 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-bb658a10-302b-4bd2-a013-f6f804087630 tempest-SnapshotDependencyTests-2006240278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:31:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-bb658a10-302b-4bd2-a013-f6f804087630 tempest-SnapshotDependencyTests-2006240278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:31:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-bb658a10-302b-4bd2-a013-f6f804087630 tempest-SnapshotDependencyTests-2006240278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:51 devstack sudo[107792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:31:51 devstack sudo[107792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:51 devstack sudo[107790]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9abc85a8-583a-438f-9009-6e18f85f384a tempest-ProjectReaderTests-34452203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f6fdbc6f-3bc4-4b46-a997-83d0da9ee1a0.info" returned: 0 in 0.293s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9abc85a8-583a-438f-9009-6e18f85f384a tempest-ProjectReaderTests-34452203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.306s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:31:51 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-9abc85a8-583a-438f-9009-6e18f85f384a tempest-ProjectReaderTests-34452203 None] Create snapshot completed successfully Nov 04 12:31:51 devstack sudo[107788]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-777ee3a0-2b77-4f40-8921-441854d96bd8 tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6a073b98-be25-468e-9274-d16348796ec3.65e19d1f-a3f4-48c7-8682-8984858dae71" returned: 0 in 0.446s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-777ee3a0-2b77-4f40-8921-441854d96bd8 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6a073b98-be25-468e-9274-d16348796ec3.65e19d1f-a3f4-48c7-8682-8984858dae71 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:51 devstack sudo[107799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6a073b98-be25-468e-9274-d16348796ec3.65e19d1f-a3f4-48c7-8682-8984858dae71 Nov 04 12:31:51 devstack sudo[107799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:51 devstack sudo[107792]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-bb658a10-302b-4bd2-a013-f6f804087630 tempest-SnapshotDependencyTests-2006240278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.325s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:51 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-bb658a10-302b-4bd2-a013-f6f804087630 tempest-SnapshotDependencyTests-2006240278 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:31:51 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-bb658a10-302b-4bd2-a013-f6f804087630 tempest-SnapshotDependencyTests-2006240278 None] Deleted volume successfully. Nov 04 12:31:51 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-bb658a10-302b-4bd2-a013-f6f804087630 tempest-SnapshotDependencyTests-2006240278 None] Lock "cinder-c2e339f8-71db-4f65-8894-620856ce2e74-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:31:52 devstack sudo[107799]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-777ee3a0-2b77-4f40-8921-441854d96bd8 tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6a073b98-be25-468e-9274-d16348796ec3.65e19d1f-a3f4-48c7-8682-8984858dae71" returned: 0 in 0.281s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-777ee3a0-2b77-4f40-8921-441854d96bd8 tempest-ProjectMemberTests-1539753999 None] Lock "cinder-quobyte-65e19d1f-a3f4-48c7-8682-8984858dae71" released by "_delete_snapshot" :: held 1.767s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:31:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-777ee3a0-2b77-4f40-8921-441854d96bd8 tempest-ProjectMemberTests-1539753999 None] Lock "cinder-quobyte-6a073b98-be25-468e-9274-d16348796ec3" released by "delete_snapshot" :: held 1.814s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:31:52 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-777ee3a0-2b77-4f40-8921-441854d96bd8 tempest-ProjectMemberTests-1539753999 None] Created reservations ['0c0f5f0c-6e1d-469b-945f-5711c061ef45', '70eb9f15-6305-482e-9763-8cbfb9893eb2', '8354def3-e672-4e83-aa96-79f4f62b43aa', 'a5bffa47-bd24-4148-bb92-1cb628c092f7'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:31:52 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-777ee3a0-2b77-4f40-8921-441854d96bd8 tempest-ProjectMemberTests-1539753999 None] Delete snapshot completed successfully. Nov 04 12:31:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-777ee3a0-2b77-4f40-8921-441854d96bd8 tempest-ProjectMemberTests-1539753999 None] Lock "cinder-65e19d1f-a3f4-48c7-8682-8984858dae71-delete_snapshot" released by "delete_snapshot" :: held 2.003s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:31:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-61c7a4b2-74ff-4f46-86bc-a3b44d34f167 tempest-ProjectReaderTests-34452203 None] Acquiring lock "cinder-7fce0392-6988-4123-89ab-77c6d939d73e-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:31:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-61c7a4b2-74ff-4f46-86bc-a3b44d34f167 tempest-ProjectReaderTests-34452203 None] Lock "cinder-7fce0392-6988-4123-89ab-77c6d939d73e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:31:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-61c7a4b2-74ff-4f46-86bc-a3b44d34f167 tempest-ProjectReaderTests-34452203 None] Acquiring lock "cinder-quobyte-f6fdbc6f-3bc4-4b46-a997-83d0da9ee1a0" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:31:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-61c7a4b2-74ff-4f46-86bc-a3b44d34f167 tempest-ProjectReaderTests-34452203 None] Lock "cinder-quobyte-f6fdbc6f-3bc4-4b46-a997-83d0da9ee1a0" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:31:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-61c7a4b2-74ff-4f46-86bc-a3b44d34f167 tempest-ProjectReaderTests-34452203 None] Acquiring lock "cinder-quobyte-7fce0392-6988-4123-89ab-77c6d939d73e" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:31:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-61c7a4b2-74ff-4f46-86bc-a3b44d34f167 tempest-ProjectReaderTests-34452203 None] Lock "cinder-quobyte-7fce0392-6988-4123-89ab-77c6d939d73e" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:31:52 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-61c7a4b2-74ff-4f46-86bc-a3b44d34f167 tempest-ProjectReaderTests-34452203 None] Deleting offline snapshot 7fce0392-6988-4123-89ab-77c6d939d73e of volume f6fdbc6f-3bc4-4b46-a997-83d0da9ee1a0 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 12:31:52 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-61c7a4b2-74ff-4f46-86bc-a3b44d34f167 tempest-ProjectReaderTests-34452203 None] snapshot_file for this snap is: volume-f6fdbc6f-3bc4-4b46-a997-83d0da9ee1a0.7fce0392-6988-4123-89ab-77c6d939d73e {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 12:31:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-8fcff763-c4ff-4e6d-ae30-ce3ce49ca657 tempest-ProjectMemberTests-1539753999 None] Acquiring lock "cinder-6a073b98-be25-468e-9274-d16348796ec3-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:31:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-8fcff763-c4ff-4e6d-ae30-ce3ce49ca657 tempest-ProjectMemberTests-1539753999 None] Lock "cinder-6a073b98-be25-468e-9274-d16348796ec3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:31:52 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[73818680-bd01-4345-9968-6c5842fbbe68]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:31:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-61c7a4b2-74ff-4f46-86bc-a3b44d34f167 tempest-ProjectReaderTests-34452203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f6fdbc6f-3bc4-4b46-a997-83d0da9ee1a0.7fce0392-6988-4123-89ab-77c6d939d73e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-8fcff763-c4ff-4e6d-ae30-ce3ce49ca657 tempest-ProjectMemberTests-1539753999 None] Acquiring lock "cinder-quobyte-6a073b98-be25-468e-9274-d16348796ec3" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:31:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-8fcff763-c4ff-4e6d-ae30-ce3ce49ca657 tempest-ProjectMemberTests-1539753999 None] Lock "cinder-quobyte-6a073b98-be25-468e-9274-d16348796ec3" acquired by "delete_volume" :: waited 0.025s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:31:52 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e898d7-a998-4b1d-b594-bd56065061dd]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:31:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8fcff763-c4ff-4e6d-ae30-ce3ce49ca657 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6a073b98-be25-468e-9274-d16348796ec3 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:52 devstack sudo[107803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f6fdbc6f-3bc4-4b46-a997-83d0da9ee1a0.7fce0392-6988-4123-89ab-77c6d939d73e Nov 04 12:31:52 devstack sudo[107803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:52 devstack sudo[107804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6a073b98-be25-468e-9274-d16348796ec3 Nov 04 12:31:52 devstack sudo[107804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:53 devstack sudo[107803]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-61c7a4b2-74ff-4f46-86bc-a3b44d34f167 tempest-ProjectReaderTests-34452203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f6fdbc6f-3bc4-4b46-a997-83d0da9ee1a0.7fce0392-6988-4123-89ab-77c6d939d73e" returned: 0 in 0.507s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:53 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-61c7a4b2-74ff-4f46-86bc-a3b44d34f167 tempest-ProjectReaderTests-34452203 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6fdbc6f-3bc4-4b46-a997-83d0da9ee1a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 12:31:53 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df8c719-7dbe-40fd-82ee-13a13941d5e8]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:31:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-61c7a4b2-74ff-4f46-86bc-a3b44d34f167 tempest-ProjectReaderTests-34452203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f6fdbc6f-3bc4-4b46-a997-83d0da9ee1a0 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:53 devstack sudo[107804]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8fcff763-c4ff-4e6d-ae30-ce3ce49ca657 tempest-ProjectMemberTests-1539753999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6a073b98-be25-468e-9274-d16348796ec3" returned: 0 in 0.471s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8fcff763-c4ff-4e6d-ae30-ce3ce49ca657 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6a073b98-be25-468e-9274-d16348796ec3 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:53 devstack sudo[107815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6a073b98-be25-468e-9274-d16348796ec3 Nov 04 12:31:53 devstack sudo[107815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:53 devstack sudo[107813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f6fdbc6f-3bc4-4b46-a997-83d0da9ee1a0 Nov 04 12:31:53 devstack sudo[107813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:53 devstack sudo[107813]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-61c7a4b2-74ff-4f46-86bc-a3b44d34f167 tempest-ProjectReaderTests-34452203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f6fdbc6f-3bc4-4b46-a997-83d0da9ee1a0" returned: 0 in 0.463s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-61c7a4b2-74ff-4f46-86bc-a3b44d34f167 tempest-ProjectReaderTests-34452203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f6fdbc6f-3bc4-4b46-a997-83d0da9ee1a0.7fce0392-6988-4123-89ab-77c6d939d73e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:53 devstack sudo[107815]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8fcff763-c4ff-4e6d-ae30-ce3ce49ca657 tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-6a073b98-be25-468e-9274-d16348796ec3" returned: 0 in 0.394s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:53 devstack sudo[107823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f6fdbc6f-3bc4-4b46-a997-83d0da9ee1a0.7fce0392-6988-4123-89ab-77c6d939d73e Nov 04 12:31:53 devstack sudo[107823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:53 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-8fcff763-c4ff-4e6d-ae30-ce3ce49ca657 tempest-ProjectMemberTests-1539753999 None] Lock "cinder-quobyte-6a073b98-be25-468e-9274-d16348796ec3" released by "delete_volume" :: held 0.970s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:31:53 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-8fcff763-c4ff-4e6d-ae30-ce3ce49ca657 tempest-ProjectMemberTests-1539753999 None] Created reservations ['800a26a7-c24b-455e-8652-fb802dc32c90', '44b56713-30ec-44c5-9a09-7eaa3fbef659', '626d82c4-ebe8-494d-94fc-d96d959b6b68', 'ab05e23b-63d4-4608-b40c-c5f911ab7017'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:31:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-8fcff763-c4ff-4e6d-ae30-ce3ce49ca657 tempest-ProjectMemberTests-1539753999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:31:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-8fcff763-c4ff-4e6d-ae30-ce3ce49ca657 tempest-ProjectMemberTests-1539753999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:31:53 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-8fcff763-c4ff-4e6d-ae30-ce3ce49ca657 tempest-ProjectMemberTests-1539753999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:31:53 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-8fcff763-c4ff-4e6d-ae30-ce3ce49ca657 tempest-ProjectMemberTests-1539753999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:31:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-8fcff763-c4ff-4e6d-ae30-ce3ce49ca657 tempest-ProjectMemberTests-1539753999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:31:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8fcff763-c4ff-4e6d-ae30-ce3ce49ca657 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:53 devstack sudo[107826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:31:53 devstack sudo[107826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:54 devstack sudo[107823]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-61c7a4b2-74ff-4f46-86bc-a3b44d34f167 tempest-ProjectReaderTests-34452203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f6fdbc6f-3bc4-4b46-a997-83d0da9ee1a0.7fce0392-6988-4123-89ab-77c6d939d73e" returned: 0 in 0.512s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-61c7a4b2-74ff-4f46-86bc-a3b44d34f167 tempest-ProjectReaderTests-34452203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f6fdbc6f-3bc4-4b46-a997-83d0da9ee1a0.7fce0392-6988-4123-89ab-77c6d939d73e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:54 devstack sudo[107830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f6fdbc6f-3bc4-4b46-a997-83d0da9ee1a0.7fce0392-6988-4123-89ab-77c6d939d73e Nov 04 12:31:54 devstack sudo[107830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:54 devstack sudo[107826]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8fcff763-c4ff-4e6d-ae30-ce3ce49ca657 tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.297s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:54 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-8fcff763-c4ff-4e6d-ae30-ce3ce49ca657 tempest-ProjectMemberTests-1539753999 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:31:54 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-8fcff763-c4ff-4e6d-ae30-ce3ce49ca657 tempest-ProjectMemberTests-1539753999 None] Deleted volume successfully. Nov 04 12:31:54 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-8fcff763-c4ff-4e6d-ae30-ce3ce49ca657 tempest-ProjectMemberTests-1539753999 None] Lock "cinder-6a073b98-be25-468e-9274-d16348796ec3-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:31:54 devstack sudo[107830]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-61c7a4b2-74ff-4f46-86bc-a3b44d34f167 tempest-ProjectReaderTests-34452203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f6fdbc6f-3bc4-4b46-a997-83d0da9ee1a0.7fce0392-6988-4123-89ab-77c6d939d73e" returned: 0 in 0.274s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:54 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-61c7a4b2-74ff-4f46-86bc-a3b44d34f167 tempest-ProjectReaderTests-34452203 None] Lock "cinder-quobyte-7fce0392-6988-4123-89ab-77c6d939d73e" released by "_delete_snapshot" :: held 1.920s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:31:54 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-61c7a4b2-74ff-4f46-86bc-a3b44d34f167 tempest-ProjectReaderTests-34452203 None] Lock "cinder-quobyte-f6fdbc6f-3bc4-4b46-a997-83d0da9ee1a0" released by "delete_snapshot" :: held 1.954s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:31:54 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-61c7a4b2-74ff-4f46-86bc-a3b44d34f167 tempest-ProjectReaderTests-34452203 None] Created reservations ['c3cbb0f1-2d47-4da5-a72d-7f274f414aa5', '235167e5-9ec7-4c8e-a26c-1d5d3c484e4b', '873dd80f-8181-4c20-99a9-38ae848bf080', 'cf76bfa8-df77-4888-aee4-2b6493d7433b'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:31:54 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-61c7a4b2-74ff-4f46-86bc-a3b44d34f167 tempest-ProjectReaderTests-34452203 None] Delete snapshot completed successfully. Nov 04 12:31:54 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-61c7a4b2-74ff-4f46-86bc-a3b44d34f167 tempest-ProjectReaderTests-34452203 None] Lock "cinder-7fce0392-6988-4123-89ab-77c6d939d73e-delete_snapshot" released by "delete_snapshot" :: held 2.119s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:31:54 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b0ad4272-8453-45ec-a403-25f723b3b78c tempest-ProjectReaderTests-34452203 None] Acquiring lock "cinder-f6fdbc6f-3bc4-4b46-a997-83d0da9ee1a0-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:31:54 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b0ad4272-8453-45ec-a403-25f723b3b78c tempest-ProjectReaderTests-34452203 None] Lock "cinder-f6fdbc6f-3bc4-4b46-a997-83d0da9ee1a0-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:31:54 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b0ad4272-8453-45ec-a403-25f723b3b78c tempest-ProjectReaderTests-34452203 None] Acquiring lock "cinder-quobyte-f6fdbc6f-3bc4-4b46-a997-83d0da9ee1a0" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:31:54 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b0ad4272-8453-45ec-a403-25f723b3b78c tempest-ProjectReaderTests-34452203 None] Lock "cinder-quobyte-f6fdbc6f-3bc4-4b46-a997-83d0da9ee1a0" acquired by "delete_volume" :: waited 0.034s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:31:54 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[76cf30c9-1193-4afc-a955-e28adb331f7b]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:31:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b0ad4272-8453-45ec-a403-25f723b3b78c tempest-ProjectReaderTests-34452203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f6fdbc6f-3bc4-4b46-a997-83d0da9ee1a0 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:54 devstack sudo[107835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f6fdbc6f-3bc4-4b46-a997-83d0da9ee1a0 Nov 04 12:31:54 devstack sudo[107835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:55 devstack sudo[107835]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b0ad4272-8453-45ec-a403-25f723b3b78c tempest-ProjectReaderTests-34452203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f6fdbc6f-3bc4-4b46-a997-83d0da9ee1a0" returned: 0 in 0.508s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b0ad4272-8453-45ec-a403-25f723b3b78c tempest-ProjectReaderTests-34452203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f6fdbc6f-3bc4-4b46-a997-83d0da9ee1a0 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:55 devstack sudo[107840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f6fdbc6f-3bc4-4b46-a997-83d0da9ee1a0 Nov 04 12:31:55 devstack sudo[107840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:55 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-248578b5-7b54-43b3-9c29-a05ee39c3270 tempest-ProjectMemberTests-1539753999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:31:55 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-248578b5-7b54-43b3-9c29-a05ee39c3270 tempest-ProjectMemberTests-1539753999 None] Flow 'volume_create_manager' (f48b933f-0103-4135-89de-02d5ec7dd8a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:31:55 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-248578b5-7b54-43b3-9c29-a05ee39c3270 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01ecebec-58e5-43e4-8c9f-0c2947dc3d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:31:55 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-248578b5-7b54-43b3-9c29-a05ee39c3270 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01ecebec-58e5-43e4-8c9f-0c2947dc3d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:31:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-787178502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=801cfd72-6931-4942-8203-9ac9ddf634dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cb67397f4d04f049564f5d284f139d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:31:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:31:55Z,use_quota=True,user_id='091b86592c99419b9c07a685e7933341',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:31:55 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-248578b5-7b54-43b3-9c29-a05ee39c3270 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d189779-c59a-4603-96e6-39303a618135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:31:55 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-248578b5-7b54-43b3-9c29-a05ee39c3270 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d189779-c59a-4603-96e6-39303a618135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:31:55 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-248578b5-7b54-43b3-9c29-a05ee39c3270 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e5915eb-d501-49f5-8b32-f242a94746a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:31:55 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-248578b5-7b54-43b3-9c29-a05ee39c3270 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e5915eb-d501-49f5-8b32-f242a94746a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '801cfd72-6931-4942-8203-9ac9ddf634dd', 'volume_name': 'volume-801cfd72-6931-4942-8203-9ac9ddf634dd', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:31:55 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-248578b5-7b54-43b3-9c29-a05ee39c3270 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ae0efa0-5a9c-4d4e-96d7-fa20100051b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:31:55 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-248578b5-7b54-43b3-9c29-a05ee39c3270 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ae0efa0-5a9c-4d4e-96d7-fa20100051b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:31:55 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-248578b5-7b54-43b3-9c29-a05ee39c3270 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f94929f5-e2dd-4841-8a0e-41c8b749a815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:31:55 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-248578b5-7b54-43b3-9c29-a05ee39c3270 tempest-ProjectMemberTests-1539753999 None] Volume 801cfd72-6931-4942-8203-9ac9ddf634dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-801cfd72-6931-4942-8203-9ac9ddf634dd', 'volume_size': 1} Nov 04 12:31:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-248578b5-7b54-43b3-9c29-a05ee39c3270 tempest-ProjectMemberTests-1539753999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:31:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-248578b5-7b54-43b3-9c29-a05ee39c3270 tempest-ProjectMemberTests-1539753999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:31:55 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-248578b5-7b54-43b3-9c29-a05ee39c3270 tempest-ProjectMemberTests-1539753999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:31:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-787178502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=801cfd72-6931-4942-8203-9ac9ddf634dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cb67397f4d04f049564f5d284f139d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:31:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:31:55Z,use_quota=True,user_id='091b86592c99419b9c07a685e7933341',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:31:55 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-248578b5-7b54-43b3-9c29-a05ee39c3270 tempest-ProjectMemberTests-1539753999 None] Creating volume 801cfd72-6931-4942-8203-9ac9ddf634dd {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:31:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-248578b5-7b54-43b3-9c29-a05ee39c3270 tempest-ProjectMemberTests-1539753999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:31:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-248578b5-7b54-43b3-9c29-a05ee39c3270 tempest-ProjectMemberTests-1539753999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:31:55 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-248578b5-7b54-43b3-9c29-a05ee39c3270 tempest-ProjectMemberTests-1539753999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:31:55 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-248578b5-7b54-43b3-9c29-a05ee39c3270 tempest-ProjectMemberTests-1539753999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:31:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-248578b5-7b54-43b3-9c29-a05ee39c3270 tempest-ProjectMemberTests-1539753999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:31:55 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-248578b5-7b54-43b3-9c29-a05ee39c3270 tempest-ProjectMemberTests-1539753999 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:31:55 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-248578b5-7b54-43b3-9c29-a05ee39c3270 tempest-ProjectMemberTests-1539753999 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:31:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-248578b5-7b54-43b3-9c29-a05ee39c3270 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-801cfd72-6931-4942-8203-9ac9ddf634dd 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:55 devstack sudo[107843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-801cfd72-6931-4942-8203-9ac9ddf634dd 1073741824 Nov 04 12:31:55 devstack sudo[107843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:55 devstack sudo[107840]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b0ad4272-8453-45ec-a403-25f723b3b78c tempest-ProjectReaderTests-34452203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f6fdbc6f-3bc4-4b46-a997-83d0da9ee1a0" returned: 0 in 0.291s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:55 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b0ad4272-8453-45ec-a403-25f723b3b78c tempest-ProjectReaderTests-34452203 None] Lock "cinder-quobyte-f6fdbc6f-3bc4-4b46-a997-83d0da9ee1a0" released by "delete_volume" :: held 0.898s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:31:55 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-b0ad4272-8453-45ec-a403-25f723b3b78c tempest-ProjectReaderTests-34452203 None] Created reservations ['b5194a75-92be-4195-bfca-7fcfbd74b238', '6e2cf534-f47f-41db-851c-dd64edd59958', 'a53fe343-e2ad-4c45-9307-60069a0c5512', 'e94bd676-9168-4973-945c-0a5536657baa'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:31:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b0ad4272-8453-45ec-a403-25f723b3b78c tempest-ProjectReaderTests-34452203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:31:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b0ad4272-8453-45ec-a403-25f723b3b78c tempest-ProjectReaderTests-34452203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:31:55 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b0ad4272-8453-45ec-a403-25f723b3b78c tempest-ProjectReaderTests-34452203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:31:55 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b0ad4272-8453-45ec-a403-25f723b3b78c tempest-ProjectReaderTests-34452203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:31:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b0ad4272-8453-45ec-a403-25f723b3b78c tempest-ProjectReaderTests-34452203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:31:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b0ad4272-8453-45ec-a403-25f723b3b78c tempest-ProjectReaderTests-34452203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:55 devstack sudo[107845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:31:55 devstack sudo[107845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:56 devstack sudo[107843]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:56 devstack sudo[107845]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-248578b5-7b54-43b3-9c29-a05ee39c3270 tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-801cfd72-6931-4942-8203-9ac9ddf634dd 1073741824" returned: 0 in 0.609s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b0ad4272-8453-45ec-a403-25f723b3b78c tempest-ProjectReaderTests-34452203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.375s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:56 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-b0ad4272-8453-45ec-a403-25f723b3b78c tempest-ProjectReaderTests-34452203 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:31:56 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-b0ad4272-8453-45ec-a403-25f723b3b78c tempest-ProjectReaderTests-34452203 None] Deleted volume successfully. Nov 04 12:31:56 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b0ad4272-8453-45ec-a403-25f723b3b78c tempest-ProjectReaderTests-34452203 None] Lock "cinder-f6fdbc6f-3bc4-4b46-a997-83d0da9ee1a0-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:31:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-248578b5-7b54-43b3-9c29-a05ee39c3270 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-801cfd72-6931-4942-8203-9ac9ddf634dd {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:56 devstack sudo[107852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-801cfd72-6931-4942-8203-9ac9ddf634dd Nov 04 12:31:56 devstack sudo[107852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:56 devstack sudo[107852]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-248578b5-7b54-43b3-9c29-a05ee39c3270 tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-801cfd72-6931-4942-8203-9ac9ddf634dd" returned: 0 in 0.267s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:56 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-248578b5-7b54-43b3-9c29-a05ee39c3270 tempest-ProjectMemberTests-1539753999 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:31:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-248578b5-7b54-43b3-9c29-a05ee39c3270 tempest-ProjectMemberTests-1539753999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:31:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-248578b5-7b54-43b3-9c29-a05ee39c3270 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f94929f5-e2dd-4841-8a0e-41c8b749a815) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-801cfd72-6931-4942-8203-9ac9ddf634dd', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:31:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-248578b5-7b54-43b3-9c29-a05ee39c3270 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0a384a9-90e5-4451-b2f8-2aaadc74f084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:31:56 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-248578b5-7b54-43b3-9c29-a05ee39c3270 tempest-ProjectMemberTests-1539753999 None] Volume volume-801cfd72-6931-4942-8203-9ac9ddf634dd (801cfd72-6931-4942-8203-9ac9ddf634dd): created successfully Nov 04 12:31:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-248578b5-7b54-43b3-9c29-a05ee39c3270 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0a384a9-90e5-4451-b2f8-2aaadc74f084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:31:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-248578b5-7b54-43b3-9c29-a05ee39c3270 tempest-ProjectMemberTests-1539753999 None] Flow 'volume_create_manager' (f48b933f-0103-4135-89de-02d5ec7dd8a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:31:56 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-248578b5-7b54-43b3-9c29-a05ee39c3270 tempest-ProjectMemberTests-1539753999 None] Created volume successfully. Nov 04 12:31:56 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f9bd3ed-7150-41f7-b10c-67102a3673e0 tempest-ProjectReaderTests-1586322695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:31:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2f9bd3ed-7150-41f7-b10c-67102a3673e0 tempest-ProjectReaderTests-1586322695 None] Flow 'volume_create_manager' (970f9dd1-9539-49fb-acac-a1e32b265232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:31:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2f9bd3ed-7150-41f7-b10c-67102a3673e0 tempest-ProjectReaderTests-1586322695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da8089ec-c844-4086-a2a3-bcc296997814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:31:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2f9bd3ed-7150-41f7-b10c-67102a3673e0 tempest-ProjectReaderTests-1586322695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da8089ec-c844-4086-a2a3-bcc296997814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:31:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1214470261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c95166da-fde3-4d07-bf20-4a453385f517,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b26a53d6ce4742ff98b7139c848f0e96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:31:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:31:57Z,use_quota=True,user_id='64e417d69d7a4b66848830619c264278',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:31:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2f9bd3ed-7150-41f7-b10c-67102a3673e0 tempest-ProjectReaderTests-1586322695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12caab22-092e-4295-913b-35f26470e7a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:31:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2f9bd3ed-7150-41f7-b10c-67102a3673e0 tempest-ProjectReaderTests-1586322695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12caab22-092e-4295-913b-35f26470e7a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:31:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2f9bd3ed-7150-41f7-b10c-67102a3673e0 tempest-ProjectReaderTests-1586322695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6d0239c-f5e8-4783-982c-0c318b252c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:31:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2f9bd3ed-7150-41f7-b10c-67102a3673e0 tempest-ProjectReaderTests-1586322695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6d0239c-f5e8-4783-982c-0c318b252c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c95166da-fde3-4d07-bf20-4a453385f517', 'volume_name': 'volume-c95166da-fde3-4d07-bf20-4a453385f517', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:31:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2f9bd3ed-7150-41f7-b10c-67102a3673e0 tempest-ProjectReaderTests-1586322695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cd35c0a-0f38-424e-87c8-81aa33877608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:31:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2f9bd3ed-7150-41f7-b10c-67102a3673e0 tempest-ProjectReaderTests-1586322695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cd35c0a-0f38-424e-87c8-81aa33877608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:31:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2f9bd3ed-7150-41f7-b10c-67102a3673e0 tempest-ProjectReaderTests-1586322695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53e61bbf-e68b-4d04-bb95-a3bbb0003f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:31:56 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-2f9bd3ed-7150-41f7-b10c-67102a3673e0 tempest-ProjectReaderTests-1586322695 None] Volume c95166da-fde3-4d07-bf20-4a453385f517: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c95166da-fde3-4d07-bf20-4a453385f517', 'volume_size': 1} Nov 04 12:31:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2f9bd3ed-7150-41f7-b10c-67102a3673e0 tempest-ProjectReaderTests-1586322695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:31:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2f9bd3ed-7150-41f7-b10c-67102a3673e0 tempest-ProjectReaderTests-1586322695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:31:56 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2f9bd3ed-7150-41f7-b10c-67102a3673e0 tempest-ProjectReaderTests-1586322695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:31:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1214470261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c95166da-fde3-4d07-bf20-4a453385f517,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b26a53d6ce4742ff98b7139c848f0e96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:31:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:31:57Z,use_quota=True,user_id='64e417d69d7a4b66848830619c264278',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:31:56 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-2f9bd3ed-7150-41f7-b10c-67102a3673e0 tempest-ProjectReaderTests-1586322695 None] Creating volume c95166da-fde3-4d07-bf20-4a453385f517 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:31:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2f9bd3ed-7150-41f7-b10c-67102a3673e0 tempest-ProjectReaderTests-1586322695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:31:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2f9bd3ed-7150-41f7-b10c-67102a3673e0 tempest-ProjectReaderTests-1586322695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:31:56 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2f9bd3ed-7150-41f7-b10c-67102a3673e0 tempest-ProjectReaderTests-1586322695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:31:56 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2f9bd3ed-7150-41f7-b10c-67102a3673e0 tempest-ProjectReaderTests-1586322695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:31:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2f9bd3ed-7150-41f7-b10c-67102a3673e0 tempest-ProjectReaderTests-1586322695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:31:56 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2f9bd3ed-7150-41f7-b10c-67102a3673e0 tempest-ProjectReaderTests-1586322695 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:31:56 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-2f9bd3ed-7150-41f7-b10c-67102a3673e0 tempest-ProjectReaderTests-1586322695 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:31:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2f9bd3ed-7150-41f7-b10c-67102a3673e0 tempest-ProjectReaderTests-1586322695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c95166da-fde3-4d07-bf20-4a453385f517 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:56 devstack sudo[107855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c95166da-fde3-4d07-bf20-4a453385f517 1073741824 Nov 04 12:31:56 devstack sudo[107855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:57 devstack sudo[107855]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2f9bd3ed-7150-41f7-b10c-67102a3673e0 tempest-ProjectReaderTests-1586322695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c95166da-fde3-4d07-bf20-4a453385f517 1073741824" returned: 0 in 0.578s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2f9bd3ed-7150-41f7-b10c-67102a3673e0 tempest-ProjectReaderTests-1586322695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c95166da-fde3-4d07-bf20-4a453385f517 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:57 devstack sudo[107861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c95166da-fde3-4d07-bf20-4a453385f517 Nov 04 12:31:57 devstack sudo[107861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:57 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dc320b4-62e6-47b7-8d58-081b73e5401a tempest-ProjectReaderTests-34452203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:31:57 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0dc320b4-62e6-47b7-8d58-081b73e5401a tempest-ProjectReaderTests-34452203 None] Flow 'volume_create_manager' (77bbba48-219a-4d2e-933b-b41f1f307aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:31:57 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0dc320b4-62e6-47b7-8d58-081b73e5401a tempest-ProjectReaderTests-34452203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9813a6c0-77f2-4465-8004-56d45b7cbe35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:31:57 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0dc320b4-62e6-47b7-8d58-081b73e5401a tempest-ProjectReaderTests-34452203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9813a6c0-77f2-4465-8004-56d45b7cbe35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:31:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1302625278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbc9557b-09bf-4948-b912-f9052086856b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb954983f7c64fe388fdbeaf1cdc0a5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:31:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:31:57Z,use_quota=True,user_id='f3d9809a097943a5b1cd27d05f8ff1ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:31:57 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0dc320b4-62e6-47b7-8d58-081b73e5401a tempest-ProjectReaderTests-34452203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a131ac30-66bf-4d00-aef9-b857a057b9ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:31:57 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0dc320b4-62e6-47b7-8d58-081b73e5401a tempest-ProjectReaderTests-34452203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a131ac30-66bf-4d00-aef9-b857a057b9ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:31:57 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0dc320b4-62e6-47b7-8d58-081b73e5401a tempest-ProjectReaderTests-34452203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55f54f64-c57f-4269-84f0-98a54daf5d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:31:57 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0dc320b4-62e6-47b7-8d58-081b73e5401a tempest-ProjectReaderTests-34452203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55f54f64-c57f-4269-84f0-98a54daf5d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbc9557b-09bf-4948-b912-f9052086856b', 'volume_name': 'volume-fbc9557b-09bf-4948-b912-f9052086856b', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:31:57 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0dc320b4-62e6-47b7-8d58-081b73e5401a tempest-ProjectReaderTests-34452203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (438b209a-d8b2-4fb8-84cd-3541834895d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:31:57 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0dc320b4-62e6-47b7-8d58-081b73e5401a tempest-ProjectReaderTests-34452203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (438b209a-d8b2-4fb8-84cd-3541834895d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:31:57 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0dc320b4-62e6-47b7-8d58-081b73e5401a tempest-ProjectReaderTests-34452203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c054b106-8395-4877-989f-28a85d00aa2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:31:57 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-0dc320b4-62e6-47b7-8d58-081b73e5401a tempest-ProjectReaderTests-34452203 None] Volume fbc9557b-09bf-4948-b912-f9052086856b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbc9557b-09bf-4948-b912-f9052086856b', 'volume_size': 1} Nov 04 12:31:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0dc320b4-62e6-47b7-8d58-081b73e5401a tempest-ProjectReaderTests-34452203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:31:57 devstack sudo[107861]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2f9bd3ed-7150-41f7-b10c-67102a3673e0 tempest-ProjectReaderTests-1586322695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c95166da-fde3-4d07-bf20-4a453385f517" returned: 0 in 0.311s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:57 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2f9bd3ed-7150-41f7-b10c-67102a3673e0 tempest-ProjectReaderTests-1586322695 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:31:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2f9bd3ed-7150-41f7-b10c-67102a3673e0 tempest-ProjectReaderTests-1586322695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:31:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0dc320b4-62e6-47b7-8d58-081b73e5401a tempest-ProjectReaderTests-34452203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.140s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:31:57 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0dc320b4-62e6-47b7-8d58-081b73e5401a tempest-ProjectReaderTests-34452203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:31:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1302625278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbc9557b-09bf-4948-b912-f9052086856b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb954983f7c64fe388fdbeaf1cdc0a5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:31:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:31:57Z,use_quota=True,user_id='f3d9809a097943a5b1cd27d05f8ff1ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:31:57 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-0dc320b4-62e6-47b7-8d58-081b73e5401a tempest-ProjectReaderTests-34452203 None] Creating volume fbc9557b-09bf-4948-b912-f9052086856b {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:31:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0dc320b4-62e6-47b7-8d58-081b73e5401a tempest-ProjectReaderTests-34452203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:31:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0dc320b4-62e6-47b7-8d58-081b73e5401a tempest-ProjectReaderTests-34452203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:31:57 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0dc320b4-62e6-47b7-8d58-081b73e5401a tempest-ProjectReaderTests-34452203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:31:57 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0dc320b4-62e6-47b7-8d58-081b73e5401a tempest-ProjectReaderTests-34452203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:31:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0dc320b4-62e6-47b7-8d58-081b73e5401a tempest-ProjectReaderTests-34452203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:31:57 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0dc320b4-62e6-47b7-8d58-081b73e5401a tempest-ProjectReaderTests-34452203 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:31:57 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-0dc320b4-62e6-47b7-8d58-081b73e5401a tempest-ProjectReaderTests-34452203 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:31:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0dc320b4-62e6-47b7-8d58-081b73e5401a tempest-ProjectReaderTests-34452203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fbc9557b-09bf-4948-b912-f9052086856b 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:57 devstack sudo[107864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fbc9557b-09bf-4948-b912-f9052086856b 1073741824 Nov 04 12:31:57 devstack sudo[107864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:57 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2f9bd3ed-7150-41f7-b10c-67102a3673e0 tempest-ProjectReaderTests-1586322695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53e61bbf-e68b-4d04-bb95-a3bbb0003f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c95166da-fde3-4d07-bf20-4a453385f517', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:31:57 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2f9bd3ed-7150-41f7-b10c-67102a3673e0 tempest-ProjectReaderTests-1586322695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8b567c4-7d66-41bc-9cd3-99ed0924c4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:31:57 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-2f9bd3ed-7150-41f7-b10c-67102a3673e0 tempest-ProjectReaderTests-1586322695 None] Volume volume-c95166da-fde3-4d07-bf20-4a453385f517 (c95166da-fde3-4d07-bf20-4a453385f517): created successfully Nov 04 12:31:57 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2f9bd3ed-7150-41f7-b10c-67102a3673e0 tempest-ProjectReaderTests-1586322695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8b567c4-7d66-41bc-9cd3-99ed0924c4d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:31:57 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2f9bd3ed-7150-41f7-b10c-67102a3673e0 tempest-ProjectReaderTests-1586322695 None] Flow 'volume_create_manager' (970f9dd1-9539-49fb-acac-a1e32b265232) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:31:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1cd6c507-4636-480f-b069-738e85759964 tempest-ProjectMemberTests-1539753999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:31:57 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-2f9bd3ed-7150-41f7-b10c-67102a3673e0 tempest-ProjectReaderTests-1586322695 None] Created volume successfully. Nov 04 12:31:58 devstack sudo[107864]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0dc320b4-62e6-47b7-8d58-081b73e5401a tempest-ProjectReaderTests-34452203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fbc9557b-09bf-4948-b912-f9052086856b 1073741824" returned: 0 in 0.469s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0dc320b4-62e6-47b7-8d58-081b73e5401a tempest-ProjectReaderTests-34452203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fbc9557b-09bf-4948-b912-f9052086856b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:58 devstack sudo[107870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fbc9557b-09bf-4948-b912-f9052086856b Nov 04 12:31:58 devstack sudo[107870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:58 devstack sudo[107870]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0dc320b4-62e6-47b7-8d58-081b73e5401a tempest-ProjectReaderTests-34452203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fbc9557b-09bf-4948-b912-f9052086856b" returned: 0 in 0.255s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:58 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0dc320b4-62e6-47b7-8d58-081b73e5401a tempest-ProjectReaderTests-34452203 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:31:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0dc320b4-62e6-47b7-8d58-081b73e5401a tempest-ProjectReaderTests-34452203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:31:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1cd6c507-4636-480f-b069-738e85759964 tempest-ProjectMemberTests-1539753999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.694s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:31:58 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0dc320b4-62e6-47b7-8d58-081b73e5401a tempest-ProjectReaderTests-34452203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c054b106-8395-4877-989f-28a85d00aa2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbc9557b-09bf-4948-b912-f9052086856b', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:31:58 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0dc320b4-62e6-47b7-8d58-081b73e5401a tempest-ProjectReaderTests-34452203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9394f400-c87b-4f6b-a04c-43b9e0367880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:31:58 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-1cd6c507-4636-480f-b069-738e85759964 tempest-ProjectMemberTests-1539753999 None] Creating offline snapshot 3783e2d4-59ef-4525-8aed-0883e1987f2b of volume 801cfd72-6931-4942-8203-9ac9ddf634dd {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 12:31:58 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-0dc320b4-62e6-47b7-8d58-081b73e5401a tempest-ProjectReaderTests-34452203 None] Volume volume-fbc9557b-09bf-4948-b912-f9052086856b (fbc9557b-09bf-4948-b912-f9052086856b): created successfully Nov 04 12:31:58 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0dc320b4-62e6-47b7-8d58-081b73e5401a tempest-ProjectReaderTests-34452203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9394f400-c87b-4f6b-a04c-43b9e0367880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:31:58 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0dc320b4-62e6-47b7-8d58-081b73e5401a tempest-ProjectReaderTests-34452203 None] Flow 'volume_create_manager' (77bbba48-219a-4d2e-933b-b41f1f307aea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:31:58 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[17626a80-7111-4bb4-821e-dc6271f9c34d]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:31:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1cd6c507-4636-480f-b069-738e85759964 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-801cfd72-6931-4942-8203-9ac9ddf634dd {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:58 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-0dc320b4-62e6-47b7-8d58-081b73e5401a tempest-ProjectReaderTests-34452203 None] Created volume successfully. Nov 04 12:31:58 devstack sudo[107873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-801cfd72-6931-4942-8203-9ac9ddf634dd Nov 04 12:31:58 devstack sudo[107873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:58 devstack sudo[107873]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1cd6c507-4636-480f-b069-738e85759964 tempest-ProjectMemberTests-1539753999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-801cfd72-6931-4942-8203-9ac9ddf634dd" returned: 0 in 0.494s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1cd6c507-4636-480f-b069-738e85759964 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-801cfd72-6931-4942-8203-9ac9ddf634dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-801cfd72-6931-4942-8203-9ac9ddf634dd.3783e2d4-59ef-4525-8aed-0883e1987f2b 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:59 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-176e5611-0be7-463f-8674-728ffa3a1002 tempest-ProjectReaderTests-1586322695 None] Acquiring lock "cinder-c95166da-fde3-4d07-bf20-4a453385f517-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:31:59 devstack sudo[107879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-801cfd72-6931-4942-8203-9ac9ddf634dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-801cfd72-6931-4942-8203-9ac9ddf634dd.3783e2d4-59ef-4525-8aed-0883e1987f2b 1G Nov 04 12:31:59 devstack sudo[107879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:59 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-176e5611-0be7-463f-8674-728ffa3a1002 tempest-ProjectReaderTests-1586322695 None] Lock "cinder-c95166da-fde3-4d07-bf20-4a453385f517-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:31:59 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-176e5611-0be7-463f-8674-728ffa3a1002 tempest-ProjectReaderTests-1586322695 None] Acquiring lock "cinder-quobyte-c95166da-fde3-4d07-bf20-4a453385f517" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:31:59 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-176e5611-0be7-463f-8674-728ffa3a1002 tempest-ProjectReaderTests-1586322695 None] Lock "cinder-quobyte-c95166da-fde3-4d07-bf20-4a453385f517" acquired by "delete_volume" :: waited 0.019s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:31:59 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[404afe79-8919-4292-abfa-7452a4fcfb96]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:31:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-176e5611-0be7-463f-8674-728ffa3a1002 tempest-ProjectReaderTests-1586322695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c95166da-fde3-4d07-bf20-4a453385f517 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:59 devstack sudo[107881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c95166da-fde3-4d07-bf20-4a453385f517 Nov 04 12:31:59 devstack sudo[107881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:59 devstack sudo[107879]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1cd6c507-4636-480f-b069-738e85759964 tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-801cfd72-6931-4942-8203-9ac9ddf634dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-801cfd72-6931-4942-8203-9ac9ddf634dd.3783e2d4-59ef-4525-8aed-0883e1987f2b 1G" returned: 0 in 0.486s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1cd6c507-4636-480f-b069-738e85759964 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-801cfd72-6931-4942-8203-9ac9ddf634dd -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-801cfd72-6931-4942-8203-9ac9ddf634dd.3783e2d4-59ef-4525-8aed-0883e1987f2b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:59 devstack sudo[107888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-801cfd72-6931-4942-8203-9ac9ddf634dd -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-801cfd72-6931-4942-8203-9ac9ddf634dd.3783e2d4-59ef-4525-8aed-0883e1987f2b Nov 04 12:31:59 devstack sudo[107888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:59 devstack sudo[107881]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-176e5611-0be7-463f-8674-728ffa3a1002 tempest-ProjectReaderTests-1586322695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c95166da-fde3-4d07-bf20-4a453385f517" returned: 0 in 0.442s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-176e5611-0be7-463f-8674-728ffa3a1002 tempest-ProjectReaderTests-1586322695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c95166da-fde3-4d07-bf20-4a453385f517 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:59 devstack sudo[107892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c95166da-fde3-4d07-bf20-4a453385f517 Nov 04 12:31:59 devstack sudo[107892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-72363050-f1b3-4340-8076-3208a87e812b tempest-ProjectReaderTests-34452203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:31:59 devstack sudo[107892]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-176e5611-0be7-463f-8674-728ffa3a1002 tempest-ProjectReaderTests-1586322695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-c95166da-fde3-4d07-bf20-4a453385f517" returned: 0 in 0.304s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:59 devstack sudo[107888]: pam_unix(sudo:session): session closed for user root Nov 04 12:31:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1cd6c507-4636-480f-b069-738e85759964 tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-801cfd72-6931-4942-8203-9ac9ddf634dd -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-801cfd72-6931-4942-8203-9ac9ddf634dd.3783e2d4-59ef-4525-8aed-0883e1987f2b" returned: 0 in 0.427s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:31:59 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-1cd6c507-4636-480f-b069-738e85759964 tempest-ProjectMemberTests-1539753999 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-801cfd72-6931-4942-8203-9ac9ddf634dd.3783e2d4-59ef-4525-8aed-0883e1987f2b is being set with open permissions: ugo+rw Nov 04 12:31:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1cd6c507-4636-480f-b069-738e85759964 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-801cfd72-6931-4942-8203-9ac9ddf634dd.3783e2d4-59ef-4525-8aed-0883e1987f2b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:31:59 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-176e5611-0be7-463f-8674-728ffa3a1002 tempest-ProjectReaderTests-1586322695 None] Lock "cinder-quobyte-c95166da-fde3-4d07-bf20-4a453385f517" released by "delete_volume" :: held 0.809s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:31:59 devstack sudo[107899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-801cfd72-6931-4942-8203-9ac9ddf634dd.3783e2d4-59ef-4525-8aed-0883e1987f2b Nov 04 12:31:59 devstack sudo[107899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:31:59 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-176e5611-0be7-463f-8674-728ffa3a1002 tempest-ProjectReaderTests-1586322695 None] Created reservations ['58e3ff3f-85a9-4e21-a145-6f677a2384f0', 'ecf397bc-c817-4fd5-9d5a-297688bf1b9f', '346b5305-8c63-40de-83fe-d386570aceab', '32eff041-70b1-4543-a6bb-79f9f6fbda17'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:32:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-176e5611-0be7-463f-8674-728ffa3a1002 tempest-ProjectReaderTests-1586322695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:32:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-176e5611-0be7-463f-8674-728ffa3a1002 tempest-ProjectReaderTests-1586322695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:32:00 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-176e5611-0be7-463f-8674-728ffa3a1002 tempest-ProjectReaderTests-1586322695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:32:00 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-176e5611-0be7-463f-8674-728ffa3a1002 tempest-ProjectReaderTests-1586322695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:32:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-176e5611-0be7-463f-8674-728ffa3a1002 tempest-ProjectReaderTests-1586322695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:32:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-176e5611-0be7-463f-8674-728ffa3a1002 tempest-ProjectReaderTests-1586322695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:00 devstack sudo[107901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:32:00 devstack sudo[107901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:00 devstack sudo[107899]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1cd6c507-4636-480f-b069-738e85759964 tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-801cfd72-6931-4942-8203-9ac9ddf634dd.3783e2d4-59ef-4525-8aed-0883e1987f2b" returned: 0 in 0.291s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1cd6c507-4636-480f-b069-738e85759964 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-801cfd72-6931-4942-8203-9ac9ddf634dd.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:00 devstack sudo[107904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-801cfd72-6931-4942-8203-9ac9ddf634dd.info Nov 04 12:32:00 devstack sudo[107904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:00 devstack sudo[107901]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-176e5611-0be7-463f-8674-728ffa3a1002 tempest-ProjectReaderTests-1586322695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.279s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:00 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-176e5611-0be7-463f-8674-728ffa3a1002 tempest-ProjectReaderTests-1586322695 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:32:00 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-176e5611-0be7-463f-8674-728ffa3a1002 tempest-ProjectReaderTests-1586322695 None] Deleted volume successfully. Nov 04 12:32:00 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-176e5611-0be7-463f-8674-728ffa3a1002 tempest-ProjectReaderTests-1586322695 None] Lock "cinder-c95166da-fde3-4d07-bf20-4a453385f517-delete_volume" released by "delete_volume" :: held 1.358s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:32:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1cd6c507-4636-480f-b069-738e85759964 tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-801cfd72-6931-4942-8203-9ac9ddf634dd.info" returned: 0 in 0.317s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:00 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-1cd6c507-4636-480f-b069-738e85759964 tempest-ProjectMemberTests-1539753999 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-801cfd72-6931-4942-8203-9ac9ddf634dd.info is being set with open permissions: ugo+rw Nov 04 12:32:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1cd6c507-4636-480f-b069-738e85759964 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-801cfd72-6931-4942-8203-9ac9ddf634dd.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:00 devstack sudo[107904]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:00 devstack sudo[107908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-801cfd72-6931-4942-8203-9ac9ddf634dd.info Nov 04 12:32:00 devstack sudo[107908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:00 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-e689836c-3f60-4934-99b4-fc4ca986538a tempest-ProjectReaderTests-1586322695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:32:00 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e689836c-3f60-4934-99b4-fc4ca986538a tempest-ProjectReaderTests-1586322695 None] Flow 'volume_create_manager' (fbf5b17e-d790-4225-a3ef-5e700bf23150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:32:00 devstack sudo[107908]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:00 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e689836c-3f60-4934-99b4-fc4ca986538a tempest-ProjectReaderTests-1586322695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (980e69bf-bfcf-4032-a6ba-e50a9f5dc929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:32:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1cd6c507-4636-480f-b069-738e85759964 tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-801cfd72-6931-4942-8203-9ac9ddf634dd.info" returned: 0 in 0.320s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1cd6c507-4636-480f-b069-738e85759964 tempest-ProjectMemberTests-1539753999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.458s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:32:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-72363050-f1b3-4340-8076-3208a87e812b tempest-ProjectReaderTests-34452203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.172s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:32:00 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e689836c-3f60-4934-99b4-fc4ca986538a tempest-ProjectReaderTests-1586322695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (980e69bf-bfcf-4032-a6ba-e50a9f5dc929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:32:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-261015607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f05d5964-cea7-4b8d-9743-c331e498f38e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b26a53d6ce4742ff98b7139c848f0e96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:32:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:32:01Z,use_quota=True,user_id='64e417d69d7a4b66848830619c264278',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:32:00 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e689836c-3f60-4934-99b4-fc4ca986538a tempest-ProjectReaderTests-1586322695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85958de9-1b32-4cc2-883c-15d743db8486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:32:00 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e689836c-3f60-4934-99b4-fc4ca986538a tempest-ProjectReaderTests-1586322695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85958de9-1b32-4cc2-883c-15d743db8486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:32:00 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e689836c-3f60-4934-99b4-fc4ca986538a tempest-ProjectReaderTests-1586322695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34d5908b-3080-4b27-b08c-fcb381048a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:32:00 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e689836c-3f60-4934-99b4-fc4ca986538a tempest-ProjectReaderTests-1586322695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34d5908b-3080-4b27-b08c-fcb381048a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f05d5964-cea7-4b8d-9743-c331e498f38e', 'volume_name': 'volume-f05d5964-cea7-4b8d-9743-c331e498f38e', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:32:00 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e689836c-3f60-4934-99b4-fc4ca986538a tempest-ProjectReaderTests-1586322695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a038cc87-87a9-4565-aa19-dca33302958a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:32:00 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e689836c-3f60-4934-99b4-fc4ca986538a tempest-ProjectReaderTests-1586322695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a038cc87-87a9-4565-aa19-dca33302958a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:32:00 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e689836c-3f60-4934-99b4-fc4ca986538a tempest-ProjectReaderTests-1586322695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d14c5e9-57e1-456d-8e7d-1a2ecc1a72c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:32:00 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-e689836c-3f60-4934-99b4-fc4ca986538a tempest-ProjectReaderTests-1586322695 None] Volume f05d5964-cea7-4b8d-9743-c331e498f38e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f05d5964-cea7-4b8d-9743-c331e498f38e', 'volume_size': 1} Nov 04 12:32:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e689836c-3f60-4934-99b4-fc4ca986538a tempest-ProjectReaderTests-1586322695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:32:00 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-72363050-f1b3-4340-8076-3208a87e812b tempest-ProjectReaderTests-34452203 None] Creating offline snapshot c1e14d2e-41a7-495a-aae3-27b72a0d82bc of volume fbc9557b-09bf-4948-b912-f9052086856b {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 12:32:00 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-1cd6c507-4636-480f-b069-738e85759964 tempest-ProjectMemberTests-1539753999 None] Create snapshot completed successfully Nov 04 12:32:00 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7815b7-668c-4472-bd2e-5d033b5016b7]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:32:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-72363050-f1b3-4340-8076-3208a87e812b tempest-ProjectReaderTests-34452203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fbc9557b-09bf-4948-b912-f9052086856b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:01 devstack sudo[107912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fbc9557b-09bf-4948-b912-f9052086856b Nov 04 12:32:01 devstack sudo[107912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:01 devstack sudo[107912]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-72363050-f1b3-4340-8076-3208a87e812b tempest-ProjectReaderTests-34452203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fbc9557b-09bf-4948-b912-f9052086856b" returned: 0 in 0.383s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-72363050-f1b3-4340-8076-3208a87e812b tempest-ProjectReaderTests-34452203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fbc9557b-09bf-4948-b912-f9052086856b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fbc9557b-09bf-4948-b912-f9052086856b.c1e14d2e-41a7-495a-aae3-27b72a0d82bc 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:01 devstack sudo[107917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fbc9557b-09bf-4948-b912-f9052086856b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fbc9557b-09bf-4948-b912-f9052086856b.c1e14d2e-41a7-495a-aae3-27b72a0d82bc 1G Nov 04 12:32:01 devstack sudo[107917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:01 devstack sudo[107917]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-72363050-f1b3-4340-8076-3208a87e812b tempest-ProjectReaderTests-34452203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fbc9557b-09bf-4948-b912-f9052086856b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fbc9557b-09bf-4948-b912-f9052086856b.c1e14d2e-41a7-495a-aae3-27b72a0d82bc 1G" returned: 0 in 0.469s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-72363050-f1b3-4340-8076-3208a87e812b tempest-ProjectReaderTests-34452203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbc9557b-09bf-4948-b912-f9052086856b -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fbc9557b-09bf-4948-b912-f9052086856b.c1e14d2e-41a7-495a-aae3-27b72a0d82bc {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:01 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 12:32:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:32:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:32:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:32:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:32:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:32:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:01 devstack sudo[107923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbc9557b-09bf-4948-b912-f9052086856b -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fbc9557b-09bf-4948-b912-f9052086856b.c1e14d2e-41a7-495a-aae3-27b72a0d82bc Nov 04 12:32:01 devstack sudo[107923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:01 devstack sudo[107925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:32:01 devstack sudo[107925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a873bfb7-346d-475f-8468-4cc04331d74d tempest-ProjectMemberTests-1539753999 None] Acquiring lock "cinder-3783e2d4-59ef-4525-8aed-0883e1987f2b-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:32:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a873bfb7-346d-475f-8468-4cc04331d74d tempest-ProjectMemberTests-1539753999 None] Lock "cinder-3783e2d4-59ef-4525-8aed-0883e1987f2b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:32:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a873bfb7-346d-475f-8468-4cc04331d74d tempest-ProjectMemberTests-1539753999 None] Acquiring lock "cinder-quobyte-801cfd72-6931-4942-8203-9ac9ddf634dd" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:32:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a873bfb7-346d-475f-8468-4cc04331d74d tempest-ProjectMemberTests-1539753999 None] Lock "cinder-quobyte-801cfd72-6931-4942-8203-9ac9ddf634dd" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:32:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a873bfb7-346d-475f-8468-4cc04331d74d tempest-ProjectMemberTests-1539753999 None] Acquiring lock "cinder-quobyte-3783e2d4-59ef-4525-8aed-0883e1987f2b" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:32:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a873bfb7-346d-475f-8468-4cc04331d74d tempest-ProjectMemberTests-1539753999 None] Lock "cinder-quobyte-3783e2d4-59ef-4525-8aed-0883e1987f2b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:32:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-a873bfb7-346d-475f-8468-4cc04331d74d tempest-ProjectMemberTests-1539753999 None] Deleting offline snapshot 3783e2d4-59ef-4525-8aed-0883e1987f2b of volume 801cfd72-6931-4942-8203-9ac9ddf634dd {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 12:32:02 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-a873bfb7-346d-475f-8468-4cc04331d74d tempest-ProjectMemberTests-1539753999 None] snapshot_file for this snap is: volume-801cfd72-6931-4942-8203-9ac9ddf634dd.3783e2d4-59ef-4525-8aed-0883e1987f2b {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 12:32:02 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e22a71-ec86-4199-aa91-22396d3cb758]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:32:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a873bfb7-346d-475f-8468-4cc04331d74d tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-801cfd72-6931-4942-8203-9ac9ddf634dd.3783e2d4-59ef-4525-8aed-0883e1987f2b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:02 devstack sudo[107925]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.268s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:02 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:32:02 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Running periodic task VolumeManager._thread_info {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 12:32:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] thread count: 28 {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 12:32:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] thread info: [<_MainThread(MainThread, started 140610387472512)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 12:32:02 devstack sudo[107927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-801cfd72-6931-4942-8203-9ac9ddf634dd.3783e2d4-59ef-4525-8aed-0883e1987f2b Nov 04 12:32:02 devstack sudo[107927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:02 devstack sudo[107923]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-72363050-f1b3-4340-8076-3208a87e812b tempest-ProjectReaderTests-34452203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbc9557b-09bf-4948-b912-f9052086856b -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fbc9557b-09bf-4948-b912-f9052086856b.c1e14d2e-41a7-495a-aae3-27b72a0d82bc" returned: 0 in 0.351s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:02 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-72363050-f1b3-4340-8076-3208a87e812b tempest-ProjectReaderTests-34452203 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fbc9557b-09bf-4948-b912-f9052086856b.c1e14d2e-41a7-495a-aae3-27b72a0d82bc is being set with open permissions: ugo+rw Nov 04 12:32:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-72363050-f1b3-4340-8076-3208a87e812b tempest-ProjectReaderTests-34452203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fbc9557b-09bf-4948-b912-f9052086856b.c1e14d2e-41a7-495a-aae3-27b72a0d82bc {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:02 devstack sudo[107934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fbc9557b-09bf-4948-b912-f9052086856b.c1e14d2e-41a7-495a-aae3-27b72a0d82bc Nov 04 12:32:02 devstack sudo[107934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:02 devstack sudo[107927]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a873bfb7-346d-475f-8468-4cc04331d74d tempest-ProjectMemberTests-1539753999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-801cfd72-6931-4942-8203-9ac9ddf634dd.3783e2d4-59ef-4525-8aed-0883e1987f2b" returned: 0 in 0.362s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:02 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-a873bfb7-346d-475f-8468-4cc04331d74d tempest-ProjectMemberTests-1539753999 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-801cfd72-6931-4942-8203-9ac9ddf634dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 12:32:02 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[43532e33-37af-46b0-835e-99e026cb5452]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:32:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a873bfb7-346d-475f-8468-4cc04331d74d tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-801cfd72-6931-4942-8203-9ac9ddf634dd {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:02 devstack sudo[107934]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-72363050-f1b3-4340-8076-3208a87e812b tempest-ProjectReaderTests-34452203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fbc9557b-09bf-4948-b912-f9052086856b.c1e14d2e-41a7-495a-aae3-27b72a0d82bc" returned: 0 in 0.261s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-72363050-f1b3-4340-8076-3208a87e812b tempest-ProjectReaderTests-34452203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fbc9557b-09bf-4948-b912-f9052086856b.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:02 devstack sudo[107941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fbc9557b-09bf-4948-b912-f9052086856b.info Nov 04 12:32:02 devstack sudo[107941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:02 devstack sudo[107940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-801cfd72-6931-4942-8203-9ac9ddf634dd Nov 04 12:32:02 devstack sudo[107940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:02 devstack sudo[107941]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-72363050-f1b3-4340-8076-3208a87e812b tempest-ProjectReaderTests-34452203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fbc9557b-09bf-4948-b912-f9052086856b.info" returned: 0 in 0.322s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:02 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-72363050-f1b3-4340-8076-3208a87e812b tempest-ProjectReaderTests-34452203 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fbc9557b-09bf-4948-b912-f9052086856b.info is being set with open permissions: ugo+rw Nov 04 12:32:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-72363050-f1b3-4340-8076-3208a87e812b tempest-ProjectReaderTests-34452203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fbc9557b-09bf-4948-b912-f9052086856b.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:02 devstack sudo[107947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fbc9557b-09bf-4948-b912-f9052086856b.info Nov 04 12:32:02 devstack sudo[107947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:02 devstack sudo[107940]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a873bfb7-346d-475f-8468-4cc04331d74d tempest-ProjectMemberTests-1539753999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-801cfd72-6931-4942-8203-9ac9ddf634dd" returned: 0 in 0.479s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a873bfb7-346d-475f-8468-4cc04331d74d tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-801cfd72-6931-4942-8203-9ac9ddf634dd.3783e2d4-59ef-4525-8aed-0883e1987f2b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:02 devstack sudo[107950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-801cfd72-6931-4942-8203-9ac9ddf634dd.3783e2d4-59ef-4525-8aed-0883e1987f2b Nov 04 12:32:02 devstack sudo[107950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:03 devstack sudo[107947]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-72363050-f1b3-4340-8076-3208a87e812b tempest-ProjectReaderTests-34452203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fbc9557b-09bf-4948-b912-f9052086856b.info" returned: 0 in 0.316s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-72363050-f1b3-4340-8076-3208a87e812b tempest-ProjectReaderTests-34452203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.250s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:32:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e689836c-3f60-4934-99b4-fc4ca986538a tempest-ProjectReaderTests-1586322695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.199s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:32:03 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e689836c-3f60-4934-99b4-fc4ca986538a tempest-ProjectReaderTests-1586322695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:32:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-261015607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f05d5964-cea7-4b8d-9743-c331e498f38e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b26a53d6ce4742ff98b7139c848f0e96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:32:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:32:01Z,use_quota=True,user_id='64e417d69d7a4b66848830619c264278',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:32:03 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-e689836c-3f60-4934-99b4-fc4ca986538a tempest-ProjectReaderTests-1586322695 None] Creating volume f05d5964-cea7-4b8d-9743-c331e498f38e {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:32:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e689836c-3f60-4934-99b4-fc4ca986538a tempest-ProjectReaderTests-1586322695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:32:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e689836c-3f60-4934-99b4-fc4ca986538a tempest-ProjectReaderTests-1586322695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:32:03 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e689836c-3f60-4934-99b4-fc4ca986538a tempest-ProjectReaderTests-1586322695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:32:03 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e689836c-3f60-4934-99b4-fc4ca986538a tempest-ProjectReaderTests-1586322695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:32:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e689836c-3f60-4934-99b4-fc4ca986538a tempest-ProjectReaderTests-1586322695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:32:03 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e689836c-3f60-4934-99b4-fc4ca986538a tempest-ProjectReaderTests-1586322695 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:32:03 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-e689836c-3f60-4934-99b4-fc4ca986538a tempest-ProjectReaderTests-1586322695 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:32:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e689836c-3f60-4934-99b4-fc4ca986538a tempest-ProjectReaderTests-1586322695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f05d5964-cea7-4b8d-9743-c331e498f38e 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:03 devstack sudo[107955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f05d5964-cea7-4b8d-9743-c331e498f38e 1073741824 Nov 04 12:32:03 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-72363050-f1b3-4340-8076-3208a87e812b tempest-ProjectReaderTests-34452203 None] Create snapshot completed successfully Nov 04 12:32:03 devstack sudo[107955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:03 devstack sudo[107950]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a873bfb7-346d-475f-8468-4cc04331d74d tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-801cfd72-6931-4942-8203-9ac9ddf634dd.3783e2d4-59ef-4525-8aed-0883e1987f2b" returned: 0 in 0.424s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a873bfb7-346d-475f-8468-4cc04331d74d tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-801cfd72-6931-4942-8203-9ac9ddf634dd.3783e2d4-59ef-4525-8aed-0883e1987f2b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:03 devstack sudo[107958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-801cfd72-6931-4942-8203-9ac9ddf634dd.3783e2d4-59ef-4525-8aed-0883e1987f2b Nov 04 12:32:03 devstack sudo[107958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:03 devstack sudo[107958]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a873bfb7-346d-475f-8468-4cc04331d74d tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-801cfd72-6931-4942-8203-9ac9ddf634dd.3783e2d4-59ef-4525-8aed-0883e1987f2b" returned: 0 in 0.291s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:03 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a873bfb7-346d-475f-8468-4cc04331d74d tempest-ProjectMemberTests-1539753999 None] Lock "cinder-quobyte-3783e2d4-59ef-4525-8aed-0883e1987f2b" released by "_delete_snapshot" :: held 1.679s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:32:03 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a873bfb7-346d-475f-8468-4cc04331d74d tempest-ProjectMemberTests-1539753999 None] Lock "cinder-quobyte-801cfd72-6931-4942-8203-9ac9ddf634dd" released by "delete_snapshot" :: held 1.706s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:32:03 devstack sudo[107955]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e689836c-3f60-4934-99b4-fc4ca986538a tempest-ProjectReaderTests-1586322695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f05d5964-cea7-4b8d-9743-c331e498f38e 1073741824" returned: 0 in 0.529s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e689836c-3f60-4934-99b4-fc4ca986538a tempest-ProjectReaderTests-1586322695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f05d5964-cea7-4b8d-9743-c331e498f38e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:03 devstack sudo[107967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f05d5964-cea7-4b8d-9743-c331e498f38e Nov 04 12:32:03 devstack sudo[107967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:03 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-a873bfb7-346d-475f-8468-4cc04331d74d tempest-ProjectMemberTests-1539753999 None] Created reservations ['743100ba-6a9b-498f-a71f-63611412fb6d', '5dee0510-fde0-43df-b92b-a8105bba47a2', 'bea9faf1-647d-4a32-8724-7231bf4bf069', 'ea8a10ae-8fca-4c74-ad38-6eefeee342d8'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:32:03 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-a873bfb7-346d-475f-8468-4cc04331d74d tempest-ProjectMemberTests-1539753999 None] Delete snapshot completed successfully. Nov 04 12:32:03 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a873bfb7-346d-475f-8468-4cc04331d74d tempest-ProjectMemberTests-1539753999 None] Lock "cinder-3783e2d4-59ef-4525-8aed-0883e1987f2b-delete_snapshot" released by "delete_snapshot" :: held 2.013s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:32:03 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-29ff0a95-34ee-4fd8-b0a3-d0d35e004389 tempest-ProjectReaderTests-34452203 None] Acquiring lock "cinder-c1e14d2e-41a7-495a-aae3-27b72a0d82bc-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:32:04 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-29ff0a95-34ee-4fd8-b0a3-d0d35e004389 tempest-ProjectReaderTests-34452203 None] Lock "cinder-c1e14d2e-41a7-495a-aae3-27b72a0d82bc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:32:04 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-29ff0a95-34ee-4fd8-b0a3-d0d35e004389 tempest-ProjectReaderTests-34452203 None] Acquiring lock "cinder-quobyte-fbc9557b-09bf-4948-b912-f9052086856b" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:32:04 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-29ff0a95-34ee-4fd8-b0a3-d0d35e004389 tempest-ProjectReaderTests-34452203 None] Lock "cinder-quobyte-fbc9557b-09bf-4948-b912-f9052086856b" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:32:04 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-29ff0a95-34ee-4fd8-b0a3-d0d35e004389 tempest-ProjectReaderTests-34452203 None] Acquiring lock "cinder-quobyte-c1e14d2e-41a7-495a-aae3-27b72a0d82bc" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:32:04 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-29ff0a95-34ee-4fd8-b0a3-d0d35e004389 tempest-ProjectReaderTests-34452203 None] Lock "cinder-quobyte-c1e14d2e-41a7-495a-aae3-27b72a0d82bc" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:32:04 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-29ff0a95-34ee-4fd8-b0a3-d0d35e004389 tempest-ProjectReaderTests-34452203 None] Deleting offline snapshot c1e14d2e-41a7-495a-aae3-27b72a0d82bc of volume fbc9557b-09bf-4948-b912-f9052086856b {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 12:32:04 devstack sudo[107967]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:04 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-29ff0a95-34ee-4fd8-b0a3-d0d35e004389 tempest-ProjectReaderTests-34452203 None] snapshot_file for this snap is: volume-fbc9557b-09bf-4948-b912-f9052086856b.c1e14d2e-41a7-495a-aae3-27b72a0d82bc {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 12:32:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e689836c-3f60-4934-99b4-fc4ca986538a tempest-ProjectReaderTests-1586322695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f05d5964-cea7-4b8d-9743-c331e498f38e" returned: 0 in 0.379s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:04 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e689836c-3f60-4934-99b4-fc4ca986538a tempest-ProjectReaderTests-1586322695 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:32:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e689836c-3f60-4934-99b4-fc4ca986538a tempest-ProjectReaderTests-1586322695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:32:04 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e689836c-3f60-4934-99b4-fc4ca986538a tempest-ProjectReaderTests-1586322695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d14c5e9-57e1-456d-8e7d-1a2ecc1a72c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f05d5964-cea7-4b8d-9743-c331e498f38e', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:32:04 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e689836c-3f60-4934-99b4-fc4ca986538a tempest-ProjectReaderTests-1586322695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39f42262-252a-4977-bf1d-08555c02e821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:32:04 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[720b774d-32bc-4e16-b876-2cd81c43e695]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:32:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-29ff0a95-34ee-4fd8-b0a3-d0d35e004389 tempest-ProjectReaderTests-34452203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fbc9557b-09bf-4948-b912-f9052086856b.c1e14d2e-41a7-495a-aae3-27b72a0d82bc {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:04 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ea1e5f63-bc45-4713-9f02-cd99ddc60190 tempest-ProjectMemberTests-1539753999 None] Acquiring lock "cinder-801cfd72-6931-4942-8203-9ac9ddf634dd-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:32:04 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-e689836c-3f60-4934-99b4-fc4ca986538a tempest-ProjectReaderTests-1586322695 None] Volume volume-f05d5964-cea7-4b8d-9743-c331e498f38e (f05d5964-cea7-4b8d-9743-c331e498f38e): created successfully Nov 04 12:32:04 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e689836c-3f60-4934-99b4-fc4ca986538a tempest-ProjectReaderTests-1586322695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39f42262-252a-4977-bf1d-08555c02e821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:32:04 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e689836c-3f60-4934-99b4-fc4ca986538a tempest-ProjectReaderTests-1586322695 None] Flow 'volume_create_manager' (fbf5b17e-d790-4225-a3ef-5e700bf23150) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:32:04 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ea1e5f63-bc45-4713-9f02-cd99ddc60190 tempest-ProjectMemberTests-1539753999 None] Lock "cinder-801cfd72-6931-4942-8203-9ac9ddf634dd-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:32:04 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-e689836c-3f60-4934-99b4-fc4ca986538a tempest-ProjectReaderTests-1586322695 None] Created volume successfully. Nov 04 12:32:04 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ea1e5f63-bc45-4713-9f02-cd99ddc60190 tempest-ProjectMemberTests-1539753999 None] Acquiring lock "cinder-quobyte-801cfd72-6931-4942-8203-9ac9ddf634dd" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:32:04 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ea1e5f63-bc45-4713-9f02-cd99ddc60190 tempest-ProjectMemberTests-1539753999 None] Lock "cinder-quobyte-801cfd72-6931-4942-8203-9ac9ddf634dd" acquired by "delete_volume" :: waited 0.017s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:32:04 devstack sudo[107970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fbc9557b-09bf-4948-b912-f9052086856b.c1e14d2e-41a7-495a-aae3-27b72a0d82bc Nov 04 12:32:04 devstack sudo[107970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:04 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[94743532-508f-4c75-9c4e-6ef00182d22e]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:32:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ea1e5f63-bc45-4713-9f02-cd99ddc60190 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-801cfd72-6931-4942-8203-9ac9ddf634dd {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:04 devstack sudo[107972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-801cfd72-6931-4942-8203-9ac9ddf634dd Nov 04 12:32:04 devstack sudo[107972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:04 devstack sudo[107970]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-29ff0a95-34ee-4fd8-b0a3-d0d35e004389 tempest-ProjectReaderTests-34452203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fbc9557b-09bf-4948-b912-f9052086856b.c1e14d2e-41a7-495a-aae3-27b72a0d82bc" returned: 0 in 0.412s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:04 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-29ff0a95-34ee-4fd8-b0a3-d0d35e004389 tempest-ProjectReaderTests-34452203 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fbc9557b-09bf-4948-b912-f9052086856b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 12:32:04 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a85575a-8746-4cd7-95b2-e0f4eed5d53a]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:32:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-29ff0a95-34ee-4fd8-b0a3-d0d35e004389 tempest-ProjectReaderTests-34452203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fbc9557b-09bf-4948-b912-f9052086856b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:04 devstack sudo[107978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fbc9557b-09bf-4948-b912-f9052086856b Nov 04 12:32:04 devstack sudo[107978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:04 devstack sudo[107972]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ea1e5f63-bc45-4713-9f02-cd99ddc60190 tempest-ProjectMemberTests-1539753999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-801cfd72-6931-4942-8203-9ac9ddf634dd" returned: 0 in 0.417s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ea1e5f63-bc45-4713-9f02-cd99ddc60190 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-801cfd72-6931-4942-8203-9ac9ddf634dd {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:04 devstack sudo[107983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-801cfd72-6931-4942-8203-9ac9ddf634dd Nov 04 12:32:04 devstack sudo[107983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:05 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0bc27eeb-eac5-4ead-b430-a6cbc338b5ed tempest-ProjectReaderTests-1586322695 None] Acquiring lock "cinder-f05d5964-cea7-4b8d-9743-c331e498f38e-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:32:05 devstack sudo[107983]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ea1e5f63-bc45-4713-9f02-cd99ddc60190 tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-801cfd72-6931-4942-8203-9ac9ddf634dd" returned: 0 in 0.316s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:05 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0bc27eeb-eac5-4ead-b430-a6cbc338b5ed tempest-ProjectReaderTests-1586322695 None] Lock "cinder-f05d5964-cea7-4b8d-9743-c331e498f38e-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:32:05 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ea1e5f63-bc45-4713-9f02-cd99ddc60190 tempest-ProjectMemberTests-1539753999 None] Lock "cinder-quobyte-801cfd72-6931-4942-8203-9ac9ddf634dd" released by "delete_volume" :: held 0.826s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:32:05 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0bc27eeb-eac5-4ead-b430-a6cbc338b5ed tempest-ProjectReaderTests-1586322695 None] Acquiring lock "cinder-quobyte-f05d5964-cea7-4b8d-9743-c331e498f38e" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:32:05 devstack sudo[107978]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-29ff0a95-34ee-4fd8-b0a3-d0d35e004389 tempest-ProjectReaderTests-34452203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fbc9557b-09bf-4948-b912-f9052086856b" returned: 0 in 0.559s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-29ff0a95-34ee-4fd8-b0a3-d0d35e004389 tempest-ProjectReaderTests-34452203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fbc9557b-09bf-4948-b912-f9052086856b.c1e14d2e-41a7-495a-aae3-27b72a0d82bc {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:05 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0bc27eeb-eac5-4ead-b430-a6cbc338b5ed tempest-ProjectReaderTests-1586322695 None] Lock "cinder-quobyte-f05d5964-cea7-4b8d-9743-c331e498f38e" acquired by "delete_volume" :: waited 0.045s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:32:05 devstack sudo[107989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fbc9557b-09bf-4948-b912-f9052086856b.c1e14d2e-41a7-495a-aae3-27b72a0d82bc Nov 04 12:32:05 devstack sudo[107989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:05 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-ea1e5f63-bc45-4713-9f02-cd99ddc60190 tempest-ProjectMemberTests-1539753999 None] Created reservations ['13f8fed1-b1f9-47d8-9359-afdc73aff27a', 'd43cf6a3-1508-4e8c-8a9b-40f8b6bd55f8', 'e2f9131f-55a7-4210-8c0e-53af74e66562', '57f4dc8f-b7fe-4105-94ba-3be425cb4d9c'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:32:05 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5467737f-9e7d-41c9-a9fe-286595103455]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:32:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0bc27eeb-eac5-4ead-b430-a6cbc338b5ed tempest-ProjectReaderTests-1586322695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f05d5964-cea7-4b8d-9743-c331e498f38e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ea1e5f63-bc45-4713-9f02-cd99ddc60190 tempest-ProjectMemberTests-1539753999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:32:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ea1e5f63-bc45-4713-9f02-cd99ddc60190 tempest-ProjectMemberTests-1539753999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:32:05 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ea1e5f63-bc45-4713-9f02-cd99ddc60190 tempest-ProjectMemberTests-1539753999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:32:05 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ea1e5f63-bc45-4713-9f02-cd99ddc60190 tempest-ProjectMemberTests-1539753999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:32:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ea1e5f63-bc45-4713-9f02-cd99ddc60190 tempest-ProjectMemberTests-1539753999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:32:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ea1e5f63-bc45-4713-9f02-cd99ddc60190 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:05 devstack sudo[107991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f05d5964-cea7-4b8d-9743-c331e498f38e Nov 04 12:32:05 devstack sudo[107992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:32:05 devstack sudo[107992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:05 devstack sudo[107991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:05 devstack sudo[107989]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-29ff0a95-34ee-4fd8-b0a3-d0d35e004389 tempest-ProjectReaderTests-34452203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fbc9557b-09bf-4948-b912-f9052086856b.c1e14d2e-41a7-495a-aae3-27b72a0d82bc" returned: 0 in 0.433s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-29ff0a95-34ee-4fd8-b0a3-d0d35e004389 tempest-ProjectReaderTests-34452203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fbc9557b-09bf-4948-b912-f9052086856b.c1e14d2e-41a7-495a-aae3-27b72a0d82bc {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:05 devstack sudo[107999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fbc9557b-09bf-4948-b912-f9052086856b.c1e14d2e-41a7-495a-aae3-27b72a0d82bc Nov 04 12:32:05 devstack sudo[107999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:05 devstack sudo[107992]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ea1e5f63-bc45-4713-9f02-cd99ddc60190 tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.315s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:05 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-ea1e5f63-bc45-4713-9f02-cd99ddc60190 tempest-ProjectMemberTests-1539753999 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:32:05 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-ea1e5f63-bc45-4713-9f02-cd99ddc60190 tempest-ProjectMemberTests-1539753999 None] Deleted volume successfully. Nov 04 12:32:05 devstack sudo[107991]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0bc27eeb-eac5-4ead-b430-a6cbc338b5ed tempest-ProjectReaderTests-1586322695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f05d5964-cea7-4b8d-9743-c331e498f38e" returned: 0 in 0.498s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0bc27eeb-eac5-4ead-b430-a6cbc338b5ed tempest-ProjectReaderTests-1586322695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f05d5964-cea7-4b8d-9743-c331e498f38e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:05 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ea1e5f63-bc45-4713-9f02-cd99ddc60190 tempest-ProjectMemberTests-1539753999 None] Lock "cinder-801cfd72-6931-4942-8203-9ac9ddf634dd-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:32:05 devstack sudo[108005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f05d5964-cea7-4b8d-9743-c331e498f38e Nov 04 12:32:05 devstack sudo[108005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:05 devstack sudo[107999]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-29ff0a95-34ee-4fd8-b0a3-d0d35e004389 tempest-ProjectReaderTests-34452203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fbc9557b-09bf-4948-b912-f9052086856b.c1e14d2e-41a7-495a-aae3-27b72a0d82bc" returned: 0 in 0.324s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:05 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-29ff0a95-34ee-4fd8-b0a3-d0d35e004389 tempest-ProjectReaderTests-34452203 None] Lock "cinder-quobyte-c1e14d2e-41a7-495a-aae3-27b72a0d82bc" released by "_delete_snapshot" :: held 1.876s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:32:05 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-29ff0a95-34ee-4fd8-b0a3-d0d35e004389 tempest-ProjectReaderTests-34452203 None] Lock "cinder-quobyte-fbc9557b-09bf-4948-b912-f9052086856b" released by "delete_snapshot" :: held 1.908s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:32:06 devstack sudo[108005]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0bc27eeb-eac5-4ead-b430-a6cbc338b5ed tempest-ProjectReaderTests-1586322695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-f05d5964-cea7-4b8d-9743-c331e498f38e" returned: 0 in 0.294s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:06 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0bc27eeb-eac5-4ead-b430-a6cbc338b5ed tempest-ProjectReaderTests-1586322695 None] Lock "cinder-quobyte-f05d5964-cea7-4b8d-9743-c331e498f38e" released by "delete_volume" :: held 0.845s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:32:06 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-29ff0a95-34ee-4fd8-b0a3-d0d35e004389 tempest-ProjectReaderTests-34452203 None] Created reservations ['8ffb71b5-17ac-4cd7-af78-50b6b630b91c', '5ab58098-662c-41f8-9d32-914b86931b09', '607a6eb9-9a75-4b40-90e7-cfed0e46f952', '8524afd9-32b8-4003-a606-69c5ad2629fe'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:32:06 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-0bc27eeb-eac5-4ead-b430-a6cbc338b5ed tempest-ProjectReaderTests-1586322695 None] Created reservations ['0591ebc4-3945-42f4-8a7b-5c146fa07850', '81f427e9-bbc4-4109-a8c3-7bf38b398742', '2065980e-0367-49b3-a41b-6435cc6733b4', '89118d9f-c690-4c5f-bb57-ca0090fce392'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:32:06 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-29ff0a95-34ee-4fd8-b0a3-d0d35e004389 tempest-ProjectReaderTests-34452203 None] Delete snapshot completed successfully. Nov 04 12:32:06 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-29ff0a95-34ee-4fd8-b0a3-d0d35e004389 tempest-ProjectReaderTests-34452203 None] Lock "cinder-c1e14d2e-41a7-495a-aae3-27b72a0d82bc-delete_snapshot" released by "delete_snapshot" :: held 2.151s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:32:06 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0359225b-4c79-4ba0-b44f-99b83f7b7419 tempest-ProjectReaderTests-34452203 None] Acquiring lock "cinder-fbc9557b-09bf-4948-b912-f9052086856b-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:32:06 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0359225b-4c79-4ba0-b44f-99b83f7b7419 tempest-ProjectReaderTests-34452203 None] Lock "cinder-fbc9557b-09bf-4948-b912-f9052086856b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:32:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0bc27eeb-eac5-4ead-b430-a6cbc338b5ed tempest-ProjectReaderTests-1586322695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:32:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0bc27eeb-eac5-4ead-b430-a6cbc338b5ed tempest-ProjectReaderTests-1586322695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:32:06 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0bc27eeb-eac5-4ead-b430-a6cbc338b5ed tempest-ProjectReaderTests-1586322695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:32:06 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0bc27eeb-eac5-4ead-b430-a6cbc338b5ed tempest-ProjectReaderTests-1586322695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:32:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0bc27eeb-eac5-4ead-b430-a6cbc338b5ed tempest-ProjectReaderTests-1586322695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:32:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0bc27eeb-eac5-4ead-b430-a6cbc338b5ed tempest-ProjectReaderTests-1586322695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:06 devstack sudo[108009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:32:06 devstack sudo[108009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:06 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0359225b-4c79-4ba0-b44f-99b83f7b7419 tempest-ProjectReaderTests-34452203 None] Acquiring lock "cinder-quobyte-fbc9557b-09bf-4948-b912-f9052086856b" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:32:06 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0359225b-4c79-4ba0-b44f-99b83f7b7419 tempest-ProjectReaderTests-34452203 None] Lock "cinder-quobyte-fbc9557b-09bf-4948-b912-f9052086856b" acquired by "delete_volume" :: waited 0.023s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:32:06 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ea7806-ff87-4846-83c4-17ed5cfaebb5]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:32:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0359225b-4c79-4ba0-b44f-99b83f7b7419 tempest-ProjectReaderTests-34452203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fbc9557b-09bf-4948-b912-f9052086856b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:06 devstack sudo[108011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fbc9557b-09bf-4948-b912-f9052086856b Nov 04 12:32:06 devstack sudo[108011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:06 devstack sudo[108009]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0bc27eeb-eac5-4ead-b430-a6cbc338b5ed tempest-ProjectReaderTests-1586322695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.320s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:06 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-0bc27eeb-eac5-4ead-b430-a6cbc338b5ed tempest-ProjectReaderTests-1586322695 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:32:06 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-0bc27eeb-eac5-4ead-b430-a6cbc338b5ed tempest-ProjectReaderTests-1586322695 None] Deleted volume successfully. Nov 04 12:32:06 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0bc27eeb-eac5-4ead-b430-a6cbc338b5ed tempest-ProjectReaderTests-1586322695 None] Lock "cinder-f05d5964-cea7-4b8d-9743-c331e498f38e-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:32:06 devstack sudo[108011]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:06 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-23ec5c87-e3da-4eda-9d86-bd2d39b1a5c9 tempest-ProjectReaderTests-1586322695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:32:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-23ec5c87-e3da-4eda-9d86-bd2d39b1a5c9 tempest-ProjectReaderTests-1586322695 None] Flow 'volume_create_manager' (6ceca3a0-8f7b-440d-8428-6a2f0cc7401b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:32:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-23ec5c87-e3da-4eda-9d86-bd2d39b1a5c9 tempest-ProjectReaderTests-1586322695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43de92a2-c176-4308-ab13-e7c748c8161f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:32:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0359225b-4c79-4ba0-b44f-99b83f7b7419 tempest-ProjectReaderTests-34452203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fbc9557b-09bf-4948-b912-f9052086856b" returned: 0 in 0.465s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0359225b-4c79-4ba0-b44f-99b83f7b7419 tempest-ProjectReaderTests-34452203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fbc9557b-09bf-4948-b912-f9052086856b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-23ec5c87-e3da-4eda-9d86-bd2d39b1a5c9 tempest-ProjectReaderTests-1586322695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43de92a2-c176-4308-ab13-e7c748c8161f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:32:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1756188292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d4243f8-c15b-4425-83c0-35a4dbcc86ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b26a53d6ce4742ff98b7139c848f0e96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:32:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:32:07Z,use_quota=True,user_id='64e417d69d7a4b66848830619c264278',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:32:06 devstack sudo[108017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fbc9557b-09bf-4948-b912-f9052086856b Nov 04 12:32:06 devstack sudo[108017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-23ec5c87-e3da-4eda-9d86-bd2d39b1a5c9 tempest-ProjectReaderTests-1586322695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b75759e-91a8-4636-9efc-33f9981b420b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:32:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-23ec5c87-e3da-4eda-9d86-bd2d39b1a5c9 tempest-ProjectReaderTests-1586322695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b75759e-91a8-4636-9efc-33f9981b420b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:32:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-23ec5c87-e3da-4eda-9d86-bd2d39b1a5c9 tempest-ProjectReaderTests-1586322695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b733068-dd25-49ed-8875-c461cf92c5a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:32:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-23ec5c87-e3da-4eda-9d86-bd2d39b1a5c9 tempest-ProjectReaderTests-1586322695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b733068-dd25-49ed-8875-c461cf92c5a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d4243f8-c15b-4425-83c0-35a4dbcc86ec', 'volume_name': 'volume-1d4243f8-c15b-4425-83c0-35a4dbcc86ec', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:32:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-23ec5c87-e3da-4eda-9d86-bd2d39b1a5c9 tempest-ProjectReaderTests-1586322695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f46d2edb-50e6-473d-8aa0-0a8cc97ee1a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:32:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-23ec5c87-e3da-4eda-9d86-bd2d39b1a5c9 tempest-ProjectReaderTests-1586322695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f46d2edb-50e6-473d-8aa0-0a8cc97ee1a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:32:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-23ec5c87-e3da-4eda-9d86-bd2d39b1a5c9 tempest-ProjectReaderTests-1586322695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df2af0cb-5233-4f7d-a8d9-e3403be161c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:32:06 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-23ec5c87-e3da-4eda-9d86-bd2d39b1a5c9 tempest-ProjectReaderTests-1586322695 None] Volume 1d4243f8-c15b-4425-83c0-35a4dbcc86ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d4243f8-c15b-4425-83c0-35a4dbcc86ec', 'volume_size': 1} Nov 04 12:32:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-23ec5c87-e3da-4eda-9d86-bd2d39b1a5c9 tempest-ProjectReaderTests-1586322695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:32:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-23ec5c87-e3da-4eda-9d86-bd2d39b1a5c9 tempest-ProjectReaderTests-1586322695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:32:06 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-23ec5c87-e3da-4eda-9d86-bd2d39b1a5c9 tempest-ProjectReaderTests-1586322695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:32:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1756188292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d4243f8-c15b-4425-83c0-35a4dbcc86ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b26a53d6ce4742ff98b7139c848f0e96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:32:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:32:07Z,use_quota=True,user_id='64e417d69d7a4b66848830619c264278',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:32:06 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-23ec5c87-e3da-4eda-9d86-bd2d39b1a5c9 tempest-ProjectReaderTests-1586322695 None] Creating volume 1d4243f8-c15b-4425-83c0-35a4dbcc86ec {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:32:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-23ec5c87-e3da-4eda-9d86-bd2d39b1a5c9 tempest-ProjectReaderTests-1586322695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:32:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-23ec5c87-e3da-4eda-9d86-bd2d39b1a5c9 tempest-ProjectReaderTests-1586322695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:32:06 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-23ec5c87-e3da-4eda-9d86-bd2d39b1a5c9 tempest-ProjectReaderTests-1586322695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:32:06 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-23ec5c87-e3da-4eda-9d86-bd2d39b1a5c9 tempest-ProjectReaderTests-1586322695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:32:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-23ec5c87-e3da-4eda-9d86-bd2d39b1a5c9 tempest-ProjectReaderTests-1586322695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:32:06 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-23ec5c87-e3da-4eda-9d86-bd2d39b1a5c9 tempest-ProjectReaderTests-1586322695 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:32:06 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-23ec5c87-e3da-4eda-9d86-bd2d39b1a5c9 tempest-ProjectReaderTests-1586322695 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:32:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-23ec5c87-e3da-4eda-9d86-bd2d39b1a5c9 tempest-ProjectReaderTests-1586322695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1d4243f8-c15b-4425-83c0-35a4dbcc86ec 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:06 devstack sudo[108019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1d4243f8-c15b-4425-83c0-35a4dbcc86ec 1073741824 Nov 04 12:32:06 devstack sudo[108019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:07 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4df4cad-8fcb-40ef-83c9-9246f600c244 tempest-ProjectMemberTests-1539753999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:32:07 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e4df4cad-8fcb-40ef-83c9-9246f600c244 tempest-ProjectMemberTests-1539753999 None] Flow 'volume_create_manager' (8195196c-d2ce-4151-9eb4-56a9f5fa6401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:32:07 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e4df4cad-8fcb-40ef-83c9-9246f600c244 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0a12cf8-d664-43c8-aeb8-0a7138eca1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:32:07 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e4df4cad-8fcb-40ef-83c9-9246f600c244 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0a12cf8-d664-43c8-aeb8-0a7138eca1ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:32:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-274626886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee097de0-903f-4aa9-9be3-67a21090cce3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cb67397f4d04f049564f5d284f139d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:32:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:32:07Z,use_quota=True,user_id='091b86592c99419b9c07a685e7933341',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:32:07 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e4df4cad-8fcb-40ef-83c9-9246f600c244 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (102ceedf-b54c-4dc3-aa3e-930e80a86b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:32:07 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e4df4cad-8fcb-40ef-83c9-9246f600c244 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (102ceedf-b54c-4dc3-aa3e-930e80a86b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:32:07 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e4df4cad-8fcb-40ef-83c9-9246f600c244 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (650cc40a-aed9-4d77-a8fc-548258d6d1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:32:07 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e4df4cad-8fcb-40ef-83c9-9246f600c244 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (650cc40a-aed9-4d77-a8fc-548258d6d1ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee097de0-903f-4aa9-9be3-67a21090cce3', 'volume_name': 'volume-ee097de0-903f-4aa9-9be3-67a21090cce3', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:32:07 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e4df4cad-8fcb-40ef-83c9-9246f600c244 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24d2ccd7-a78d-409c-9db3-5f78a0440601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:32:07 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e4df4cad-8fcb-40ef-83c9-9246f600c244 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24d2ccd7-a78d-409c-9db3-5f78a0440601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:32:07 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e4df4cad-8fcb-40ef-83c9-9246f600c244 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80ac0560-c7d7-4992-89c2-9ea5b0b2de62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:32:07 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-e4df4cad-8fcb-40ef-83c9-9246f600c244 tempest-ProjectMemberTests-1539753999 None] Volume ee097de0-903f-4aa9-9be3-67a21090cce3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee097de0-903f-4aa9-9be3-67a21090cce3', 'volume_size': 1} Nov 04 12:32:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e4df4cad-8fcb-40ef-83c9-9246f600c244 tempest-ProjectMemberTests-1539753999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:32:07 devstack sudo[108017]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0359225b-4c79-4ba0-b44f-99b83f7b7419 tempest-ProjectReaderTests-34452203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-fbc9557b-09bf-4948-b912-f9052086856b" returned: 0 in 0.284s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:07 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0359225b-4c79-4ba0-b44f-99b83f7b7419 tempest-ProjectReaderTests-34452203 None] Lock "cinder-quobyte-fbc9557b-09bf-4948-b912-f9052086856b" released by "delete_volume" :: held 0.829s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:32:07 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-0359225b-4c79-4ba0-b44f-99b83f7b7419 tempest-ProjectReaderTests-34452203 None] Created reservations ['0e847ba4-a5a8-4b22-91a0-8be5c352a372', '58f89519-ecd3-4f40-b4fd-a2bb716e2561', '89596562-56fb-4fd8-9421-d10b5c123223', 'a4ef5f1b-1e7c-4e66-84b8-df3d566c27cf'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:32:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0359225b-4c79-4ba0-b44f-99b83f7b7419 tempest-ProjectReaderTests-34452203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:32:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0359225b-4c79-4ba0-b44f-99b83f7b7419 tempest-ProjectReaderTests-34452203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:32:07 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0359225b-4c79-4ba0-b44f-99b83f7b7419 tempest-ProjectReaderTests-34452203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:32:07 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0359225b-4c79-4ba0-b44f-99b83f7b7419 tempest-ProjectReaderTests-34452203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:32:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0359225b-4c79-4ba0-b44f-99b83f7b7419 tempest-ProjectReaderTests-34452203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:32:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0359225b-4c79-4ba0-b44f-99b83f7b7419 tempest-ProjectReaderTests-34452203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:07 devstack sudo[108026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:32:07 devstack sudo[108026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:07 devstack sudo[108019]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-23ec5c87-e3da-4eda-9d86-bd2d39b1a5c9 tempest-ProjectReaderTests-1586322695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1d4243f8-c15b-4425-83c0-35a4dbcc86ec 1073741824" returned: 0 in 0.489s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-23ec5c87-e3da-4eda-9d86-bd2d39b1a5c9 tempest-ProjectReaderTests-1586322695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1d4243f8-c15b-4425-83c0-35a4dbcc86ec {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:07 devstack sudo[108028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1d4243f8-c15b-4425-83c0-35a4dbcc86ec Nov 04 12:32:07 devstack sudo[108028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:07 devstack sudo[108026]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0359225b-4c79-4ba0-b44f-99b83f7b7419 tempest-ProjectReaderTests-34452203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.264s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:07 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-0359225b-4c79-4ba0-b44f-99b83f7b7419 tempest-ProjectReaderTests-34452203 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:32:07 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-0359225b-4c79-4ba0-b44f-99b83f7b7419 tempest-ProjectReaderTests-34452203 None] Deleted volume successfully. Nov 04 12:32:07 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0359225b-4c79-4ba0-b44f-99b83f7b7419 tempest-ProjectReaderTests-34452203 None] Lock "cinder-fbc9557b-09bf-4948-b912-f9052086856b-delete_volume" released by "delete_volume" :: held 1.446s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:32:07 devstack sudo[108028]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-23ec5c87-e3da-4eda-9d86-bd2d39b1a5c9 tempest-ProjectReaderTests-1586322695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1d4243f8-c15b-4425-83c0-35a4dbcc86ec" returned: 0 in 0.321s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:07 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-23ec5c87-e3da-4eda-9d86-bd2d39b1a5c9 tempest-ProjectReaderTests-1586322695 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:32:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-23ec5c87-e3da-4eda-9d86-bd2d39b1a5c9 tempest-ProjectReaderTests-1586322695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:32:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e4df4cad-8fcb-40ef-83c9-9246f600c244 tempest-ProjectMemberTests-1539753999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.696s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:32:07 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e4df4cad-8fcb-40ef-83c9-9246f600c244 tempest-ProjectMemberTests-1539753999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:32:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-274626886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee097de0-903f-4aa9-9be3-67a21090cce3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cb67397f4d04f049564f5d284f139d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:32:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:32:07Z,use_quota=True,user_id='091b86592c99419b9c07a685e7933341',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:32:07 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-e4df4cad-8fcb-40ef-83c9-9246f600c244 tempest-ProjectMemberTests-1539753999 None] Creating volume ee097de0-903f-4aa9-9be3-67a21090cce3 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:32:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e4df4cad-8fcb-40ef-83c9-9246f600c244 tempest-ProjectMemberTests-1539753999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:32:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e4df4cad-8fcb-40ef-83c9-9246f600c244 tempest-ProjectMemberTests-1539753999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:32:07 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e4df4cad-8fcb-40ef-83c9-9246f600c244 tempest-ProjectMemberTests-1539753999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:32:07 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e4df4cad-8fcb-40ef-83c9-9246f600c244 tempest-ProjectMemberTests-1539753999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:32:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e4df4cad-8fcb-40ef-83c9-9246f600c244 tempest-ProjectMemberTests-1539753999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:32:07 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e4df4cad-8fcb-40ef-83c9-9246f600c244 tempest-ProjectMemberTests-1539753999 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:32:07 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-e4df4cad-8fcb-40ef-83c9-9246f600c244 tempest-ProjectMemberTests-1539753999 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:32:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e4df4cad-8fcb-40ef-83c9-9246f600c244 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee097de0-903f-4aa9-9be3-67a21090cce3 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:07 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-23ec5c87-e3da-4eda-9d86-bd2d39b1a5c9 tempest-ProjectReaderTests-1586322695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df2af0cb-5233-4f7d-a8d9-e3403be161c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d4243f8-c15b-4425-83c0-35a4dbcc86ec', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:32:07 devstack sudo[108032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee097de0-903f-4aa9-9be3-67a21090cce3 1073741824 Nov 04 12:32:07 devstack sudo[108032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:07 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-23ec5c87-e3da-4eda-9d86-bd2d39b1a5c9 tempest-ProjectReaderTests-1586322695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8ecf662-de62-49d1-a182-819e7d44d56f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:32:07 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-23ec5c87-e3da-4eda-9d86-bd2d39b1a5c9 tempest-ProjectReaderTests-1586322695 None] Volume volume-1d4243f8-c15b-4425-83c0-35a4dbcc86ec (1d4243f8-c15b-4425-83c0-35a4dbcc86ec): created successfully Nov 04 12:32:07 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-23ec5c87-e3da-4eda-9d86-bd2d39b1a5c9 tempest-ProjectReaderTests-1586322695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8ecf662-de62-49d1-a182-819e7d44d56f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:32:07 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-23ec5c87-e3da-4eda-9d86-bd2d39b1a5c9 tempest-ProjectReaderTests-1586322695 None] Flow 'volume_create_manager' (6ceca3a0-8f7b-440d-8428-6a2f0cc7401b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:32:07 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-23ec5c87-e3da-4eda-9d86-bd2d39b1a5c9 tempest-ProjectReaderTests-1586322695 None] Created volume successfully. Nov 04 12:32:07 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-ead639a5-55e2-4b3d-bfae-8f4b6d6a6bb6 tempest-ProjectReaderTests-34452203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:32:07 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ead639a5-55e2-4b3d-bfae-8f4b6d6a6bb6 tempest-ProjectReaderTests-34452203 None] Flow 'volume_create_manager' (bcc49253-0f2d-44c3-992e-d0ded2acd0e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:32:07 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ead639a5-55e2-4b3d-bfae-8f4b6d6a6bb6 tempest-ProjectReaderTests-34452203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9c8859c-aff2-4121-9e63-2c34cf195df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:32:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ead639a5-55e2-4b3d-bfae-8f4b6d6a6bb6 tempest-ProjectReaderTests-34452203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9c8859c-aff2-4121-9e63-2c34cf195df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:32:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-617017348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba94cef0-d1a0-4d2c-89a7-9776e16aea72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb954983f7c64fe388fdbeaf1cdc0a5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:32:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:32:08Z,use_quota=True,user_id='f3d9809a097943a5b1cd27d05f8ff1ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:32:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ead639a5-55e2-4b3d-bfae-8f4b6d6a6bb6 tempest-ProjectReaderTests-34452203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (625a6659-bd96-4dfe-a5f2-02734bb0366b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:32:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ead639a5-55e2-4b3d-bfae-8f4b6d6a6bb6 tempest-ProjectReaderTests-34452203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (625a6659-bd96-4dfe-a5f2-02734bb0366b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:32:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ead639a5-55e2-4b3d-bfae-8f4b6d6a6bb6 tempest-ProjectReaderTests-34452203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1ccefb7-1cb1-4eba-8c67-e40ac675a71b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:32:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ead639a5-55e2-4b3d-bfae-8f4b6d6a6bb6 tempest-ProjectReaderTests-34452203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1ccefb7-1cb1-4eba-8c67-e40ac675a71b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba94cef0-d1a0-4d2c-89a7-9776e16aea72', 'volume_name': 'volume-ba94cef0-d1a0-4d2c-89a7-9776e16aea72', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:32:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ead639a5-55e2-4b3d-bfae-8f4b6d6a6bb6 tempest-ProjectReaderTests-34452203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (036bb923-0d5e-4ff4-8508-ad2a3d2fc4ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:32:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ead639a5-55e2-4b3d-bfae-8f4b6d6a6bb6 tempest-ProjectReaderTests-34452203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (036bb923-0d5e-4ff4-8508-ad2a3d2fc4ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:32:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ead639a5-55e2-4b3d-bfae-8f4b6d6a6bb6 tempest-ProjectReaderTests-34452203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f47f52af-8117-4008-a90b-4078d49360ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:32:08 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-ead639a5-55e2-4b3d-bfae-8f4b6d6a6bb6 tempest-ProjectReaderTests-34452203 None] Volume ba94cef0-d1a0-4d2c-89a7-9776e16aea72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba94cef0-d1a0-4d2c-89a7-9776e16aea72', 'volume_size': 1} Nov 04 12:32:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ead639a5-55e2-4b3d-bfae-8f4b6d6a6bb6 tempest-ProjectReaderTests-34452203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:32:08 devstack sudo[108032]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e4df4cad-8fcb-40ef-83c9-9246f600c244 tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee097de0-903f-4aa9-9be3-67a21090cce3 1073741824" returned: 0 in 0.470s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e4df4cad-8fcb-40ef-83c9-9246f600c244 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee097de0-903f-4aa9-9be3-67a21090cce3 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:08 devstack sudo[108037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee097de0-903f-4aa9-9be3-67a21090cce3 Nov 04 12:32:08 devstack sudo[108037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:08 devstack sudo[108037]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e4df4cad-8fcb-40ef-83c9-9246f600c244 tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee097de0-903f-4aa9-9be3-67a21090cce3" returned: 0 in 0.247s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:08 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e4df4cad-8fcb-40ef-83c9-9246f600c244 tempest-ProjectMemberTests-1539753999 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:32:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e4df4cad-8fcb-40ef-83c9-9246f600c244 tempest-ProjectMemberTests-1539753999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:32:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ead639a5-55e2-4b3d-bfae-8f4b6d6a6bb6 tempest-ProjectReaderTests-34452203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.518s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:32:08 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ead639a5-55e2-4b3d-bfae-8f4b6d6a6bb6 tempest-ProjectReaderTests-34452203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:32:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-617017348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba94cef0-d1a0-4d2c-89a7-9776e16aea72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb954983f7c64fe388fdbeaf1cdc0a5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:32:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:32:08Z,use_quota=True,user_id='f3d9809a097943a5b1cd27d05f8ff1ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:32:08 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-ead639a5-55e2-4b3d-bfae-8f4b6d6a6bb6 tempest-ProjectReaderTests-34452203 None] Creating volume ba94cef0-d1a0-4d2c-89a7-9776e16aea72 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:32:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ead639a5-55e2-4b3d-bfae-8f4b6d6a6bb6 tempest-ProjectReaderTests-34452203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:32:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ead639a5-55e2-4b3d-bfae-8f4b6d6a6bb6 tempest-ProjectReaderTests-34452203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:32:08 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ead639a5-55e2-4b3d-bfae-8f4b6d6a6bb6 tempest-ProjectReaderTests-34452203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:32:08 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ead639a5-55e2-4b3d-bfae-8f4b6d6a6bb6 tempest-ProjectReaderTests-34452203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:32:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ead639a5-55e2-4b3d-bfae-8f4b6d6a6bb6 tempest-ProjectReaderTests-34452203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:32:08 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ead639a5-55e2-4b3d-bfae-8f4b6d6a6bb6 tempest-ProjectReaderTests-34452203 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:32:08 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-ead639a5-55e2-4b3d-bfae-8f4b6d6a6bb6 tempest-ProjectReaderTests-34452203 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:32:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ead639a5-55e2-4b3d-bfae-8f4b6d6a6bb6 tempest-ProjectReaderTests-34452203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ba94cef0-d1a0-4d2c-89a7-9776e16aea72 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:08 devstack sudo[108040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ba94cef0-d1a0-4d2c-89a7-9776e16aea72 1073741824 Nov 04 12:32:08 devstack sudo[108040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e4df4cad-8fcb-40ef-83c9-9246f600c244 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80ac0560-c7d7-4992-89c2-9ea5b0b2de62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee097de0-903f-4aa9-9be3-67a21090cce3', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:32:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e4df4cad-8fcb-40ef-83c9-9246f600c244 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c44fbf78-8e7c-4c12-838f-9ce355e68390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:32:08 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-e4df4cad-8fcb-40ef-83c9-9246f600c244 tempest-ProjectMemberTests-1539753999 None] Volume volume-ee097de0-903f-4aa9-9be3-67a21090cce3 (ee097de0-903f-4aa9-9be3-67a21090cce3): created successfully Nov 04 12:32:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e4df4cad-8fcb-40ef-83c9-9246f600c244 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c44fbf78-8e7c-4c12-838f-9ce355e68390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:32:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e4df4cad-8fcb-40ef-83c9-9246f600c244 tempest-ProjectMemberTests-1539753999 None] Flow 'volume_create_manager' (8195196c-d2ce-4151-9eb4-56a9f5fa6401) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:32:08 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-e4df4cad-8fcb-40ef-83c9-9246f600c244 tempest-ProjectMemberTests-1539753999 None] Created volume successfully. Nov 04 12:32:08 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-cb74ba12-6315-4121-98ab-0639d4ead1df tempest-ProjectReaderTests-1586322695 None] Acquiring lock "cinder-1d4243f8-c15b-4425-83c0-35a4dbcc86ec-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:32:09 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-cb74ba12-6315-4121-98ab-0639d4ead1df tempest-ProjectReaderTests-1586322695 None] Lock "cinder-1d4243f8-c15b-4425-83c0-35a4dbcc86ec-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:32:09 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-cb74ba12-6315-4121-98ab-0639d4ead1df tempest-ProjectReaderTests-1586322695 None] Acquiring lock "cinder-quobyte-1d4243f8-c15b-4425-83c0-35a4dbcc86ec" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:32:09 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-cb74ba12-6315-4121-98ab-0639d4ead1df tempest-ProjectReaderTests-1586322695 None] Lock "cinder-quobyte-1d4243f8-c15b-4425-83c0-35a4dbcc86ec" acquired by "delete_volume" :: waited 0.017s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:32:09 devstack sudo[108040]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ead639a5-55e2-4b3d-bfae-8f4b6d6a6bb6 tempest-ProjectReaderTests-34452203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ba94cef0-d1a0-4d2c-89a7-9776e16aea72 1073741824" returned: 0 in 0.500s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:09 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d85393-0a77-44c1-9deb-f4bd91f4439f]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:32:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cb74ba12-6315-4121-98ab-0639d4ead1df tempest-ProjectReaderTests-1586322695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1d4243f8-c15b-4425-83c0-35a4dbcc86ec {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ead639a5-55e2-4b3d-bfae-8f4b6d6a6bb6 tempest-ProjectReaderTests-34452203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ba94cef0-d1a0-4d2c-89a7-9776e16aea72 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:09 devstack sudo[108047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ba94cef0-d1a0-4d2c-89a7-9776e16aea72 Nov 04 12:32:09 devstack sudo[108047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:09 devstack sudo[108046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1d4243f8-c15b-4425-83c0-35a4dbcc86ec Nov 04 12:32:09 devstack sudo[108046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-96e6d322-15d7-4b8e-83df-7570b41ae4ae tempest-ProjectMemberTests-1539753999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:32:09 devstack sudo[108047]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ead639a5-55e2-4b3d-bfae-8f4b6d6a6bb6 tempest-ProjectReaderTests-34452203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ba94cef0-d1a0-4d2c-89a7-9776e16aea72" returned: 0 in 0.291s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:09 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ead639a5-55e2-4b3d-bfae-8f4b6d6a6bb6 tempest-ProjectReaderTests-34452203 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:32:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ead639a5-55e2-4b3d-bfae-8f4b6d6a6bb6 tempest-ProjectReaderTests-34452203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:32:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-96e6d322-15d7-4b8e-83df-7570b41ae4ae tempest-ProjectMemberTests-1539753999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.118s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:32:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ead639a5-55e2-4b3d-bfae-8f4b6d6a6bb6 tempest-ProjectReaderTests-34452203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f47f52af-8117-4008-a90b-4078d49360ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba94cef0-d1a0-4d2c-89a7-9776e16aea72', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:32:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ead639a5-55e2-4b3d-bfae-8f4b6d6a6bb6 tempest-ProjectReaderTests-34452203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93ccf7d6-41ae-4890-b88e-72bb804c138d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:32:09 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-96e6d322-15d7-4b8e-83df-7570b41ae4ae tempest-ProjectMemberTests-1539753999 None] Creating offline snapshot 09da182a-9d65-41e9-a644-0a830a54a900 of volume ee097de0-903f-4aa9-9be3-67a21090cce3 {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 12:32:09 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-ead639a5-55e2-4b3d-bfae-8f4b6d6a6bb6 tempest-ProjectReaderTests-34452203 None] Volume volume-ba94cef0-d1a0-4d2c-89a7-9776e16aea72 (ba94cef0-d1a0-4d2c-89a7-9776e16aea72): created successfully Nov 04 12:32:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ead639a5-55e2-4b3d-bfae-8f4b6d6a6bb6 tempest-ProjectReaderTests-34452203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93ccf7d6-41ae-4890-b88e-72bb804c138d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:32:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ead639a5-55e2-4b3d-bfae-8f4b6d6a6bb6 tempest-ProjectReaderTests-34452203 None] Flow 'volume_create_manager' (bcc49253-0f2d-44c3-992e-d0ded2acd0e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:32:09 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc40d01-c51e-4db0-ba2f-84210c879413]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:32:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-96e6d322-15d7-4b8e-83df-7570b41ae4ae tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee097de0-903f-4aa9-9be3-67a21090cce3 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:09 devstack sudo[108046]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cb74ba12-6315-4121-98ab-0639d4ead1df tempest-ProjectReaderTests-1586322695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1d4243f8-c15b-4425-83c0-35a4dbcc86ec" returned: 0 in 0.417s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:09 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-ead639a5-55e2-4b3d-bfae-8f4b6d6a6bb6 tempest-ProjectReaderTests-34452203 None] Created volume successfully. Nov 04 12:32:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cb74ba12-6315-4121-98ab-0639d4ead1df tempest-ProjectReaderTests-1586322695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1d4243f8-c15b-4425-83c0-35a4dbcc86ec {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:09 devstack sudo[108055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1d4243f8-c15b-4425-83c0-35a4dbcc86ec Nov 04 12:32:09 devstack sudo[108055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:09 devstack sudo[108054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee097de0-903f-4aa9-9be3-67a21090cce3 Nov 04 12:32:09 devstack sudo[108054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:09 devstack sudo[108055]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cb74ba12-6315-4121-98ab-0639d4ead1df tempest-ProjectReaderTests-1586322695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-1d4243f8-c15b-4425-83c0-35a4dbcc86ec" returned: 0 in 0.255s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:09 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-cb74ba12-6315-4121-98ab-0639d4ead1df tempest-ProjectReaderTests-1586322695 None] Lock "cinder-quobyte-1d4243f8-c15b-4425-83c0-35a4dbcc86ec" released by "delete_volume" :: held 0.722s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:32:09 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-cb74ba12-6315-4121-98ab-0639d4ead1df tempest-ProjectReaderTests-1586322695 None] Created reservations ['89e008a8-a4a2-43d2-a3d6-bfc483672229', 'ffeb74e4-459a-4b30-945f-0bfbfa93703b', '619dbdfe-31f7-4187-a387-0f8dff40342a', 'e767f4f3-8621-486c-83f7-3f889679917d'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:32:09 devstack sudo[108054]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-96e6d322-15d7-4b8e-83df-7570b41ae4ae tempest-ProjectMemberTests-1539753999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee097de0-903f-4aa9-9be3-67a21090cce3" returned: 0 in 0.396s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-96e6d322-15d7-4b8e-83df-7570b41ae4ae tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee097de0-903f-4aa9-9be3-67a21090cce3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee097de0-903f-4aa9-9be3-67a21090cce3.09da182a-9d65-41e9-a644-0a830a54a900 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:09 devstack sudo[108062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee097de0-903f-4aa9-9be3-67a21090cce3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee097de0-903f-4aa9-9be3-67a21090cce3.09da182a-9d65-41e9-a644-0a830a54a900 1G Nov 04 12:32:09 devstack sudo[108062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cb74ba12-6315-4121-98ab-0639d4ead1df tempest-ProjectReaderTests-1586322695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:32:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cb74ba12-6315-4121-98ab-0639d4ead1df tempest-ProjectReaderTests-1586322695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:32:09 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-cb74ba12-6315-4121-98ab-0639d4ead1df tempest-ProjectReaderTests-1586322695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:32:09 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-cb74ba12-6315-4121-98ab-0639d4ead1df tempest-ProjectReaderTests-1586322695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:32:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cb74ba12-6315-4121-98ab-0639d4ead1df tempest-ProjectReaderTests-1586322695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:32:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cb74ba12-6315-4121-98ab-0639d4ead1df tempest-ProjectReaderTests-1586322695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:09 devstack sudo[108064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:32:09 devstack sudo[108064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b2770a6d-19d8-4b58-bdc0-c946dff401e6 tempest-ProjectReaderTests-34452203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:32:10 devstack sudo[108064]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cb74ba12-6315-4121-98ab-0639d4ead1df tempest-ProjectReaderTests-1586322695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.310s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:10 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-cb74ba12-6315-4121-98ab-0639d4ead1df tempest-ProjectReaderTests-1586322695 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:32:10 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-cb74ba12-6315-4121-98ab-0639d4ead1df tempest-ProjectReaderTests-1586322695 None] Deleted volume successfully. Nov 04 12:32:10 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-cb74ba12-6315-4121-98ab-0639d4ead1df tempest-ProjectReaderTests-1586322695 None] Lock "cinder-1d4243f8-c15b-4425-83c0-35a4dbcc86ec-delete_volume" released by "delete_volume" :: held 1.275s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:32:10 devstack sudo[108062]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-96e6d322-15d7-4b8e-83df-7570b41ae4ae tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee097de0-903f-4aa9-9be3-67a21090cce3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee097de0-903f-4aa9-9be3-67a21090cce3.09da182a-9d65-41e9-a644-0a830a54a900 1G" returned: 0 in 0.535s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-96e6d322-15d7-4b8e-83df-7570b41ae4ae tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee097de0-903f-4aa9-9be3-67a21090cce3 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee097de0-903f-4aa9-9be3-67a21090cce3.09da182a-9d65-41e9-a644-0a830a54a900 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:10 devstack sudo[108071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee097de0-903f-4aa9-9be3-67a21090cce3 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee097de0-903f-4aa9-9be3-67a21090cce3.09da182a-9d65-41e9-a644-0a830a54a900 Nov 04 12:32:10 devstack sudo[108071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:10 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6707f45-04c7-4228-98ef-77bceef70709 tempest-ProjectReaderTests-1586322695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:32:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e6707f45-04c7-4228-98ef-77bceef70709 tempest-ProjectReaderTests-1586322695 None] Flow 'volume_create_manager' (2d0bda65-cc71-48a2-93cf-77005afdf32c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:32:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e6707f45-04c7-4228-98ef-77bceef70709 tempest-ProjectReaderTests-1586322695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72c0f32e-319a-4b84-80d5-22cb07eaaad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:32:10 devstack sudo[108071]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-96e6d322-15d7-4b8e-83df-7570b41ae4ae tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee097de0-903f-4aa9-9be3-67a21090cce3 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee097de0-903f-4aa9-9be3-67a21090cce3.09da182a-9d65-41e9-a644-0a830a54a900" returned: 0 in 0.314s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:10 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-96e6d322-15d7-4b8e-83df-7570b41ae4ae tempest-ProjectMemberTests-1539753999 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee097de0-903f-4aa9-9be3-67a21090cce3.09da182a-9d65-41e9-a644-0a830a54a900 is being set with open permissions: ugo+rw Nov 04 12:32:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-96e6d322-15d7-4b8e-83df-7570b41ae4ae tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee097de0-903f-4aa9-9be3-67a21090cce3.09da182a-9d65-41e9-a644-0a830a54a900 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:10 devstack sudo[108076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee097de0-903f-4aa9-9be3-67a21090cce3.09da182a-9d65-41e9-a644-0a830a54a900 Nov 04 12:32:10 devstack sudo[108076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e6707f45-04c7-4228-98ef-77bceef70709 tempest-ProjectReaderTests-1586322695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72c0f32e-319a-4b84-80d5-22cb07eaaad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:32:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1496511113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8679b9b1-dd5e-4028-9c85-b86320fb7aaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b26a53d6ce4742ff98b7139c848f0e96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:32:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:32:11Z,use_quota=True,user_id='64e417d69d7a4b66848830619c264278',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:32:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e6707f45-04c7-4228-98ef-77bceef70709 tempest-ProjectReaderTests-1586322695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d4807fc-384f-4fd2-aa5e-eca81322d0a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:32:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e6707f45-04c7-4228-98ef-77bceef70709 tempest-ProjectReaderTests-1586322695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d4807fc-384f-4fd2-aa5e-eca81322d0a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:32:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e6707f45-04c7-4228-98ef-77bceef70709 tempest-ProjectReaderTests-1586322695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb1b398b-4276-4c6f-a409-40ebc325ab11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:32:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e6707f45-04c7-4228-98ef-77bceef70709 tempest-ProjectReaderTests-1586322695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb1b398b-4276-4c6f-a409-40ebc325ab11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8679b9b1-dd5e-4028-9c85-b86320fb7aaf', 'volume_name': 'volume-8679b9b1-dd5e-4028-9c85-b86320fb7aaf', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:32:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e6707f45-04c7-4228-98ef-77bceef70709 tempest-ProjectReaderTests-1586322695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47e1f6bc-837c-4870-80b8-64fcceb264c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:32:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e6707f45-04c7-4228-98ef-77bceef70709 tempest-ProjectReaderTests-1586322695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47e1f6bc-837c-4870-80b8-64fcceb264c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:32:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e6707f45-04c7-4228-98ef-77bceef70709 tempest-ProjectReaderTests-1586322695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f187d30-7009-450e-b000-e74350fdc3d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:32:10 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-e6707f45-04c7-4228-98ef-77bceef70709 tempest-ProjectReaderTests-1586322695 None] Volume 8679b9b1-dd5e-4028-9c85-b86320fb7aaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8679b9b1-dd5e-4028-9c85-b86320fb7aaf', 'volume_size': 1} Nov 04 12:32:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e6707f45-04c7-4228-98ef-77bceef70709 tempest-ProjectReaderTests-1586322695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:32:10 devstack sudo[108076]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-96e6d322-15d7-4b8e-83df-7570b41ae4ae tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee097de0-903f-4aa9-9be3-67a21090cce3.09da182a-9d65-41e9-a644-0a830a54a900" returned: 0 in 0.238s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-96e6d322-15d7-4b8e-83df-7570b41ae4ae tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee097de0-903f-4aa9-9be3-67a21090cce3.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:11 devstack sudo[108079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee097de0-903f-4aa9-9be3-67a21090cce3.info Nov 04 12:32:11 devstack sudo[108079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:11 devstack sudo[108079]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-96e6d322-15d7-4b8e-83df-7570b41ae4ae tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee097de0-903f-4aa9-9be3-67a21090cce3.info" returned: 0 in 0.259s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:11 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-96e6d322-15d7-4b8e-83df-7570b41ae4ae tempest-ProjectMemberTests-1539753999 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee097de0-903f-4aa9-9be3-67a21090cce3.info is being set with open permissions: ugo+rw Nov 04 12:32:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-96e6d322-15d7-4b8e-83df-7570b41ae4ae tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee097de0-903f-4aa9-9be3-67a21090cce3.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:11 devstack sudo[108082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee097de0-903f-4aa9-9be3-67a21090cce3.info Nov 04 12:32:11 devstack sudo[108082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:11 devstack sudo[108082]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-96e6d322-15d7-4b8e-83df-7570b41ae4ae tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee097de0-903f-4aa9-9be3-67a21090cce3.info" returned: 0 in 0.237s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-96e6d322-15d7-4b8e-83df-7570b41ae4ae tempest-ProjectMemberTests-1539753999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.083s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:32:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b2770a6d-19d8-4b58-bdc0-c946dff401e6 tempest-ProjectReaderTests-34452203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.278s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:32:11 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-b2770a6d-19d8-4b58-bdc0-c946dff401e6 tempest-ProjectReaderTests-34452203 None] Creating offline snapshot 478d87e9-9df2-49d5-91f3-ac7fbd3cbcd0 of volume ba94cef0-d1a0-4d2c-89a7-9776e16aea72 {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 12:32:11 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-96e6d322-15d7-4b8e-83df-7570b41ae4ae tempest-ProjectMemberTests-1539753999 None] Create snapshot completed successfully Nov 04 12:32:11 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[83469488-428d-466c-b8d7-b2ff519213dc]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:32:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b2770a6d-19d8-4b58-bdc0-c946dff401e6 tempest-ProjectReaderTests-34452203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ba94cef0-d1a0-4d2c-89a7-9776e16aea72 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:11 devstack sudo[108085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ba94cef0-d1a0-4d2c-89a7-9776e16aea72 Nov 04 12:32:11 devstack sudo[108085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:11 devstack sudo[108085]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b2770a6d-19d8-4b58-bdc0-c946dff401e6 tempest-ProjectReaderTests-34452203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ba94cef0-d1a0-4d2c-89a7-9776e16aea72" returned: 0 in 0.362s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b2770a6d-19d8-4b58-bdc0-c946dff401e6 tempest-ProjectReaderTests-34452203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ba94cef0-d1a0-4d2c-89a7-9776e16aea72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ba94cef0-d1a0-4d2c-89a7-9776e16aea72.478d87e9-9df2-49d5-91f3-ac7fbd3cbcd0 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:11 devstack sudo[108090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ba94cef0-d1a0-4d2c-89a7-9776e16aea72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ba94cef0-d1a0-4d2c-89a7-9776e16aea72.478d87e9-9df2-49d5-91f3-ac7fbd3cbcd0 1G Nov 04 12:32:11 devstack sudo[108090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:12 devstack sudo[108090]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b2770a6d-19d8-4b58-bdc0-c946dff401e6 tempest-ProjectReaderTests-34452203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ba94cef0-d1a0-4d2c-89a7-9776e16aea72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ba94cef0-d1a0-4d2c-89a7-9776e16aea72.478d87e9-9df2-49d5-91f3-ac7fbd3cbcd0 1G" returned: 0 in 0.374s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b2770a6d-19d8-4b58-bdc0-c946dff401e6 tempest-ProjectReaderTests-34452203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba94cef0-d1a0-4d2c-89a7-9776e16aea72 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ba94cef0-d1a0-4d2c-89a7-9776e16aea72.478d87e9-9df2-49d5-91f3-ac7fbd3cbcd0 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:12 devstack sudo[108095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba94cef0-d1a0-4d2c-89a7-9776e16aea72 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ba94cef0-d1a0-4d2c-89a7-9776e16aea72.478d87e9-9df2-49d5-91f3-ac7fbd3cbcd0 Nov 04 12:32:12 devstack sudo[108095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:12 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6345fa9c-65c8-4adc-8840-553dbb03cbab tempest-ProjectMemberTests-1539753999 None] Acquiring lock "cinder-09da182a-9d65-41e9-a644-0a830a54a900-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:32:12 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6345fa9c-65c8-4adc-8840-553dbb03cbab tempest-ProjectMemberTests-1539753999 None] Lock "cinder-09da182a-9d65-41e9-a644-0a830a54a900-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:32:12 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6345fa9c-65c8-4adc-8840-553dbb03cbab tempest-ProjectMemberTests-1539753999 None] Acquiring lock "cinder-quobyte-ee097de0-903f-4aa9-9be3-67a21090cce3" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:32:12 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6345fa9c-65c8-4adc-8840-553dbb03cbab tempest-ProjectMemberTests-1539753999 None] Lock "cinder-quobyte-ee097de0-903f-4aa9-9be3-67a21090cce3" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:32:12 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6345fa9c-65c8-4adc-8840-553dbb03cbab tempest-ProjectMemberTests-1539753999 None] Acquiring lock "cinder-quobyte-09da182a-9d65-41e9-a644-0a830a54a900" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:32:12 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6345fa9c-65c8-4adc-8840-553dbb03cbab tempest-ProjectMemberTests-1539753999 None] Lock "cinder-quobyte-09da182a-9d65-41e9-a644-0a830a54a900" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:32:12 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-6345fa9c-65c8-4adc-8840-553dbb03cbab tempest-ProjectMemberTests-1539753999 None] Deleting offline snapshot 09da182a-9d65-41e9-a644-0a830a54a900 of volume ee097de0-903f-4aa9-9be3-67a21090cce3 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 12:32:12 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-6345fa9c-65c8-4adc-8840-553dbb03cbab tempest-ProjectMemberTests-1539753999 None] snapshot_file for this snap is: volume-ee097de0-903f-4aa9-9be3-67a21090cce3.09da182a-9d65-41e9-a644-0a830a54a900 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 12:32:12 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[30552c85-3907-4320-9f14-6d640c986cc8]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:32:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6345fa9c-65c8-4adc-8840-553dbb03cbab tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee097de0-903f-4aa9-9be3-67a21090cce3.09da182a-9d65-41e9-a644-0a830a54a900 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:12 devstack sudo[108095]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b2770a6d-19d8-4b58-bdc0-c946dff401e6 tempest-ProjectReaderTests-34452203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba94cef0-d1a0-4d2c-89a7-9776e16aea72 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ba94cef0-d1a0-4d2c-89a7-9776e16aea72.478d87e9-9df2-49d5-91f3-ac7fbd3cbcd0" returned: 0 in 0.304s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:12 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-b2770a6d-19d8-4b58-bdc0-c946dff401e6 tempest-ProjectReaderTests-34452203 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ba94cef0-d1a0-4d2c-89a7-9776e16aea72.478d87e9-9df2-49d5-91f3-ac7fbd3cbcd0 is being set with open permissions: ugo+rw Nov 04 12:32:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b2770a6d-19d8-4b58-bdc0-c946dff401e6 tempest-ProjectReaderTests-34452203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ba94cef0-d1a0-4d2c-89a7-9776e16aea72.478d87e9-9df2-49d5-91f3-ac7fbd3cbcd0 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:12 devstack sudo[108101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ba94cef0-d1a0-4d2c-89a7-9776e16aea72.478d87e9-9df2-49d5-91f3-ac7fbd3cbcd0 Nov 04 12:32:12 devstack sudo[108101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:12 devstack sudo[108100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee097de0-903f-4aa9-9be3-67a21090cce3.09da182a-9d65-41e9-a644-0a830a54a900 Nov 04 12:32:12 devstack sudo[108100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:12 devstack sudo[108101]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b2770a6d-19d8-4b58-bdc0-c946dff401e6 tempest-ProjectReaderTests-34452203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ba94cef0-d1a0-4d2c-89a7-9776e16aea72.478d87e9-9df2-49d5-91f3-ac7fbd3cbcd0" returned: 0 in 0.236s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b2770a6d-19d8-4b58-bdc0-c946dff401e6 tempest-ProjectReaderTests-34452203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ba94cef0-d1a0-4d2c-89a7-9776e16aea72.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:12 devstack sudo[108106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ba94cef0-d1a0-4d2c-89a7-9776e16aea72.info Nov 04 12:32:12 devstack sudo[108106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:12 devstack sudo[108100]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6345fa9c-65c8-4adc-8840-553dbb03cbab tempest-ProjectMemberTests-1539753999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee097de0-903f-4aa9-9be3-67a21090cce3.09da182a-9d65-41e9-a644-0a830a54a900" returned: 0 in 0.379s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:12 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-6345fa9c-65c8-4adc-8840-553dbb03cbab tempest-ProjectMemberTests-1539753999 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee097de0-903f-4aa9-9be3-67a21090cce3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 12:32:12 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b96de2-60f2-4a30-a8a7-3f8e4440c688]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:32:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6345fa9c-65c8-4adc-8840-553dbb03cbab tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee097de0-903f-4aa9-9be3-67a21090cce3 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:13 devstack sudo[108110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee097de0-903f-4aa9-9be3-67a21090cce3 Nov 04 12:32:13 devstack sudo[108110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:13 devstack sudo[108106]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b2770a6d-19d8-4b58-bdc0-c946dff401e6 tempest-ProjectReaderTests-34452203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ba94cef0-d1a0-4d2c-89a7-9776e16aea72.info" returned: 0 in 0.276s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:13 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-b2770a6d-19d8-4b58-bdc0-c946dff401e6 tempest-ProjectReaderTests-34452203 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ba94cef0-d1a0-4d2c-89a7-9776e16aea72.info is being set with open permissions: ugo+rw Nov 04 12:32:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b2770a6d-19d8-4b58-bdc0-c946dff401e6 tempest-ProjectReaderTests-34452203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ba94cef0-d1a0-4d2c-89a7-9776e16aea72.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:13 devstack sudo[108113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ba94cef0-d1a0-4d2c-89a7-9776e16aea72.info Nov 04 12:32:13 devstack sudo[108113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:13 devstack sudo[108110]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6345fa9c-65c8-4adc-8840-553dbb03cbab tempest-ProjectMemberTests-1539753999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee097de0-903f-4aa9-9be3-67a21090cce3" returned: 0 in 0.362s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6345fa9c-65c8-4adc-8840-553dbb03cbab tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee097de0-903f-4aa9-9be3-67a21090cce3.09da182a-9d65-41e9-a644-0a830a54a900 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:13 devstack sudo[108119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee097de0-903f-4aa9-9be3-67a21090cce3.09da182a-9d65-41e9-a644-0a830a54a900 Nov 04 12:32:13 devstack sudo[108119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:13 devstack sudo[108113]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b2770a6d-19d8-4b58-bdc0-c946dff401e6 tempest-ProjectReaderTests-34452203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ba94cef0-d1a0-4d2c-89a7-9776e16aea72.info" returned: 0 in 0.255s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b2770a6d-19d8-4b58-bdc0-c946dff401e6 tempest-ProjectReaderTests-34452203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.901s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:32:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e6707f45-04c7-4228-98ef-77bceef70709 tempest-ProjectReaderTests-1586322695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.623s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:32:13 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e6707f45-04c7-4228-98ef-77bceef70709 tempest-ProjectReaderTests-1586322695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:32:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1496511113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8679b9b1-dd5e-4028-9c85-b86320fb7aaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b26a53d6ce4742ff98b7139c848f0e96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:32:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:32:11Z,use_quota=True,user_id='64e417d69d7a4b66848830619c264278',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:32:13 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-e6707f45-04c7-4228-98ef-77bceef70709 tempest-ProjectReaderTests-1586322695 None] Creating volume 8679b9b1-dd5e-4028-9c85-b86320fb7aaf {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:32:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e6707f45-04c7-4228-98ef-77bceef70709 tempest-ProjectReaderTests-1586322695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:32:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e6707f45-04c7-4228-98ef-77bceef70709 tempest-ProjectReaderTests-1586322695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:32:13 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e6707f45-04c7-4228-98ef-77bceef70709 tempest-ProjectReaderTests-1586322695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:32:13 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e6707f45-04c7-4228-98ef-77bceef70709 tempest-ProjectReaderTests-1586322695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:32:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e6707f45-04c7-4228-98ef-77bceef70709 tempest-ProjectReaderTests-1586322695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:32:13 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e6707f45-04c7-4228-98ef-77bceef70709 tempest-ProjectReaderTests-1586322695 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:32:13 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-e6707f45-04c7-4228-98ef-77bceef70709 tempest-ProjectReaderTests-1586322695 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:32:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e6707f45-04c7-4228-98ef-77bceef70709 tempest-ProjectReaderTests-1586322695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8679b9b1-dd5e-4028-9c85-b86320fb7aaf 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:13 devstack sudo[108121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8679b9b1-dd5e-4028-9c85-b86320fb7aaf 1073741824 Nov 04 12:32:13 devstack sudo[108121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:13 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-b2770a6d-19d8-4b58-bdc0-c946dff401e6 tempest-ProjectReaderTests-34452203 None] Create snapshot completed successfully Nov 04 12:32:13 devstack sudo[108119]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6345fa9c-65c8-4adc-8840-553dbb03cbab tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee097de0-903f-4aa9-9be3-67a21090cce3.09da182a-9d65-41e9-a644-0a830a54a900" returned: 0 in 0.313s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6345fa9c-65c8-4adc-8840-553dbb03cbab tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee097de0-903f-4aa9-9be3-67a21090cce3.09da182a-9d65-41e9-a644-0a830a54a900 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:13 devstack sudo[108129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee097de0-903f-4aa9-9be3-67a21090cce3.09da182a-9d65-41e9-a644-0a830a54a900 Nov 04 12:32:13 devstack sudo[108129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:13 devstack sudo[108121]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e6707f45-04c7-4228-98ef-77bceef70709 tempest-ProjectReaderTests-1586322695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8679b9b1-dd5e-4028-9c85-b86320fb7aaf 1073741824" returned: 0 in 0.496s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:13 devstack sudo[108129]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6345fa9c-65c8-4adc-8840-553dbb03cbab tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee097de0-903f-4aa9-9be3-67a21090cce3.09da182a-9d65-41e9-a644-0a830a54a900" returned: 0 in 0.288s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e6707f45-04c7-4228-98ef-77bceef70709 tempest-ProjectReaderTests-1586322695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8679b9b1-dd5e-4028-9c85-b86320fb7aaf {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:13 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6345fa9c-65c8-4adc-8840-553dbb03cbab tempest-ProjectMemberTests-1539753999 None] Lock "cinder-quobyte-09da182a-9d65-41e9-a644-0a830a54a900" released by "_delete_snapshot" :: held 1.458s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:32:14 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6345fa9c-65c8-4adc-8840-553dbb03cbab tempest-ProjectMemberTests-1539753999 None] Lock "cinder-quobyte-ee097de0-903f-4aa9-9be3-67a21090cce3" released by "delete_snapshot" :: held 1.484s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:32:14 devstack sudo[108134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8679b9b1-dd5e-4028-9c85-b86320fb7aaf Nov 04 12:32:14 devstack sudo[108134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:14 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-6345fa9c-65c8-4adc-8840-553dbb03cbab tempest-ProjectMemberTests-1539753999 None] Created reservations ['81f83138-42b4-4ee2-85e2-10756f125f1e', '77ba511e-e403-46fe-bf54-08ad57494c8d', '8ad2bbc7-e0f6-45b4-8eaa-e259ff84513a', 'ec349c1d-b27c-43c8-a857-4b17b9fa4a13'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:32:14 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-6345fa9c-65c8-4adc-8840-553dbb03cbab tempest-ProjectMemberTests-1539753999 None] Delete snapshot completed successfully. Nov 04 12:32:14 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6345fa9c-65c8-4adc-8840-553dbb03cbab tempest-ProjectMemberTests-1539753999 None] Lock "cinder-09da182a-9d65-41e9-a644-0a830a54a900-delete_snapshot" released by "delete_snapshot" :: held 1.618s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:32:14 devstack sudo[108134]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e6707f45-04c7-4228-98ef-77bceef70709 tempest-ProjectReaderTests-1586322695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8679b9b1-dd5e-4028-9c85-b86320fb7aaf" returned: 0 in 0.245s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:14 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e6707f45-04c7-4228-98ef-77bceef70709 tempest-ProjectReaderTests-1586322695 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:32:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e6707f45-04c7-4228-98ef-77bceef70709 tempest-ProjectReaderTests-1586322695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:32:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e6707f45-04c7-4228-98ef-77bceef70709 tempest-ProjectReaderTests-1586322695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f187d30-7009-450e-b000-e74350fdc3d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8679b9b1-dd5e-4028-9c85-b86320fb7aaf', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:32:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e6707f45-04c7-4228-98ef-77bceef70709 tempest-ProjectReaderTests-1586322695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eded987-6928-4c2a-9c33-583e930ff72a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:32:14 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-e6707f45-04c7-4228-98ef-77bceef70709 tempest-ProjectReaderTests-1586322695 None] Volume volume-8679b9b1-dd5e-4028-9c85-b86320fb7aaf (8679b9b1-dd5e-4028-9c85-b86320fb7aaf): created successfully Nov 04 12:32:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e6707f45-04c7-4228-98ef-77bceef70709 tempest-ProjectReaderTests-1586322695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eded987-6928-4c2a-9c33-583e930ff72a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:32:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e6707f45-04c7-4228-98ef-77bceef70709 tempest-ProjectReaderTests-1586322695 None] Flow 'volume_create_manager' (2d0bda65-cc71-48a2-93cf-77005afdf32c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:32:14 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-e6707f45-04c7-4228-98ef-77bceef70709 tempest-ProjectReaderTests-1586322695 None] Created volume successfully. Nov 04 12:32:14 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ac436b1c-7996-4e52-b983-1f0a34998e78 tempest-ProjectReaderTests-34452203 None] Acquiring lock "cinder-478d87e9-9df2-49d5-91f3-ac7fbd3cbcd0-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:32:14 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ac436b1c-7996-4e52-b983-1f0a34998e78 tempest-ProjectReaderTests-34452203 None] Lock "cinder-478d87e9-9df2-49d5-91f3-ac7fbd3cbcd0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:32:14 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ac436b1c-7996-4e52-b983-1f0a34998e78 tempest-ProjectReaderTests-34452203 None] Acquiring lock "cinder-quobyte-ba94cef0-d1a0-4d2c-89a7-9776e16aea72" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:32:14 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ac436b1c-7996-4e52-b983-1f0a34998e78 tempest-ProjectReaderTests-34452203 None] Lock "cinder-quobyte-ba94cef0-d1a0-4d2c-89a7-9776e16aea72" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:32:14 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ac436b1c-7996-4e52-b983-1f0a34998e78 tempest-ProjectReaderTests-34452203 None] Acquiring lock "cinder-quobyte-478d87e9-9df2-49d5-91f3-ac7fbd3cbcd0" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:32:14 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ac436b1c-7996-4e52-b983-1f0a34998e78 tempest-ProjectReaderTests-34452203 None] Lock "cinder-quobyte-478d87e9-9df2-49d5-91f3-ac7fbd3cbcd0" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:32:14 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-ac436b1c-7996-4e52-b983-1f0a34998e78 tempest-ProjectReaderTests-34452203 None] Deleting offline snapshot 478d87e9-9df2-49d5-91f3-ac7fbd3cbcd0 of volume ba94cef0-d1a0-4d2c-89a7-9776e16aea72 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 12:32:14 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-ac436b1c-7996-4e52-b983-1f0a34998e78 tempest-ProjectReaderTests-34452203 None] snapshot_file for this snap is: volume-ba94cef0-d1a0-4d2c-89a7-9776e16aea72.478d87e9-9df2-49d5-91f3-ac7fbd3cbcd0 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 12:32:14 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[06339a14-0dd9-4c08-a31e-84e8deecb685]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:32:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ac436b1c-7996-4e52-b983-1f0a34998e78 tempest-ProjectReaderTests-34452203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ba94cef0-d1a0-4d2c-89a7-9776e16aea72.478d87e9-9df2-49d5-91f3-ac7fbd3cbcd0 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:14 devstack sudo[108137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ba94cef0-d1a0-4d2c-89a7-9776e16aea72.478d87e9-9df2-49d5-91f3-ac7fbd3cbcd0 Nov 04 12:32:14 devstack sudo[108137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:14 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-eb9955cb-c8f8-4f05-a993-8a70cf81627c tempest-ProjectMemberTests-1539753999 None] Acquiring lock "cinder-ee097de0-903f-4aa9-9be3-67a21090cce3-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:32:14 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-eb9955cb-c8f8-4f05-a993-8a70cf81627c tempest-ProjectMemberTests-1539753999 None] Lock "cinder-ee097de0-903f-4aa9-9be3-67a21090cce3-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:32:14 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-eb9955cb-c8f8-4f05-a993-8a70cf81627c tempest-ProjectMemberTests-1539753999 None] Acquiring lock "cinder-quobyte-ee097de0-903f-4aa9-9be3-67a21090cce3" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:32:14 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-eb9955cb-c8f8-4f05-a993-8a70cf81627c tempest-ProjectMemberTests-1539753999 None] Lock "cinder-quobyte-ee097de0-903f-4aa9-9be3-67a21090cce3" acquired by "delete_volume" :: waited 0.022s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:32:14 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d9007a-e0b0-4ce8-9917-6b1f74775b5d]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:32:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-eb9955cb-c8f8-4f05-a993-8a70cf81627c tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee097de0-903f-4aa9-9be3-67a21090cce3 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:14 devstack sudo[108139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee097de0-903f-4aa9-9be3-67a21090cce3 Nov 04 12:32:14 devstack sudo[108139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:14 devstack sudo[108137]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ac436b1c-7996-4e52-b983-1f0a34998e78 tempest-ProjectReaderTests-34452203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ba94cef0-d1a0-4d2c-89a7-9776e16aea72.478d87e9-9df2-49d5-91f3-ac7fbd3cbcd0" returned: 0 in 0.446s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:14 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-ac436b1c-7996-4e52-b983-1f0a34998e78 tempest-ProjectReaderTests-34452203 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba94cef0-d1a0-4d2c-89a7-9776e16aea72(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 12:32:15 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-04aeaf46-cdff-422a-8101-f2ed42ffeafd tempest-ProjectReaderTests-1586322695 None] Acquiring lock "cinder-8679b9b1-dd5e-4028-9c85-b86320fb7aaf-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:32:15 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d821a5-2f77-4084-bdbf-7fdd1c605a4b]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:32:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ac436b1c-7996-4e52-b983-1f0a34998e78 tempest-ProjectReaderTests-34452203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ba94cef0-d1a0-4d2c-89a7-9776e16aea72 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:15 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-04aeaf46-cdff-422a-8101-f2ed42ffeafd tempest-ProjectReaderTests-1586322695 None] Lock "cinder-8679b9b1-dd5e-4028-9c85-b86320fb7aaf-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:32:15 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-04aeaf46-cdff-422a-8101-f2ed42ffeafd tempest-ProjectReaderTests-1586322695 None] Acquiring lock "cinder-quobyte-8679b9b1-dd5e-4028-9c85-b86320fb7aaf" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:32:15 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-04aeaf46-cdff-422a-8101-f2ed42ffeafd tempest-ProjectReaderTests-1586322695 None] Lock "cinder-quobyte-8679b9b1-dd5e-4028-9c85-b86320fb7aaf" acquired by "delete_volume" :: waited 0.020s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:32:15 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a801d7-bc5c-4c3c-828b-43a00ee69639]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:32:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-04aeaf46-cdff-422a-8101-f2ed42ffeafd tempest-ProjectReaderTests-1586322695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8679b9b1-dd5e-4028-9c85-b86320fb7aaf {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:15 devstack sudo[108146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ba94cef0-d1a0-4d2c-89a7-9776e16aea72 Nov 04 12:32:15 devstack sudo[108146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:15 devstack sudo[108139]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-eb9955cb-c8f8-4f05-a993-8a70cf81627c tempest-ProjectMemberTests-1539753999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee097de0-903f-4aa9-9be3-67a21090cce3" returned: 0 in 0.443s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-eb9955cb-c8f8-4f05-a993-8a70cf81627c tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee097de0-903f-4aa9-9be3-67a21090cce3 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:15 devstack sudo[108153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee097de0-903f-4aa9-9be3-67a21090cce3 Nov 04 12:32:15 devstack sudo[108153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:15 devstack sudo[108149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8679b9b1-dd5e-4028-9c85-b86320fb7aaf Nov 04 12:32:15 devstack sudo[108149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:15 devstack sudo[108146]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ac436b1c-7996-4e52-b983-1f0a34998e78 tempest-ProjectReaderTests-34452203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ba94cef0-d1a0-4d2c-89a7-9776e16aea72" returned: 0 in 0.449s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ac436b1c-7996-4e52-b983-1f0a34998e78 tempest-ProjectReaderTests-34452203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ba94cef0-d1a0-4d2c-89a7-9776e16aea72.478d87e9-9df2-49d5-91f3-ac7fbd3cbcd0 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:15 devstack sudo[108153]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-eb9955cb-c8f8-4f05-a993-8a70cf81627c tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ee097de0-903f-4aa9-9be3-67a21090cce3" returned: 0 in 0.279s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:15 devstack sudo[108164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ba94cef0-d1a0-4d2c-89a7-9776e16aea72.478d87e9-9df2-49d5-91f3-ac7fbd3cbcd0 Nov 04 12:32:15 devstack sudo[108164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:15 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-eb9955cb-c8f8-4f05-a993-8a70cf81627c tempest-ProjectMemberTests-1539753999 None] Lock "cinder-quobyte-ee097de0-903f-4aa9-9be3-67a21090cce3" released by "delete_volume" :: held 0.788s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:32:15 devstack sudo[108149]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-04aeaf46-cdff-422a-8101-f2ed42ffeafd tempest-ProjectReaderTests-1586322695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8679b9b1-dd5e-4028-9c85-b86320fb7aaf" returned: 0 in 0.403s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-04aeaf46-cdff-422a-8101-f2ed42ffeafd tempest-ProjectReaderTests-1586322695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8679b9b1-dd5e-4028-9c85-b86320fb7aaf {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:15 devstack sudo[108167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8679b9b1-dd5e-4028-9c85-b86320fb7aaf Nov 04 12:32:15 devstack sudo[108167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:15 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-eb9955cb-c8f8-4f05-a993-8a70cf81627c tempest-ProjectMemberTests-1539753999 None] Created reservations ['a26485df-8104-40c4-95d7-4d1f59064524', '7f238b9d-3cad-4d75-b9fd-bc59ee76613e', '91057730-bb5d-4800-82fb-49659fe432b7', '20036a77-ac6b-4291-8c74-172539627439'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:32:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-eb9955cb-c8f8-4f05-a993-8a70cf81627c tempest-ProjectMemberTests-1539753999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:32:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-eb9955cb-c8f8-4f05-a993-8a70cf81627c tempest-ProjectMemberTests-1539753999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:32:15 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-eb9955cb-c8f8-4f05-a993-8a70cf81627c tempest-ProjectMemberTests-1539753999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:32:15 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-eb9955cb-c8f8-4f05-a993-8a70cf81627c tempest-ProjectMemberTests-1539753999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:32:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-eb9955cb-c8f8-4f05-a993-8a70cf81627c tempest-ProjectMemberTests-1539753999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:32:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-eb9955cb-c8f8-4f05-a993-8a70cf81627c tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:15 devstack sudo[108169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:32:15 devstack sudo[108169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:15 devstack sudo[108167]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-04aeaf46-cdff-422a-8101-f2ed42ffeafd tempest-ProjectReaderTests-1586322695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8679b9b1-dd5e-4028-9c85-b86320fb7aaf" returned: 0 in 0.305s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:15 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-04aeaf46-cdff-422a-8101-f2ed42ffeafd tempest-ProjectReaderTests-1586322695 None] Lock "cinder-quobyte-8679b9b1-dd5e-4028-9c85-b86320fb7aaf" released by "delete_volume" :: held 0.764s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:32:15 devstack sudo[108164]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ac436b1c-7996-4e52-b983-1f0a34998e78 tempest-ProjectReaderTests-34452203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ba94cef0-d1a0-4d2c-89a7-9776e16aea72.478d87e9-9df2-49d5-91f3-ac7fbd3cbcd0" returned: 0 in 0.430s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ac436b1c-7996-4e52-b983-1f0a34998e78 tempest-ProjectReaderTests-34452203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ba94cef0-d1a0-4d2c-89a7-9776e16aea72.478d87e9-9df2-49d5-91f3-ac7fbd3cbcd0 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:15 devstack sudo[108176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ba94cef0-d1a0-4d2c-89a7-9776e16aea72.478d87e9-9df2-49d5-91f3-ac7fbd3cbcd0 Nov 04 12:32:15 devstack sudo[108176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:15 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-04aeaf46-cdff-422a-8101-f2ed42ffeafd tempest-ProjectReaderTests-1586322695 None] Created reservations ['b22ff2e2-d913-480b-b3dc-14269037bfcd', 'c60f9d77-9c9d-4a9f-ad58-5c59827189b8', 'a00d1991-1445-4b76-b1d0-61a1f40473f1', '40077dcc-837a-469c-af67-bf2975caeb4b'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:32:15 devstack sudo[108169]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-eb9955cb-c8f8-4f05-a993-8a70cf81627c tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.314s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:15 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-eb9955cb-c8f8-4f05-a993-8a70cf81627c tempest-ProjectMemberTests-1539753999 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:32:15 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-eb9955cb-c8f8-4f05-a993-8a70cf81627c tempest-ProjectMemberTests-1539753999 None] Deleted volume successfully. Nov 04 12:32:16 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-eb9955cb-c8f8-4f05-a993-8a70cf81627c tempest-ProjectMemberTests-1539753999 None] Lock "cinder-ee097de0-903f-4aa9-9be3-67a21090cce3-delete_volume" released by "delete_volume" :: held 1.348s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:32:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-04aeaf46-cdff-422a-8101-f2ed42ffeafd tempest-ProjectReaderTests-1586322695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:32:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-04aeaf46-cdff-422a-8101-f2ed42ffeafd tempest-ProjectReaderTests-1586322695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:32:16 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-04aeaf46-cdff-422a-8101-f2ed42ffeafd tempest-ProjectReaderTests-1586322695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:32:16 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-04aeaf46-cdff-422a-8101-f2ed42ffeafd tempest-ProjectReaderTests-1586322695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:32:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-04aeaf46-cdff-422a-8101-f2ed42ffeafd tempest-ProjectReaderTests-1586322695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:32:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-04aeaf46-cdff-422a-8101-f2ed42ffeafd tempest-ProjectReaderTests-1586322695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:16 devstack sudo[108179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:32:16 devstack sudo[108179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:16 devstack sudo[108176]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ac436b1c-7996-4e52-b983-1f0a34998e78 tempest-ProjectReaderTests-34452203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ba94cef0-d1a0-4d2c-89a7-9776e16aea72.478d87e9-9df2-49d5-91f3-ac7fbd3cbcd0" returned: 0 in 0.367s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:16 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ac436b1c-7996-4e52-b983-1f0a34998e78 tempest-ProjectReaderTests-34452203 None] Lock "cinder-quobyte-478d87e9-9df2-49d5-91f3-ac7fbd3cbcd0" released by "_delete_snapshot" :: held 1.844s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:32:16 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ac436b1c-7996-4e52-b983-1f0a34998e78 tempest-ProjectReaderTests-34452203 None] Lock "cinder-quobyte-ba94cef0-d1a0-4d2c-89a7-9776e16aea72" released by "delete_snapshot" :: held 1.870s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:32:16 devstack sudo[108179]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-04aeaf46-cdff-422a-8101-f2ed42ffeafd tempest-ProjectReaderTests-1586322695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.354s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:16 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-04aeaf46-cdff-422a-8101-f2ed42ffeafd tempest-ProjectReaderTests-1586322695 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:32:16 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-04aeaf46-cdff-422a-8101-f2ed42ffeafd tempest-ProjectReaderTests-1586322695 None] Deleted volume successfully. Nov 04 12:32:16 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8671c0c-e3c6-468d-a594-25c8b6470fe6 tempest-ProjectMemberTests-1539753999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:32:16 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f8671c0c-e3c6-468d-a594-25c8b6470fe6 tempest-ProjectMemberTests-1539753999 None] Flow 'volume_create_manager' (d80f6532-1350-4654-9b9c-33229c945e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:32:16 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f8671c0c-e3c6-468d-a594-25c8b6470fe6 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (382e81c1-5916-4e54-b00b-9bfd45dc5e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:32:16 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-04aeaf46-cdff-422a-8101-f2ed42ffeafd tempest-ProjectReaderTests-1586322695 None] Lock "cinder-8679b9b1-dd5e-4028-9c85-b86320fb7aaf-delete_volume" released by "delete_volume" :: held 1.422s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:32:16 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-ac436b1c-7996-4e52-b983-1f0a34998e78 tempest-ProjectReaderTests-34452203 None] Created reservations ['5f6f1514-1806-46f3-8bdf-9cb9c777d950', '5d59faf4-e22b-4d12-9dcc-099af76f3fef', '7070823a-c6d7-406c-86c1-d017e9cbb153', '95964c22-679b-45ce-b834-9a5775a14418'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:32:16 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f8671c0c-e3c6-468d-a594-25c8b6470fe6 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (382e81c1-5916-4e54-b00b-9bfd45dc5e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:32:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-562142797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca6f5b64-a6c5-4e08-8c5f-342241009c12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cb67397f4d04f049564f5d284f139d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:32:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:32:16Z,use_quota=True,user_id='091b86592c99419b9c07a685e7933341',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:32:16 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f8671c0c-e3c6-468d-a594-25c8b6470fe6 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00e8a5fc-f983-4685-b1f2-c3b66b166842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:32:16 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f8671c0c-e3c6-468d-a594-25c8b6470fe6 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00e8a5fc-f983-4685-b1f2-c3b66b166842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:32:16 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f8671c0c-e3c6-468d-a594-25c8b6470fe6 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7153cf3-efbd-43fc-9271-9b07da040462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:32:16 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f8671c0c-e3c6-468d-a594-25c8b6470fe6 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7153cf3-efbd-43fc-9271-9b07da040462) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca6f5b64-a6c5-4e08-8c5f-342241009c12', 'volume_name': 'volume-ca6f5b64-a6c5-4e08-8c5f-342241009c12', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:32:16 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f8671c0c-e3c6-468d-a594-25c8b6470fe6 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08d11f9c-6b22-4ece-8f1e-da149f17fe4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:32:16 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f8671c0c-e3c6-468d-a594-25c8b6470fe6 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08d11f9c-6b22-4ece-8f1e-da149f17fe4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:32:16 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f8671c0c-e3c6-468d-a594-25c8b6470fe6 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (169406b5-72db-4639-95a1-71e4b06c0b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:32:16 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-f8671c0c-e3c6-468d-a594-25c8b6470fe6 tempest-ProjectMemberTests-1539753999 None] Volume ca6f5b64-a6c5-4e08-8c5f-342241009c12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca6f5b64-a6c5-4e08-8c5f-342241009c12', 'volume_size': 1} Nov 04 12:32:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f8671c0c-e3c6-468d-a594-25c8b6470fe6 tempest-ProjectMemberTests-1539753999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:32:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f8671c0c-e3c6-468d-a594-25c8b6470fe6 tempest-ProjectMemberTests-1539753999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:32:16 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f8671c0c-e3c6-468d-a594-25c8b6470fe6 tempest-ProjectMemberTests-1539753999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:32:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-562142797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca6f5b64-a6c5-4e08-8c5f-342241009c12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cb67397f4d04f049564f5d284f139d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:32:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:32:16Z,use_quota=True,user_id='091b86592c99419b9c07a685e7933341',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:32:16 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-f8671c0c-e3c6-468d-a594-25c8b6470fe6 tempest-ProjectMemberTests-1539753999 None] Creating volume ca6f5b64-a6c5-4e08-8c5f-342241009c12 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:32:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f8671c0c-e3c6-468d-a594-25c8b6470fe6 tempest-ProjectMemberTests-1539753999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:32:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f8671c0c-e3c6-468d-a594-25c8b6470fe6 tempest-ProjectMemberTests-1539753999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:32:16 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f8671c0c-e3c6-468d-a594-25c8b6470fe6 tempest-ProjectMemberTests-1539753999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:32:16 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f8671c0c-e3c6-468d-a594-25c8b6470fe6 tempest-ProjectMemberTests-1539753999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:32:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f8671c0c-e3c6-468d-a594-25c8b6470fe6 tempest-ProjectMemberTests-1539753999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:32:16 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f8671c0c-e3c6-468d-a594-25c8b6470fe6 tempest-ProjectMemberTests-1539753999 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:32:16 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-f8671c0c-e3c6-468d-a594-25c8b6470fe6 tempest-ProjectMemberTests-1539753999 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:32:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f8671c0c-e3c6-468d-a594-25c8b6470fe6 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ca6f5b64-a6c5-4e08-8c5f-342241009c12 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:16 devstack sudo[108183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ca6f5b64-a6c5-4e08-8c5f-342241009c12 1073741824 Nov 04 12:32:16 devstack sudo[108183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:16 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-ac436b1c-7996-4e52-b983-1f0a34998e78 tempest-ProjectReaderTests-34452203 None] Delete snapshot completed successfully. Nov 04 12:32:16 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ac436b1c-7996-4e52-b983-1f0a34998e78 tempest-ProjectReaderTests-34452203 None] Lock "cinder-478d87e9-9df2-49d5-91f3-ac7fbd3cbcd0-delete_snapshot" released by "delete_snapshot" :: held 2.186s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:32:17 devstack sudo[108183]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f8671c0c-e3c6-468d-a594-25c8b6470fe6 tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ca6f5b64-a6c5-4e08-8c5f-342241009c12 1073741824" returned: 0 in 0.467s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f8671c0c-e3c6-468d-a594-25c8b6470fe6 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ca6f5b64-a6c5-4e08-8c5f-342241009c12 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:17 devstack sudo[108189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ca6f5b64-a6c5-4e08-8c5f-342241009c12 Nov 04 12:32:17 devstack sudo[108189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:17 devstack sudo[108189]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f8671c0c-e3c6-468d-a594-25c8b6470fe6 tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ca6f5b64-a6c5-4e08-8c5f-342241009c12" returned: 0 in 0.248s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:17 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f8671c0c-e3c6-468d-a594-25c8b6470fe6 tempest-ProjectMemberTests-1539753999 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:32:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f8671c0c-e3c6-468d-a594-25c8b6470fe6 tempest-ProjectMemberTests-1539753999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:32:17 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f8671c0c-e3c6-468d-a594-25c8b6470fe6 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (169406b5-72db-4639-95a1-71e4b06c0b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca6f5b64-a6c5-4e08-8c5f-342241009c12', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:32:17 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f8671c0c-e3c6-468d-a594-25c8b6470fe6 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d87e3ea-46ce-49e6-aec5-1d4a9a50d229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:32:17 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-f8671c0c-e3c6-468d-a594-25c8b6470fe6 tempest-ProjectMemberTests-1539753999 None] Volume volume-ca6f5b64-a6c5-4e08-8c5f-342241009c12 (ca6f5b64-a6c5-4e08-8c5f-342241009c12): created successfully Nov 04 12:32:17 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f8671c0c-e3c6-468d-a594-25c8b6470fe6 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d87e3ea-46ce-49e6-aec5-1d4a9a50d229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:32:17 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f8671c0c-e3c6-468d-a594-25c8b6470fe6 tempest-ProjectMemberTests-1539753999 None] Flow 'volume_create_manager' (d80f6532-1350-4654-9b9c-33229c945e4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:32:17 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-f8671c0c-e3c6-468d-a594-25c8b6470fe6 tempest-ProjectMemberTests-1539753999 None] Created volume successfully. Nov 04 12:32:17 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-1191c89d-a739-471d-b8c3-e2e04dc5e6d7 tempest-ProjectReaderTests-34452203 None] Acquiring lock "cinder-ba94cef0-d1a0-4d2c-89a7-9776e16aea72-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:32:17 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-1191c89d-a739-471d-b8c3-e2e04dc5e6d7 tempest-ProjectReaderTests-34452203 None] Lock "cinder-ba94cef0-d1a0-4d2c-89a7-9776e16aea72-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:32:17 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-1191c89d-a739-471d-b8c3-e2e04dc5e6d7 tempest-ProjectReaderTests-34452203 None] Acquiring lock "cinder-quobyte-ba94cef0-d1a0-4d2c-89a7-9776e16aea72" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:32:17 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-1191c89d-a739-471d-b8c3-e2e04dc5e6d7 tempest-ProjectReaderTests-34452203 None] Lock "cinder-quobyte-ba94cef0-d1a0-4d2c-89a7-9776e16aea72" acquired by "delete_volume" :: waited 0.020s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:32:17 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[489a48d0-57cd-4c1c-b4db-750b5dbbfb82]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:32:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1191c89d-a739-471d-b8c3-e2e04dc5e6d7 tempest-ProjectReaderTests-34452203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ba94cef0-d1a0-4d2c-89a7-9776e16aea72 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:17 devstack sudo[108192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ba94cef0-d1a0-4d2c-89a7-9776e16aea72 Nov 04 12:32:17 devstack sudo[108192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:18 devstack sudo[108192]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1191c89d-a739-471d-b8c3-e2e04dc5e6d7 tempest-ProjectReaderTests-34452203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ba94cef0-d1a0-4d2c-89a7-9776e16aea72" returned: 0 in 0.392s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1191c89d-a739-471d-b8c3-e2e04dc5e6d7 tempest-ProjectReaderTests-34452203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ba94cef0-d1a0-4d2c-89a7-9776e16aea72 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:18 devstack sudo[108197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ba94cef0-d1a0-4d2c-89a7-9776e16aea72 Nov 04 12:32:18 devstack sudo[108197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:18 devstack sudo[108197]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1191c89d-a739-471d-b8c3-e2e04dc5e6d7 tempest-ProjectReaderTests-34452203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ba94cef0-d1a0-4d2c-89a7-9776e16aea72" returned: 0 in 0.256s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:18 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-1191c89d-a739-471d-b8c3-e2e04dc5e6d7 tempest-ProjectReaderTests-34452203 None] Lock "cinder-quobyte-ba94cef0-d1a0-4d2c-89a7-9776e16aea72" released by "delete_volume" :: held 0.713s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:32:18 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-1191c89d-a739-471d-b8c3-e2e04dc5e6d7 tempest-ProjectReaderTests-34452203 None] Created reservations ['0f2a8c04-4976-4fbe-a5f2-fb1f9ce7d17c', '929c6f1e-beb0-47aa-a44f-aa3657977134', 'a2aad37c-6386-4719-81d6-accc33fe7f21', '39d7a9bd-359c-4eb9-a45c-78c07339ed99'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:32:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1191c89d-a739-471d-b8c3-e2e04dc5e6d7 tempest-ProjectReaderTests-34452203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:32:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1191c89d-a739-471d-b8c3-e2e04dc5e6d7 tempest-ProjectReaderTests-34452203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:32:18 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1191c89d-a739-471d-b8c3-e2e04dc5e6d7 tempest-ProjectReaderTests-34452203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:32:18 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1191c89d-a739-471d-b8c3-e2e04dc5e6d7 tempest-ProjectReaderTests-34452203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:32:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1191c89d-a739-471d-b8c3-e2e04dc5e6d7 tempest-ProjectReaderTests-34452203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:32:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1191c89d-a739-471d-b8c3-e2e04dc5e6d7 tempest-ProjectReaderTests-34452203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:18 devstack sudo[108202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:32:18 devstack sudo[108202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f7f2f605-814f-40de-b4b8-171e8f49e3e1 tempest-ProjectMemberTests-1539753999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:32:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f7f2f605-814f-40de-b4b8-171e8f49e3e1 tempest-ProjectMemberTests-1539753999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:32:18 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-f7f2f605-814f-40de-b4b8-171e8f49e3e1 tempest-ProjectMemberTests-1539753999 None] Creating offline snapshot 40c5a5ba-49d3-440d-8441-982626ecfc44 of volume ca6f5b64-a6c5-4e08-8c5f-342241009c12 {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 12:32:18 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5bede36-2643-4ce0-8948-7c7aa878dd31]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:32:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f7f2f605-814f-40de-b4b8-171e8f49e3e1 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ca6f5b64-a6c5-4e08-8c5f-342241009c12 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:18 devstack sudo[108204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ca6f5b64-a6c5-4e08-8c5f-342241009c12 Nov 04 12:32:18 devstack sudo[108204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:18 devstack sudo[108202]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1191c89d-a739-471d-b8c3-e2e04dc5e6d7 tempest-ProjectReaderTests-34452203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.255s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:18 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-1191c89d-a739-471d-b8c3-e2e04dc5e6d7 tempest-ProjectReaderTests-34452203 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:32:18 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-1191c89d-a739-471d-b8c3-e2e04dc5e6d7 tempest-ProjectReaderTests-34452203 None] Deleted volume successfully. Nov 04 12:32:18 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-1191c89d-a739-471d-b8c3-e2e04dc5e6d7 tempest-ProjectReaderTests-34452203 None] Lock "cinder-ba94cef0-d1a0-4d2c-89a7-9776e16aea72-delete_volume" released by "delete_volume" :: held 1.231s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:32:19 devstack sudo[108204]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f7f2f605-814f-40de-b4b8-171e8f49e3e1 tempest-ProjectMemberTests-1539753999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ca6f5b64-a6c5-4e08-8c5f-342241009c12" returned: 0 in 0.371s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f7f2f605-814f-40de-b4b8-171e8f49e3e1 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ca6f5b64-a6c5-4e08-8c5f-342241009c12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ca6f5b64-a6c5-4e08-8c5f-342241009c12.40c5a5ba-49d3-440d-8441-982626ecfc44 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:19 devstack sudo[108210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ca6f5b64-a6c5-4e08-8c5f-342241009c12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ca6f5b64-a6c5-4e08-8c5f-342241009c12.40c5a5ba-49d3-440d-8441-982626ecfc44 1G Nov 04 12:32:19 devstack sudo[108210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:19 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-2901c8df-8da2-45fb-b846-e53e29083529 tempest-ProjectReaderTests-34452203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:32:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2901c8df-8da2-45fb-b846-e53e29083529 tempest-ProjectReaderTests-34452203 None] Flow 'volume_create_manager' (4d05d7bc-02e9-423e-893c-294e94e0b994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:32:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2901c8df-8da2-45fb-b846-e53e29083529 tempest-ProjectReaderTests-34452203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5195823-c545-4640-8543-11ac92927b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:32:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2901c8df-8da2-45fb-b846-e53e29083529 tempest-ProjectReaderTests-34452203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5195823-c545-4640-8543-11ac92927b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:32:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1590767313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b653314-b0a6-4fc6-95e2-7c3841c1e9b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb954983f7c64fe388fdbeaf1cdc0a5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:32:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:32:19Z,use_quota=True,user_id='f3d9809a097943a5b1cd27d05f8ff1ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:32:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2901c8df-8da2-45fb-b846-e53e29083529 tempest-ProjectReaderTests-34452203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb91be8e-428e-4a44-bcf0-cb95d021a681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:32:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2901c8df-8da2-45fb-b846-e53e29083529 tempest-ProjectReaderTests-34452203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb91be8e-428e-4a44-bcf0-cb95d021a681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:32:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2901c8df-8da2-45fb-b846-e53e29083529 tempest-ProjectReaderTests-34452203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (903fd3f3-936e-47f5-adad-d33be12c28d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:32:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2901c8df-8da2-45fb-b846-e53e29083529 tempest-ProjectReaderTests-34452203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (903fd3f3-936e-47f5-adad-d33be12c28d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b653314-b0a6-4fc6-95e2-7c3841c1e9b9', 'volume_name': 'volume-8b653314-b0a6-4fc6-95e2-7c3841c1e9b9', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:32:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2901c8df-8da2-45fb-b846-e53e29083529 tempest-ProjectReaderTests-34452203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddc32029-d7b0-4502-80bd-8243cf4602a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:32:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2901c8df-8da2-45fb-b846-e53e29083529 tempest-ProjectReaderTests-34452203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddc32029-d7b0-4502-80bd-8243cf4602a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:32:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2901c8df-8da2-45fb-b846-e53e29083529 tempest-ProjectReaderTests-34452203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ce2c1a2-0fbb-4872-ba04-f2fb70c72e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:32:19 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-2901c8df-8da2-45fb-b846-e53e29083529 tempest-ProjectReaderTests-34452203 None] Volume 8b653314-b0a6-4fc6-95e2-7c3841c1e9b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b653314-b0a6-4fc6-95e2-7c3841c1e9b9', 'volume_size': 1} Nov 04 12:32:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2901c8df-8da2-45fb-b846-e53e29083529 tempest-ProjectReaderTests-34452203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:32:19 devstack sudo[108210]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f7f2f605-814f-40de-b4b8-171e8f49e3e1 tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ca6f5b64-a6c5-4e08-8c5f-342241009c12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ca6f5b64-a6c5-4e08-8c5f-342241009c12.40c5a5ba-49d3-440d-8441-982626ecfc44 1G" returned: 0 in 0.434s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f7f2f605-814f-40de-b4b8-171e8f49e3e1 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca6f5b64-a6c5-4e08-8c5f-342241009c12 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ca6f5b64-a6c5-4e08-8c5f-342241009c12.40c5a5ba-49d3-440d-8441-982626ecfc44 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:19 devstack sudo[108216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca6f5b64-a6c5-4e08-8c5f-342241009c12 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ca6f5b64-a6c5-4e08-8c5f-342241009c12.40c5a5ba-49d3-440d-8441-982626ecfc44 Nov 04 12:32:19 devstack sudo[108216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:19 devstack sudo[108216]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f7f2f605-814f-40de-b4b8-171e8f49e3e1 tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca6f5b64-a6c5-4e08-8c5f-342241009c12 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ca6f5b64-a6c5-4e08-8c5f-342241009c12.40c5a5ba-49d3-440d-8441-982626ecfc44" returned: 0 in 0.271s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:19 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-f7f2f605-814f-40de-b4b8-171e8f49e3e1 tempest-ProjectMemberTests-1539753999 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ca6f5b64-a6c5-4e08-8c5f-342241009c12.40c5a5ba-49d3-440d-8441-982626ecfc44 is being set with open permissions: ugo+rw Nov 04 12:32:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f7f2f605-814f-40de-b4b8-171e8f49e3e1 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ca6f5b64-a6c5-4e08-8c5f-342241009c12.40c5a5ba-49d3-440d-8441-982626ecfc44 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:19 devstack sudo[108221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ca6f5b64-a6c5-4e08-8c5f-342241009c12.40c5a5ba-49d3-440d-8441-982626ecfc44 Nov 04 12:32:19 devstack sudo[108221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:19 devstack sudo[108221]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f7f2f605-814f-40de-b4b8-171e8f49e3e1 tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ca6f5b64-a6c5-4e08-8c5f-342241009c12.40c5a5ba-49d3-440d-8441-982626ecfc44" returned: 0 in 0.231s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f7f2f605-814f-40de-b4b8-171e8f49e3e1 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ca6f5b64-a6c5-4e08-8c5f-342241009c12.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:20 devstack sudo[108224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ca6f5b64-a6c5-4e08-8c5f-342241009c12.info Nov 04 12:32:20 devstack sudo[108224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:20 devstack sudo[108224]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f7f2f605-814f-40de-b4b8-171e8f49e3e1 tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ca6f5b64-a6c5-4e08-8c5f-342241009c12.info" returned: 0 in 0.236s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:20 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-f7f2f605-814f-40de-b4b8-171e8f49e3e1 tempest-ProjectMemberTests-1539753999 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ca6f5b64-a6c5-4e08-8c5f-342241009c12.info is being set with open permissions: ugo+rw Nov 04 12:32:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f7f2f605-814f-40de-b4b8-171e8f49e3e1 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ca6f5b64-a6c5-4e08-8c5f-342241009c12.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:20 devstack sudo[108227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ca6f5b64-a6c5-4e08-8c5f-342241009c12.info Nov 04 12:32:20 devstack sudo[108227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:20 devstack sudo[108227]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f7f2f605-814f-40de-b4b8-171e8f49e3e1 tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ca6f5b64-a6c5-4e08-8c5f-342241009c12.info" returned: 0 in 0.226s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f7f2f605-814f-40de-b4b8-171e8f49e3e1 tempest-ProjectMemberTests-1539753999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.846s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:32:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2901c8df-8da2-45fb-b846-e53e29083529 tempest-ProjectReaderTests-34452203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.067s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:32:20 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2901c8df-8da2-45fb-b846-e53e29083529 tempest-ProjectReaderTests-34452203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:32:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1590767313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b653314-b0a6-4fc6-95e2-7c3841c1e9b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb954983f7c64fe388fdbeaf1cdc0a5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:32:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:32:19Z,use_quota=True,user_id='f3d9809a097943a5b1cd27d05f8ff1ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:32:20 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-2901c8df-8da2-45fb-b846-e53e29083529 tempest-ProjectReaderTests-34452203 None] Creating volume 8b653314-b0a6-4fc6-95e2-7c3841c1e9b9 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:32:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2901c8df-8da2-45fb-b846-e53e29083529 tempest-ProjectReaderTests-34452203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:32:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2901c8df-8da2-45fb-b846-e53e29083529 tempest-ProjectReaderTests-34452203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:32:20 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2901c8df-8da2-45fb-b846-e53e29083529 tempest-ProjectReaderTests-34452203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:32:20 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2901c8df-8da2-45fb-b846-e53e29083529 tempest-ProjectReaderTests-34452203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:32:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2901c8df-8da2-45fb-b846-e53e29083529 tempest-ProjectReaderTests-34452203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:32:20 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2901c8df-8da2-45fb-b846-e53e29083529 tempest-ProjectReaderTests-34452203 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:32:20 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-2901c8df-8da2-45fb-b846-e53e29083529 tempest-ProjectReaderTests-34452203 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:32:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2901c8df-8da2-45fb-b846-e53e29083529 tempest-ProjectReaderTests-34452203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8b653314-b0a6-4fc6-95e2-7c3841c1e9b9 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:20 devstack sudo[108230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8b653314-b0a6-4fc6-95e2-7c3841c1e9b9 1073741824 Nov 04 12:32:20 devstack sudo[108230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:20 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-f7f2f605-814f-40de-b4b8-171e8f49e3e1 tempest-ProjectMemberTests-1539753999 None] Create snapshot completed successfully Nov 04 12:32:20 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f36a202b-711c-4fc6-ad9f-b06b80d127e9 tempest-ProjectMemberTests-1539753999 None] Acquiring lock "cinder-40c5a5ba-49d3-440d-8441-982626ecfc44-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:32:20 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f36a202b-711c-4fc6-ad9f-b06b80d127e9 tempest-ProjectMemberTests-1539753999 None] Lock "cinder-40c5a5ba-49d3-440d-8441-982626ecfc44-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:32:20 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f36a202b-711c-4fc6-ad9f-b06b80d127e9 tempest-ProjectMemberTests-1539753999 None] Acquiring lock "cinder-quobyte-ca6f5b64-a6c5-4e08-8c5f-342241009c12" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:32:20 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f36a202b-711c-4fc6-ad9f-b06b80d127e9 tempest-ProjectMemberTests-1539753999 None] Lock "cinder-quobyte-ca6f5b64-a6c5-4e08-8c5f-342241009c12" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:32:20 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f36a202b-711c-4fc6-ad9f-b06b80d127e9 tempest-ProjectMemberTests-1539753999 None] Acquiring lock "cinder-quobyte-40c5a5ba-49d3-440d-8441-982626ecfc44" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:32:20 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f36a202b-711c-4fc6-ad9f-b06b80d127e9 tempest-ProjectMemberTests-1539753999 None] Lock "cinder-quobyte-40c5a5ba-49d3-440d-8441-982626ecfc44" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:32:20 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-f36a202b-711c-4fc6-ad9f-b06b80d127e9 tempest-ProjectMemberTests-1539753999 None] Deleting offline snapshot 40c5a5ba-49d3-440d-8441-982626ecfc44 of volume ca6f5b64-a6c5-4e08-8c5f-342241009c12 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 12:32:20 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-f36a202b-711c-4fc6-ad9f-b06b80d127e9 tempest-ProjectMemberTests-1539753999 None] snapshot_file for this snap is: volume-ca6f5b64-a6c5-4e08-8c5f-342241009c12.40c5a5ba-49d3-440d-8441-982626ecfc44 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 12:32:20 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10990e9-ec11-40ee-b79e-4349f88fbde8]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:32:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f36a202b-711c-4fc6-ad9f-b06b80d127e9 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ca6f5b64-a6c5-4e08-8c5f-342241009c12.40c5a5ba-49d3-440d-8441-982626ecfc44 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:20 devstack sudo[108230]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2901c8df-8da2-45fb-b846-e53e29083529 tempest-ProjectReaderTests-34452203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8b653314-b0a6-4fc6-95e2-7c3841c1e9b9 1073741824" returned: 0 in 0.448s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2901c8df-8da2-45fb-b846-e53e29083529 tempest-ProjectReaderTests-34452203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8b653314-b0a6-4fc6-95e2-7c3841c1e9b9 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:20 devstack sudo[108236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ca6f5b64-a6c5-4e08-8c5f-342241009c12.40c5a5ba-49d3-440d-8441-982626ecfc44 Nov 04 12:32:20 devstack sudo[108236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:20 devstack sudo[108237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8b653314-b0a6-4fc6-95e2-7c3841c1e9b9 Nov 04 12:32:20 devstack sudo[108237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:21 devstack sudo[108237]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2901c8df-8da2-45fb-b846-e53e29083529 tempest-ProjectReaderTests-34452203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8b653314-b0a6-4fc6-95e2-7c3841c1e9b9" returned: 0 in 0.251s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:21 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2901c8df-8da2-45fb-b846-e53e29083529 tempest-ProjectReaderTests-34452203 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:32:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2901c8df-8da2-45fb-b846-e53e29083529 tempest-ProjectReaderTests-34452203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:32:21 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2901c8df-8da2-45fb-b846-e53e29083529 tempest-ProjectReaderTests-34452203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ce2c1a2-0fbb-4872-ba04-f2fb70c72e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b653314-b0a6-4fc6-95e2-7c3841c1e9b9', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:32:21 devstack sudo[108236]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:21 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2901c8df-8da2-45fb-b846-e53e29083529 tempest-ProjectReaderTests-34452203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5a6370f-ef75-43a7-8464-ea3d565abb68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:32:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f36a202b-711c-4fc6-ad9f-b06b80d127e9 tempest-ProjectMemberTests-1539753999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ca6f5b64-a6c5-4e08-8c5f-342241009c12.40c5a5ba-49d3-440d-8441-982626ecfc44" returned: 0 in 0.374s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:21 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-f36a202b-711c-4fc6-ad9f-b06b80d127e9 tempest-ProjectMemberTests-1539753999 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ca6f5b64-a6c5-4e08-8c5f-342241009c12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 12:32:21 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-2901c8df-8da2-45fb-b846-e53e29083529 tempest-ProjectReaderTests-34452203 None] Volume volume-8b653314-b0a6-4fc6-95e2-7c3841c1e9b9 (8b653314-b0a6-4fc6-95e2-7c3841c1e9b9): created successfully Nov 04 12:32:21 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2901c8df-8da2-45fb-b846-e53e29083529 tempest-ProjectReaderTests-34452203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5a6370f-ef75-43a7-8464-ea3d565abb68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:32:21 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2901c8df-8da2-45fb-b846-e53e29083529 tempest-ProjectReaderTests-34452203 None] Flow 'volume_create_manager' (4d05d7bc-02e9-423e-893c-294e94e0b994) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:32:21 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b42b0c-24bc-4845-965a-eff91aab888e]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:32:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f36a202b-711c-4fc6-ad9f-b06b80d127e9 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ca6f5b64-a6c5-4e08-8c5f-342241009c12 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:21 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-2901c8df-8da2-45fb-b846-e53e29083529 tempest-ProjectReaderTests-34452203 None] Created volume successfully. Nov 04 12:32:21 devstack sudo[108244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ca6f5b64-a6c5-4e08-8c5f-342241009c12 Nov 04 12:32:21 devstack sudo[108244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6e32216a-f8d9-4fc0-be8e-0959fce87244 tempest-ProjectReaderTests-34452203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:32:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6e32216a-f8d9-4fc0-be8e-0959fce87244 tempest-ProjectReaderTests-34452203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:32:21 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-6e32216a-f8d9-4fc0-be8e-0959fce87244 tempest-ProjectReaderTests-34452203 None] Creating offline snapshot ddcd652b-2230-44ec-a4ad-b5295ef7d30b of volume 8b653314-b0a6-4fc6-95e2-7c3841c1e9b9 {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 12:32:21 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a76823e-3d60-4dec-9ee0-7753cbddea38]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:32:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6e32216a-f8d9-4fc0-be8e-0959fce87244 tempest-ProjectReaderTests-34452203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8b653314-b0a6-4fc6-95e2-7c3841c1e9b9 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:21 devstack sudo[108244]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f36a202b-711c-4fc6-ad9f-b06b80d127e9 tempest-ProjectMemberTests-1539753999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ca6f5b64-a6c5-4e08-8c5f-342241009c12" returned: 0 in 0.379s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f36a202b-711c-4fc6-ad9f-b06b80d127e9 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ca6f5b64-a6c5-4e08-8c5f-342241009c12.40c5a5ba-49d3-440d-8441-982626ecfc44 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:21 devstack sudo[108250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ca6f5b64-a6c5-4e08-8c5f-342241009c12.40c5a5ba-49d3-440d-8441-982626ecfc44 Nov 04 12:32:21 devstack sudo[108250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:21 devstack sudo[108248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8b653314-b0a6-4fc6-95e2-7c3841c1e9b9 Nov 04 12:32:21 devstack sudo[108248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:22 devstack sudo[108248]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6e32216a-f8d9-4fc0-be8e-0959fce87244 tempest-ProjectReaderTests-34452203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8b653314-b0a6-4fc6-95e2-7c3841c1e9b9" returned: 0 in 0.422s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6e32216a-f8d9-4fc0-be8e-0959fce87244 tempest-ProjectReaderTests-34452203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8b653314-b0a6-4fc6-95e2-7c3841c1e9b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8b653314-b0a6-4fc6-95e2-7c3841c1e9b9.ddcd652b-2230-44ec-a4ad-b5295ef7d30b 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:22 devstack sudo[108250]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f36a202b-711c-4fc6-ad9f-b06b80d127e9 tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ca6f5b64-a6c5-4e08-8c5f-342241009c12.40c5a5ba-49d3-440d-8441-982626ecfc44" returned: 0 in 0.368s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f36a202b-711c-4fc6-ad9f-b06b80d127e9 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ca6f5b64-a6c5-4e08-8c5f-342241009c12.40c5a5ba-49d3-440d-8441-982626ecfc44 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:22 devstack sudo[108259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8b653314-b0a6-4fc6-95e2-7c3841c1e9b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8b653314-b0a6-4fc6-95e2-7c3841c1e9b9.ddcd652b-2230-44ec-a4ad-b5295ef7d30b 1G Nov 04 12:32:22 devstack sudo[108259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:22 devstack sudo[108261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ca6f5b64-a6c5-4e08-8c5f-342241009c12.40c5a5ba-49d3-440d-8441-982626ecfc44 Nov 04 12:32:22 devstack sudo[108261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:22 devstack sudo[108261]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f36a202b-711c-4fc6-ad9f-b06b80d127e9 tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ca6f5b64-a6c5-4e08-8c5f-342241009c12.40c5a5ba-49d3-440d-8441-982626ecfc44" returned: 0 in 0.243s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:22 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f36a202b-711c-4fc6-ad9f-b06b80d127e9 tempest-ProjectMemberTests-1539753999 None] Lock "cinder-quobyte-40c5a5ba-49d3-440d-8441-982626ecfc44" released by "_delete_snapshot" :: held 1.476s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:32:22 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f36a202b-711c-4fc6-ad9f-b06b80d127e9 tempest-ProjectMemberTests-1539753999 None] Lock "cinder-quobyte-ca6f5b64-a6c5-4e08-8c5f-342241009c12" released by "delete_snapshot" :: held 1.498s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:32:22 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-f36a202b-711c-4fc6-ad9f-b06b80d127e9 tempest-ProjectMemberTests-1539753999 None] Created reservations ['37752c37-d3ab-4e3c-a7de-ec59c23a2dc6', '6430e35f-e03b-47d2-a041-30b400e168d3', 'd9ca913f-6d4a-45ef-ae43-cc3a29b8eaa6', 'd28841c8-4b92-4f15-817a-4116a670b7cb'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:32:22 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-f36a202b-711c-4fc6-ad9f-b06b80d127e9 tempest-ProjectMemberTests-1539753999 None] Delete snapshot completed successfully. Nov 04 12:32:22 devstack sudo[108259]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:22 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f36a202b-711c-4fc6-ad9f-b06b80d127e9 tempest-ProjectMemberTests-1539753999 None] Lock "cinder-40c5a5ba-49d3-440d-8441-982626ecfc44-delete_snapshot" released by "delete_snapshot" :: held 1.634s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:32:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6e32216a-f8d9-4fc0-be8e-0959fce87244 tempest-ProjectReaderTests-34452203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8b653314-b0a6-4fc6-95e2-7c3841c1e9b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8b653314-b0a6-4fc6-95e2-7c3841c1e9b9.ddcd652b-2230-44ec-a4ad-b5295ef7d30b 1G" returned: 0 in 0.423s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6e32216a-f8d9-4fc0-be8e-0959fce87244 tempest-ProjectReaderTests-34452203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b653314-b0a6-4fc6-95e2-7c3841c1e9b9 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8b653314-b0a6-4fc6-95e2-7c3841c1e9b9.ddcd652b-2230-44ec-a4ad-b5295ef7d30b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:22 devstack sudo[108267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b653314-b0a6-4fc6-95e2-7c3841c1e9b9 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8b653314-b0a6-4fc6-95e2-7c3841c1e9b9.ddcd652b-2230-44ec-a4ad-b5295ef7d30b Nov 04 12:32:22 devstack sudo[108267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:22 devstack sudo[108267]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6e32216a-f8d9-4fc0-be8e-0959fce87244 tempest-ProjectReaderTests-34452203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b653314-b0a6-4fc6-95e2-7c3841c1e9b9 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8b653314-b0a6-4fc6-95e2-7c3841c1e9b9.ddcd652b-2230-44ec-a4ad-b5295ef7d30b" returned: 0 in 0.277s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:22 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-6e32216a-f8d9-4fc0-be8e-0959fce87244 tempest-ProjectReaderTests-34452203 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8b653314-b0a6-4fc6-95e2-7c3841c1e9b9.ddcd652b-2230-44ec-a4ad-b5295ef7d30b is being set with open permissions: ugo+rw Nov 04 12:32:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6e32216a-f8d9-4fc0-be8e-0959fce87244 tempest-ProjectReaderTests-34452203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8b653314-b0a6-4fc6-95e2-7c3841c1e9b9.ddcd652b-2230-44ec-a4ad-b5295ef7d30b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:22 devstack sudo[108272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8b653314-b0a6-4fc6-95e2-7c3841c1e9b9.ddcd652b-2230-44ec-a4ad-b5295ef7d30b Nov 04 12:32:22 devstack sudo[108272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:22 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9a852c03-27fd-41e2-ac0a-1ba87200888f tempest-ProjectMemberTests-1539753999 None] Acquiring lock "cinder-ca6f5b64-a6c5-4e08-8c5f-342241009c12-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:32:22 devstack sudo[108272]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6e32216a-f8d9-4fc0-be8e-0959fce87244 tempest-ProjectReaderTests-34452203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8b653314-b0a6-4fc6-95e2-7c3841c1e9b9.ddcd652b-2230-44ec-a4ad-b5295ef7d30b" returned: 0 in 0.248s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:22 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9a852c03-27fd-41e2-ac0a-1ba87200888f tempest-ProjectMemberTests-1539753999 None] Lock "cinder-ca6f5b64-a6c5-4e08-8c5f-342241009c12-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:32:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6e32216a-f8d9-4fc0-be8e-0959fce87244 tempest-ProjectReaderTests-34452203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8b653314-b0a6-4fc6-95e2-7c3841c1e9b9.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:23 devstack sudo[108275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8b653314-b0a6-4fc6-95e2-7c3841c1e9b9.info Nov 04 12:32:23 devstack sudo[108275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:23 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9a852c03-27fd-41e2-ac0a-1ba87200888f tempest-ProjectMemberTests-1539753999 None] Acquiring lock "cinder-quobyte-ca6f5b64-a6c5-4e08-8c5f-342241009c12" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:32:23 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9a852c03-27fd-41e2-ac0a-1ba87200888f tempest-ProjectMemberTests-1539753999 None] Lock "cinder-quobyte-ca6f5b64-a6c5-4e08-8c5f-342241009c12" acquired by "delete_volume" :: waited 0.018s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:32:23 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[136eb123-beca-4c85-867d-7a35cc124edc]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:32:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9a852c03-27fd-41e2-ac0a-1ba87200888f tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ca6f5b64-a6c5-4e08-8c5f-342241009c12 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:23 devstack sudo[108277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ca6f5b64-a6c5-4e08-8c5f-342241009c12 Nov 04 12:32:23 devstack sudo[108277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:23 devstack sudo[108275]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6e32216a-f8d9-4fc0-be8e-0959fce87244 tempest-ProjectReaderTests-34452203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8b653314-b0a6-4fc6-95e2-7c3841c1e9b9.info" returned: 0 in 0.254s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:23 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-6e32216a-f8d9-4fc0-be8e-0959fce87244 tempest-ProjectReaderTests-34452203 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8b653314-b0a6-4fc6-95e2-7c3841c1e9b9.info is being set with open permissions: ugo+rw Nov 04 12:32:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6e32216a-f8d9-4fc0-be8e-0959fce87244 tempest-ProjectReaderTests-34452203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8b653314-b0a6-4fc6-95e2-7c3841c1e9b9.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:23 devstack sudo[108280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8b653314-b0a6-4fc6-95e2-7c3841c1e9b9.info Nov 04 12:32:23 devstack sudo[108280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:23 devstack sudo[108277]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9a852c03-27fd-41e2-ac0a-1ba87200888f tempest-ProjectMemberTests-1539753999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ca6f5b64-a6c5-4e08-8c5f-342241009c12" returned: 0 in 0.370s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9a852c03-27fd-41e2-ac0a-1ba87200888f tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ca6f5b64-a6c5-4e08-8c5f-342241009c12 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:23 devstack sudo[108286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ca6f5b64-a6c5-4e08-8c5f-342241009c12 Nov 04 12:32:23 devstack sudo[108286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:23 devstack sudo[108280]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6e32216a-f8d9-4fc0-be8e-0959fce87244 tempest-ProjectReaderTests-34452203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8b653314-b0a6-4fc6-95e2-7c3841c1e9b9.info" returned: 0 in 0.265s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6e32216a-f8d9-4fc0-be8e-0959fce87244 tempest-ProjectReaderTests-34452203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.984s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:32:23 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-6e32216a-f8d9-4fc0-be8e-0959fce87244 tempest-ProjectReaderTests-34452203 None] Create snapshot completed successfully Nov 04 12:32:23 devstack sudo[108286]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:23 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b6956951-772a-4c57-916d-404956052b62 tempest-ProjectReaderTests-34452203 None] Acquiring lock "cinder-ddcd652b-2230-44ec-a4ad-b5295ef7d30b-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:32:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9a852c03-27fd-41e2-ac0a-1ba87200888f tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-ca6f5b64-a6c5-4e08-8c5f-342241009c12" returned: 0 in 0.251s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:23 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9a852c03-27fd-41e2-ac0a-1ba87200888f tempest-ProjectMemberTests-1539753999 None] Lock "cinder-quobyte-ca6f5b64-a6c5-4e08-8c5f-342241009c12" released by "delete_volume" :: held 0.687s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:32:23 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b6956951-772a-4c57-916d-404956052b62 tempest-ProjectReaderTests-34452203 None] Lock "cinder-ddcd652b-2230-44ec-a4ad-b5295ef7d30b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:32:23 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b6956951-772a-4c57-916d-404956052b62 tempest-ProjectReaderTests-34452203 None] Acquiring lock "cinder-quobyte-8b653314-b0a6-4fc6-95e2-7c3841c1e9b9" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:32:23 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b6956951-772a-4c57-916d-404956052b62 tempest-ProjectReaderTests-34452203 None] Lock "cinder-quobyte-8b653314-b0a6-4fc6-95e2-7c3841c1e9b9" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:32:23 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b6956951-772a-4c57-916d-404956052b62 tempest-ProjectReaderTests-34452203 None] Acquiring lock "cinder-quobyte-ddcd652b-2230-44ec-a4ad-b5295ef7d30b" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:32:23 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b6956951-772a-4c57-916d-404956052b62 tempest-ProjectReaderTests-34452203 None] Lock "cinder-quobyte-ddcd652b-2230-44ec-a4ad-b5295ef7d30b" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:32:23 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-b6956951-772a-4c57-916d-404956052b62 tempest-ProjectReaderTests-34452203 None] Deleting offline snapshot ddcd652b-2230-44ec-a4ad-b5295ef7d30b of volume 8b653314-b0a6-4fc6-95e2-7c3841c1e9b9 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 12:32:23 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-b6956951-772a-4c57-916d-404956052b62 tempest-ProjectReaderTests-34452203 None] snapshot_file for this snap is: volume-8b653314-b0a6-4fc6-95e2-7c3841c1e9b9.ddcd652b-2230-44ec-a4ad-b5295ef7d30b {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 12:32:23 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[77947f89-c4b3-48bc-b2b8-cab341b1c825]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:32:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b6956951-772a-4c57-916d-404956052b62 tempest-ProjectReaderTests-34452203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8b653314-b0a6-4fc6-95e2-7c3841c1e9b9.ddcd652b-2230-44ec-a4ad-b5295ef7d30b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:23 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-9a852c03-27fd-41e2-ac0a-1ba87200888f tempest-ProjectMemberTests-1539753999 None] Created reservations ['78eebb0f-7a70-4bc5-b7e8-b2ed3c6f2dd1', 'bc7f6ccb-c312-4890-a87e-88e9b7a9d0df', '2a5c63ba-1e1f-4250-a1f8-58255b618b37', 'b36221b6-7c9e-42e9-a54b-e13000e80088'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:32:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9a852c03-27fd-41e2-ac0a-1ba87200888f tempest-ProjectMemberTests-1539753999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:32:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9a852c03-27fd-41e2-ac0a-1ba87200888f tempest-ProjectMemberTests-1539753999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:32:23 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9a852c03-27fd-41e2-ac0a-1ba87200888f tempest-ProjectMemberTests-1539753999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:32:23 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9a852c03-27fd-41e2-ac0a-1ba87200888f tempest-ProjectMemberTests-1539753999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:32:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9a852c03-27fd-41e2-ac0a-1ba87200888f tempest-ProjectMemberTests-1539753999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:32:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9a852c03-27fd-41e2-ac0a-1ba87200888f tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:23 devstack sudo[108290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8b653314-b0a6-4fc6-95e2-7c3841c1e9b9.ddcd652b-2230-44ec-a4ad-b5295ef7d30b Nov 04 12:32:23 devstack sudo[108290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:23 devstack sudo[108291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:32:23 devstack sudo[108291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:24 devstack sudo[108291]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9a852c03-27fd-41e2-ac0a-1ba87200888f tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.263s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:24 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-9a852c03-27fd-41e2-ac0a-1ba87200888f tempest-ProjectMemberTests-1539753999 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:32:24 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-9a852c03-27fd-41e2-ac0a-1ba87200888f tempest-ProjectMemberTests-1539753999 None] Deleted volume successfully. Nov 04 12:32:24 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9a852c03-27fd-41e2-ac0a-1ba87200888f tempest-ProjectMemberTests-1539753999 None] Lock "cinder-ca6f5b64-a6c5-4e08-8c5f-342241009c12-delete_volume" released by "delete_volume" :: held 1.223s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:32:24 devstack sudo[108290]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b6956951-772a-4c57-916d-404956052b62 tempest-ProjectReaderTests-34452203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8b653314-b0a6-4fc6-95e2-7c3841c1e9b9.ddcd652b-2230-44ec-a4ad-b5295ef7d30b" returned: 0 in 0.414s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:24 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-b6956951-772a-4c57-916d-404956052b62 tempest-ProjectReaderTests-34452203 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b653314-b0a6-4fc6-95e2-7c3841c1e9b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 12:32:24 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[33b81790-f14e-4832-a959-571a512b8828]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:32:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b6956951-772a-4c57-916d-404956052b62 tempest-ProjectReaderTests-34452203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8b653314-b0a6-4fc6-95e2-7c3841c1e9b9 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:24 devstack sudo[108303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8b653314-b0a6-4fc6-95e2-7c3841c1e9b9 Nov 04 12:32:24 devstack sudo[108303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:24 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-1106d660-d2a5-4c02-978a-2f865c168405 tempest-ProjectMemberTests-1539753999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:32:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1106d660-d2a5-4c02-978a-2f865c168405 tempest-ProjectMemberTests-1539753999 None] Flow 'volume_create_manager' (901786dc-2783-4018-a6a6-9e8a1b2b2448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:32:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1106d660-d2a5-4c02-978a-2f865c168405 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a3627da-da95-43fe-bc71-60184f151e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:32:24 devstack sudo[108303]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b6956951-772a-4c57-916d-404956052b62 tempest-ProjectReaderTests-34452203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8b653314-b0a6-4fc6-95e2-7c3841c1e9b9" returned: 0 in 0.372s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b6956951-772a-4c57-916d-404956052b62 tempest-ProjectReaderTests-34452203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8b653314-b0a6-4fc6-95e2-7c3841c1e9b9.ddcd652b-2230-44ec-a4ad-b5295ef7d30b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1106d660-d2a5-4c02-978a-2f865c168405 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a3627da-da95-43fe-bc71-60184f151e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:32:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2058765013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=374dd371-deb0-478a-aa26-f69bdf37687f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cb67397f4d04f049564f5d284f139d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:32:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:32:25Z,use_quota=True,user_id='091b86592c99419b9c07a685e7933341',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:32:24 devstack sudo[108308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8b653314-b0a6-4fc6-95e2-7c3841c1e9b9.ddcd652b-2230-44ec-a4ad-b5295ef7d30b Nov 04 12:32:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1106d660-d2a5-4c02-978a-2f865c168405 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef6e79bb-43a5-4811-8928-b68523071457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:32:24 devstack sudo[108308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1106d660-d2a5-4c02-978a-2f865c168405 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef6e79bb-43a5-4811-8928-b68523071457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:32:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1106d660-d2a5-4c02-978a-2f865c168405 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4c1a8bb-113c-4025-8e88-98b2dbcf298b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:32:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1106d660-d2a5-4c02-978a-2f865c168405 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4c1a8bb-113c-4025-8e88-98b2dbcf298b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '374dd371-deb0-478a-aa26-f69bdf37687f', 'volume_name': 'volume-374dd371-deb0-478a-aa26-f69bdf37687f', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:32:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1106d660-d2a5-4c02-978a-2f865c168405 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39af5326-2e67-476e-a249-ca2a3760b332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:32:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1106d660-d2a5-4c02-978a-2f865c168405 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39af5326-2e67-476e-a249-ca2a3760b332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:32:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1106d660-d2a5-4c02-978a-2f865c168405 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17d8a68c-4804-4491-a497-a9389e865e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:32:24 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-1106d660-d2a5-4c02-978a-2f865c168405 tempest-ProjectMemberTests-1539753999 None] Volume 374dd371-deb0-478a-aa26-f69bdf37687f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-374dd371-deb0-478a-aa26-f69bdf37687f', 'volume_size': 1} Nov 04 12:32:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1106d660-d2a5-4c02-978a-2f865c168405 tempest-ProjectMemberTests-1539753999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:32:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1106d660-d2a5-4c02-978a-2f865c168405 tempest-ProjectMemberTests-1539753999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:32:24 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1106d660-d2a5-4c02-978a-2f865c168405 tempest-ProjectMemberTests-1539753999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:32:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2058765013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=374dd371-deb0-478a-aa26-f69bdf37687f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cb67397f4d04f049564f5d284f139d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:32:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:32:25Z,use_quota=True,user_id='091b86592c99419b9c07a685e7933341',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:32:24 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-1106d660-d2a5-4c02-978a-2f865c168405 tempest-ProjectMemberTests-1539753999 None] Creating volume 374dd371-deb0-478a-aa26-f69bdf37687f {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:32:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1106d660-d2a5-4c02-978a-2f865c168405 tempest-ProjectMemberTests-1539753999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:32:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1106d660-d2a5-4c02-978a-2f865c168405 tempest-ProjectMemberTests-1539753999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:32:24 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1106d660-d2a5-4c02-978a-2f865c168405 tempest-ProjectMemberTests-1539753999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:32:24 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1106d660-d2a5-4c02-978a-2f865c168405 tempest-ProjectMemberTests-1539753999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:32:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1106d660-d2a5-4c02-978a-2f865c168405 tempest-ProjectMemberTests-1539753999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:32:24 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1106d660-d2a5-4c02-978a-2f865c168405 tempest-ProjectMemberTests-1539753999 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:32:24 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-1106d660-d2a5-4c02-978a-2f865c168405 tempest-ProjectMemberTests-1539753999 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:32:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1106d660-d2a5-4c02-978a-2f865c168405 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-374dd371-deb0-478a-aa26-f69bdf37687f 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:24 devstack sudo[108310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-374dd371-deb0-478a-aa26-f69bdf37687f 1073741824 Nov 04 12:32:24 devstack sudo[108310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:24 devstack sudo[108308]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b6956951-772a-4c57-916d-404956052b62 tempest-ProjectReaderTests-34452203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8b653314-b0a6-4fc6-95e2-7c3841c1e9b9.ddcd652b-2230-44ec-a4ad-b5295ef7d30b" returned: 0 in 0.340s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b6956951-772a-4c57-916d-404956052b62 tempest-ProjectReaderTests-34452203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8b653314-b0a6-4fc6-95e2-7c3841c1e9b9.ddcd652b-2230-44ec-a4ad-b5295ef7d30b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:24 devstack sudo[108318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8b653314-b0a6-4fc6-95e2-7c3841c1e9b9.ddcd652b-2230-44ec-a4ad-b5295ef7d30b Nov 04 12:32:24 devstack sudo[108318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:25 devstack sudo[108310]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1106d660-d2a5-4c02-978a-2f865c168405 tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-374dd371-deb0-478a-aa26-f69bdf37687f 1073741824" returned: 0 in 0.413s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1106d660-d2a5-4c02-978a-2f865c168405 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-374dd371-deb0-478a-aa26-f69bdf37687f {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:25 devstack sudo[108320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-374dd371-deb0-478a-aa26-f69bdf37687f Nov 04 12:32:25 devstack sudo[108320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:25 devstack sudo[108318]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b6956951-772a-4c57-916d-404956052b62 tempest-ProjectReaderTests-34452203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8b653314-b0a6-4fc6-95e2-7c3841c1e9b9.ddcd652b-2230-44ec-a4ad-b5295ef7d30b" returned: 0 in 0.266s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:25 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b6956951-772a-4c57-916d-404956052b62 tempest-ProjectReaderTests-34452203 None] Lock "cinder-quobyte-ddcd652b-2230-44ec-a4ad-b5295ef7d30b" released by "_delete_snapshot" :: held 1.492s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:32:25 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b6956951-772a-4c57-916d-404956052b62 tempest-ProjectReaderTests-34452203 None] Lock "cinder-quobyte-8b653314-b0a6-4fc6-95e2-7c3841c1e9b9" released by "delete_snapshot" :: held 1.520s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:32:25 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=189,cinder:UPDATE=238,cinder:DELETE=19,cinder:INSERT=63 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 12:32:25 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=187,cinder:INSERT=68,cinder:UPDATE=255,cinder:DELETE=23 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 12:32:25 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-b6956951-772a-4c57-916d-404956052b62 tempest-ProjectReaderTests-34452203 None] Created reservations ['2b18dce9-439c-4653-a724-c81e2b28bd88', '4b4ef062-82eb-4535-8fd7-d50be2eb4a7a', '00aba6f2-4902-4428-a8c1-aa169df8d4da', '9d9d3c72-e8db-4221-a347-9d547b7e1f1c'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:32:25 devstack sudo[108320]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1106d660-d2a5-4c02-978a-2f865c168405 tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-374dd371-deb0-478a-aa26-f69bdf37687f" returned: 0 in 0.251s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:25 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1106d660-d2a5-4c02-978a-2f865c168405 tempest-ProjectMemberTests-1539753999 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:32:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1106d660-d2a5-4c02-978a-2f865c168405 tempest-ProjectMemberTests-1539753999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:32:25 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-b6956951-772a-4c57-916d-404956052b62 tempest-ProjectReaderTests-34452203 None] Delete snapshot completed successfully. Nov 04 12:32:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1106d660-d2a5-4c02-978a-2f865c168405 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17d8a68c-4804-4491-a497-a9389e865e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-374dd371-deb0-478a-aa26-f69bdf37687f', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:32:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1106d660-d2a5-4c02-978a-2f865c168405 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32104497-0a32-4f05-a3be-28c98ed3cce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:32:25 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b6956951-772a-4c57-916d-404956052b62 tempest-ProjectReaderTests-34452203 None] Lock "cinder-ddcd652b-2230-44ec-a4ad-b5295ef7d30b-delete_snapshot" released by "delete_snapshot" :: held 1.687s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:32:25 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-1106d660-d2a5-4c02-978a-2f865c168405 tempest-ProjectMemberTests-1539753999 None] Volume volume-374dd371-deb0-478a-aa26-f69bdf37687f (374dd371-deb0-478a-aa26-f69bdf37687f): created successfully Nov 04 12:32:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1106d660-d2a5-4c02-978a-2f865c168405 tempest-ProjectMemberTests-1539753999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32104497-0a32-4f05-a3be-28c98ed3cce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:32:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1106d660-d2a5-4c02-978a-2f865c168405 tempest-ProjectMemberTests-1539753999 None] Flow 'volume_create_manager' (901786dc-2783-4018-a6a6-9e8a1b2b2448) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:32:25 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-1106d660-d2a5-4c02-978a-2f865c168405 tempest-ProjectMemberTests-1539753999 None] Created volume successfully. Nov 04 12:32:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b7e5be3e-0614-4aa6-a1f9-d45101044698 tempest-ProjectMemberTests-1539753999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:32:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b7e5be3e-0614-4aa6-a1f9-d45101044698 tempest-ProjectMemberTests-1539753999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:32:25 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-b7e5be3e-0614-4aa6-a1f9-d45101044698 tempest-ProjectMemberTests-1539753999 None] Creating offline snapshot e2e4c7ec-0b21-4c94-8bde-4564adf7904e of volume 374dd371-deb0-478a-aa26-f69bdf37687f {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 12:32:25 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[07bb5a43-b418-4fd8-b174-ab31dbe1741b]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:32:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b7e5be3e-0614-4aa6-a1f9-d45101044698 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-374dd371-deb0-478a-aa26-f69bdf37687f {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:25 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c8f8af73-aef9-4868-9c36-d301dd4bb4ca tempest-ProjectReaderTests-34452203 None] Acquiring lock "cinder-8b653314-b0a6-4fc6-95e2-7c3841c1e9b9-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:32:25 devstack sudo[108324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-374dd371-deb0-478a-aa26-f69bdf37687f Nov 04 12:32:25 devstack sudo[108324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:25 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c8f8af73-aef9-4868-9c36-d301dd4bb4ca tempest-ProjectReaderTests-34452203 None] Lock "cinder-8b653314-b0a6-4fc6-95e2-7c3841c1e9b9-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:32:25 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c8f8af73-aef9-4868-9c36-d301dd4bb4ca tempest-ProjectReaderTests-34452203 None] Acquiring lock "cinder-quobyte-8b653314-b0a6-4fc6-95e2-7c3841c1e9b9" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:32:25 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c8f8af73-aef9-4868-9c36-d301dd4bb4ca tempest-ProjectReaderTests-34452203 None] Lock "cinder-quobyte-8b653314-b0a6-4fc6-95e2-7c3841c1e9b9" acquired by "delete_volume" :: waited 0.016s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:32:25 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0044d492-99c5-44e1-bce3-1e9a7dfabd85]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:32:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c8f8af73-aef9-4868-9c36-d301dd4bb4ca tempest-ProjectReaderTests-34452203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8b653314-b0a6-4fc6-95e2-7c3841c1e9b9 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:26 devstack sudo[108326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8b653314-b0a6-4fc6-95e2-7c3841c1e9b9 Nov 04 12:32:26 devstack sudo[108326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:26 devstack sudo[108324]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b7e5be3e-0614-4aa6-a1f9-d45101044698 tempest-ProjectMemberTests-1539753999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-374dd371-deb0-478a-aa26-f69bdf37687f" returned: 0 in 0.388s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b7e5be3e-0614-4aa6-a1f9-d45101044698 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-374dd371-deb0-478a-aa26-f69bdf37687f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-374dd371-deb0-478a-aa26-f69bdf37687f.e2e4c7ec-0b21-4c94-8bde-4564adf7904e 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:26 devstack sudo[108331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-374dd371-deb0-478a-aa26-f69bdf37687f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-374dd371-deb0-478a-aa26-f69bdf37687f.e2e4c7ec-0b21-4c94-8bde-4564adf7904e 1G Nov 04 12:32:26 devstack sudo[108331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:26 devstack sudo[108326]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c8f8af73-aef9-4868-9c36-d301dd4bb4ca tempest-ProjectReaderTests-34452203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8b653314-b0a6-4fc6-95e2-7c3841c1e9b9" returned: 0 in 0.364s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c8f8af73-aef9-4868-9c36-d301dd4bb4ca tempest-ProjectReaderTests-34452203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8b653314-b0a6-4fc6-95e2-7c3841c1e9b9 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:26 devstack sudo[108337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8b653314-b0a6-4fc6-95e2-7c3841c1e9b9 Nov 04 12:32:26 devstack sudo[108337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:26 devstack sudo[108331]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b7e5be3e-0614-4aa6-a1f9-d45101044698 tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-374dd371-deb0-478a-aa26-f69bdf37687f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-374dd371-deb0-478a-aa26-f69bdf37687f.e2e4c7ec-0b21-4c94-8bde-4564adf7904e 1G" returned: 0 in 0.397s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b7e5be3e-0614-4aa6-a1f9-d45101044698 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-374dd371-deb0-478a-aa26-f69bdf37687f -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-374dd371-deb0-478a-aa26-f69bdf37687f.e2e4c7ec-0b21-4c94-8bde-4564adf7904e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:26 devstack sudo[108341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-374dd371-deb0-478a-aa26-f69bdf37687f -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-374dd371-deb0-478a-aa26-f69bdf37687f.e2e4c7ec-0b21-4c94-8bde-4564adf7904e Nov 04 12:32:26 devstack sudo[108341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:26 devstack sudo[108337]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c8f8af73-aef9-4868-9c36-d301dd4bb4ca tempest-ProjectReaderTests-34452203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-8b653314-b0a6-4fc6-95e2-7c3841c1e9b9" returned: 0 in 0.280s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:26 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c8f8af73-aef9-4868-9c36-d301dd4bb4ca tempest-ProjectReaderTests-34452203 None] Lock "cinder-quobyte-8b653314-b0a6-4fc6-95e2-7c3841c1e9b9" released by "delete_volume" :: held 0.710s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:32:26 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-c8f8af73-aef9-4868-9c36-d301dd4bb4ca tempest-ProjectReaderTests-34452203 None] Created reservations ['e7429dc8-9f5b-4571-a605-491837d2579c', '2749e806-4f29-48ed-be16-f58476957787', 'c96c1902-6a3d-4e3c-878a-f22b9f3a86f9', 'be74e1d7-0d52-4082-a6b3-d52d0a659078'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:32:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c8f8af73-aef9-4868-9c36-d301dd4bb4ca tempest-ProjectReaderTests-34452203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:32:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c8f8af73-aef9-4868-9c36-d301dd4bb4ca tempest-ProjectReaderTests-34452203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:32:26 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c8f8af73-aef9-4868-9c36-d301dd4bb4ca tempest-ProjectReaderTests-34452203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:32:26 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c8f8af73-aef9-4868-9c36-d301dd4bb4ca tempest-ProjectReaderTests-34452203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:32:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c8f8af73-aef9-4868-9c36-d301dd4bb4ca tempest-ProjectReaderTests-34452203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:32:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c8f8af73-aef9-4868-9c36-d301dd4bb4ca tempest-ProjectReaderTests-34452203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:26 devstack sudo[108346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:32:26 devstack sudo[108346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:26 devstack sudo[108341]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b7e5be3e-0614-4aa6-a1f9-d45101044698 tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-374dd371-deb0-478a-aa26-f69bdf37687f -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-374dd371-deb0-478a-aa26-f69bdf37687f.e2e4c7ec-0b21-4c94-8bde-4564adf7904e" returned: 0 in 0.315s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:26 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-b7e5be3e-0614-4aa6-a1f9-d45101044698 tempest-ProjectMemberTests-1539753999 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-374dd371-deb0-478a-aa26-f69bdf37687f.e2e4c7ec-0b21-4c94-8bde-4564adf7904e is being set with open permissions: ugo+rw Nov 04 12:32:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b7e5be3e-0614-4aa6-a1f9-d45101044698 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-374dd371-deb0-478a-aa26-f69bdf37687f.e2e4c7ec-0b21-4c94-8bde-4564adf7904e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:26 devstack sudo[108349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-374dd371-deb0-478a-aa26-f69bdf37687f.e2e4c7ec-0b21-4c94-8bde-4564adf7904e Nov 04 12:32:26 devstack sudo[108349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:27 devstack sudo[108346]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c8f8af73-aef9-4868-9c36-d301dd4bb4ca tempest-ProjectReaderTests-34452203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.276s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:27 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-c8f8af73-aef9-4868-9c36-d301dd4bb4ca tempest-ProjectReaderTests-34452203 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:32:27 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-c8f8af73-aef9-4868-9c36-d301dd4bb4ca tempest-ProjectReaderTests-34452203 None] Deleted volume successfully. Nov 04 12:32:27 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c8f8af73-aef9-4868-9c36-d301dd4bb4ca tempest-ProjectReaderTests-34452203 None] Lock "cinder-8b653314-b0a6-4fc6-95e2-7c3841c1e9b9-delete_volume" released by "delete_volume" :: held 1.197s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:32:27 devstack sudo[108349]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b7e5be3e-0614-4aa6-a1f9-d45101044698 tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-374dd371-deb0-478a-aa26-f69bdf37687f.e2e4c7ec-0b21-4c94-8bde-4564adf7904e" returned: 0 in 0.269s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b7e5be3e-0614-4aa6-a1f9-d45101044698 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-374dd371-deb0-478a-aa26-f69bdf37687f.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:27 devstack sudo[108353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-374dd371-deb0-478a-aa26-f69bdf37687f.info Nov 04 12:32:27 devstack sudo[108353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:27 devstack sudo[108353]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b7e5be3e-0614-4aa6-a1f9-d45101044698 tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-374dd371-deb0-478a-aa26-f69bdf37687f.info" returned: 0 in 0.261s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:27 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-b7e5be3e-0614-4aa6-a1f9-d45101044698 tempest-ProjectMemberTests-1539753999 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-374dd371-deb0-478a-aa26-f69bdf37687f.info is being set with open permissions: ugo+rw Nov 04 12:32:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b7e5be3e-0614-4aa6-a1f9-d45101044698 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-374dd371-deb0-478a-aa26-f69bdf37687f.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:27 devstack sudo[108356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-374dd371-deb0-478a-aa26-f69bdf37687f.info Nov 04 12:32:27 devstack sudo[108356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:27 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-12ee7d2d-faf4-441f-9851-9e4e7276b1df tempest-ProjectReaderTests-34452203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:32:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-12ee7d2d-faf4-441f-9851-9e4e7276b1df tempest-ProjectReaderTests-34452203 None] Flow 'volume_create_manager' (d33008ac-5458-4582-9b51-fdb49f03a4cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:32:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-12ee7d2d-faf4-441f-9851-9e4e7276b1df tempest-ProjectReaderTests-34452203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b05a1f1-894b-4551-b0fd-b50386e9b3c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:32:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-12ee7d2d-faf4-441f-9851-9e4e7276b1df tempest-ProjectReaderTests-34452203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b05a1f1-894b-4551-b0fd-b50386e9b3c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-614541233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9944c28-8743-4f51-897c-0ac25b879940,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb954983f7c64fe388fdbeaf1cdc0a5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:32:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:32:27Z,use_quota=True,user_id='f3d9809a097943a5b1cd27d05f8ff1ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:32:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-12ee7d2d-faf4-441f-9851-9e4e7276b1df tempest-ProjectReaderTests-34452203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9005229-5130-4ffd-bb00-320118b6e92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:32:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-12ee7d2d-faf4-441f-9851-9e4e7276b1df tempest-ProjectReaderTests-34452203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9005229-5130-4ffd-bb00-320118b6e92a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:32:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-12ee7d2d-faf4-441f-9851-9e4e7276b1df tempest-ProjectReaderTests-34452203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87b92166-7dc7-4239-9c73-7ab06c4f86ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:32:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-12ee7d2d-faf4-441f-9851-9e4e7276b1df tempest-ProjectReaderTests-34452203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87b92166-7dc7-4239-9c73-7ab06c4f86ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9944c28-8743-4f51-897c-0ac25b879940', 'volume_name': 'volume-a9944c28-8743-4f51-897c-0ac25b879940', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:32:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-12ee7d2d-faf4-441f-9851-9e4e7276b1df tempest-ProjectReaderTests-34452203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d25df2b1-dc66-4c9c-944b-44a9dcb4d267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:32:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-12ee7d2d-faf4-441f-9851-9e4e7276b1df tempest-ProjectReaderTests-34452203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d25df2b1-dc66-4c9c-944b-44a9dcb4d267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:32:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-12ee7d2d-faf4-441f-9851-9e4e7276b1df tempest-ProjectReaderTests-34452203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c8adde4-0f52-4822-9629-f4dc1d09c38b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:32:27 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-12ee7d2d-faf4-441f-9851-9e4e7276b1df tempest-ProjectReaderTests-34452203 None] Volume a9944c28-8743-4f51-897c-0ac25b879940: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9944c28-8743-4f51-897c-0ac25b879940', 'volume_size': 1} Nov 04 12:32:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-12ee7d2d-faf4-441f-9851-9e4e7276b1df tempest-ProjectReaderTests-34452203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:32:27 devstack sudo[108356]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b7e5be3e-0614-4aa6-a1f9-d45101044698 tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-374dd371-deb0-478a-aa26-f69bdf37687f.info" returned: 0 in 0.250s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b7e5be3e-0614-4aa6-a1f9-d45101044698 tempest-ProjectMemberTests-1539753999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.962s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:32:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-12ee7d2d-faf4-441f-9851-9e4e7276b1df tempest-ProjectReaderTests-34452203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.101s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:32:27 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-12ee7d2d-faf4-441f-9851-9e4e7276b1df tempest-ProjectReaderTests-34452203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-614541233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9944c28-8743-4f51-897c-0ac25b879940,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb954983f7c64fe388fdbeaf1cdc0a5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:32:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:32:27Z,use_quota=True,user_id='f3d9809a097943a5b1cd27d05f8ff1ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:32:27 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-12ee7d2d-faf4-441f-9851-9e4e7276b1df tempest-ProjectReaderTests-34452203 None] Creating volume a9944c28-8743-4f51-897c-0ac25b879940 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:32:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-12ee7d2d-faf4-441f-9851-9e4e7276b1df tempest-ProjectReaderTests-34452203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:32:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-12ee7d2d-faf4-441f-9851-9e4e7276b1df tempest-ProjectReaderTests-34452203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:32:27 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-12ee7d2d-faf4-441f-9851-9e4e7276b1df tempest-ProjectReaderTests-34452203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:32:27 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-12ee7d2d-faf4-441f-9851-9e4e7276b1df tempest-ProjectReaderTests-34452203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:32:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-12ee7d2d-faf4-441f-9851-9e4e7276b1df tempest-ProjectReaderTests-34452203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:32:27 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-12ee7d2d-faf4-441f-9851-9e4e7276b1df tempest-ProjectReaderTests-34452203 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:32:27 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-12ee7d2d-faf4-441f-9851-9e4e7276b1df tempest-ProjectReaderTests-34452203 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:32:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-12ee7d2d-faf4-441f-9851-9e4e7276b1df tempest-ProjectReaderTests-34452203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a9944c28-8743-4f51-897c-0ac25b879940 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:27 devstack sudo[108359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a9944c28-8743-4f51-897c-0ac25b879940 1073741824 Nov 04 12:32:27 devstack sudo[108359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:27 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-b7e5be3e-0614-4aa6-a1f9-d45101044698 tempest-ProjectMemberTests-1539753999 None] Create snapshot completed successfully Nov 04 12:32:27 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-59392f1b-ed07-4af9-8a86-ff77df04e174 tempest-ProjectMemberTests-1539753999 None] Acquiring lock "cinder-e2e4c7ec-0b21-4c94-8bde-4564adf7904e-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:32:27 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-59392f1b-ed07-4af9-8a86-ff77df04e174 tempest-ProjectMemberTests-1539753999 None] Lock "cinder-e2e4c7ec-0b21-4c94-8bde-4564adf7904e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:32:27 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-59392f1b-ed07-4af9-8a86-ff77df04e174 tempest-ProjectMemberTests-1539753999 None] Acquiring lock "cinder-quobyte-374dd371-deb0-478a-aa26-f69bdf37687f" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:32:28 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-59392f1b-ed07-4af9-8a86-ff77df04e174 tempest-ProjectMemberTests-1539753999 None] Lock "cinder-quobyte-374dd371-deb0-478a-aa26-f69bdf37687f" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:32:28 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-59392f1b-ed07-4af9-8a86-ff77df04e174 tempest-ProjectMemberTests-1539753999 None] Acquiring lock "cinder-quobyte-e2e4c7ec-0b21-4c94-8bde-4564adf7904e" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:32:28 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-59392f1b-ed07-4af9-8a86-ff77df04e174 tempest-ProjectMemberTests-1539753999 None] Lock "cinder-quobyte-e2e4c7ec-0b21-4c94-8bde-4564adf7904e" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:32:28 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-59392f1b-ed07-4af9-8a86-ff77df04e174 tempest-ProjectMemberTests-1539753999 None] Deleting offline snapshot e2e4c7ec-0b21-4c94-8bde-4564adf7904e of volume 374dd371-deb0-478a-aa26-f69bdf37687f {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 12:32:28 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-59392f1b-ed07-4af9-8a86-ff77df04e174 tempest-ProjectMemberTests-1539753999 None] snapshot_file for this snap is: volume-374dd371-deb0-478a-aa26-f69bdf37687f.e2e4c7ec-0b21-4c94-8bde-4564adf7904e {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 12:32:28 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[49898d56-9eeb-4cdd-a1fb-e9338d268f6b]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:32:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-59392f1b-ed07-4af9-8a86-ff77df04e174 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-374dd371-deb0-478a-aa26-f69bdf37687f.e2e4c7ec-0b21-4c94-8bde-4564adf7904e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:28 devstack sudo[108364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-374dd371-deb0-478a-aa26-f69bdf37687f.e2e4c7ec-0b21-4c94-8bde-4564adf7904e Nov 04 12:32:28 devstack sudo[108359]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:28 devstack sudo[108364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-12ee7d2d-faf4-441f-9851-9e4e7276b1df tempest-ProjectReaderTests-34452203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a9944c28-8743-4f51-897c-0ac25b879940 1073741824" returned: 0 in 0.490s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-12ee7d2d-faf4-441f-9851-9e4e7276b1df tempest-ProjectReaderTests-34452203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a9944c28-8743-4f51-897c-0ac25b879940 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:28 devstack sudo[108367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a9944c28-8743-4f51-897c-0ac25b879940 Nov 04 12:32:28 devstack sudo[108367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:28 devstack sudo[108364]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-59392f1b-ed07-4af9-8a86-ff77df04e174 tempest-ProjectMemberTests-1539753999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-374dd371-deb0-478a-aa26-f69bdf37687f.e2e4c7ec-0b21-4c94-8bde-4564adf7904e" returned: 0 in 0.389s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:28 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-59392f1b-ed07-4af9-8a86-ff77df04e174 tempest-ProjectMemberTests-1539753999 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-374dd371-deb0-478a-aa26-f69bdf37687f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 12:32:28 devstack sudo[108367]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-12ee7d2d-faf4-441f-9851-9e4e7276b1df tempest-ProjectReaderTests-34452203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a9944c28-8743-4f51-897c-0ac25b879940" returned: 0 in 0.268s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:28 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-12ee7d2d-faf4-441f-9851-9e4e7276b1df tempest-ProjectReaderTests-34452203 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:32:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-12ee7d2d-faf4-441f-9851-9e4e7276b1df tempest-ProjectReaderTests-34452203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:32:28 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf30c9b8-b2ac-4ed1-b456-666dd46a9e88]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:32:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-59392f1b-ed07-4af9-8a86-ff77df04e174 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-374dd371-deb0-478a-aa26-f69bdf37687f {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:28 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-12ee7d2d-faf4-441f-9851-9e4e7276b1df tempest-ProjectReaderTests-34452203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c8adde4-0f52-4822-9629-f4dc1d09c38b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9944c28-8743-4f51-897c-0ac25b879940', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:32:28 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-12ee7d2d-faf4-441f-9851-9e4e7276b1df tempest-ProjectReaderTests-34452203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e73fd042-ccce-4f4d-b8bc-e60e2255d227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:32:28 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-12ee7d2d-faf4-441f-9851-9e4e7276b1df tempest-ProjectReaderTests-34452203 None] Volume volume-a9944c28-8743-4f51-897c-0ac25b879940 (a9944c28-8743-4f51-897c-0ac25b879940): created successfully Nov 04 12:32:28 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-12ee7d2d-faf4-441f-9851-9e4e7276b1df tempest-ProjectReaderTests-34452203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e73fd042-ccce-4f4d-b8bc-e60e2255d227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:32:28 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-12ee7d2d-faf4-441f-9851-9e4e7276b1df tempest-ProjectReaderTests-34452203 None] Flow 'volume_create_manager' (d33008ac-5458-4582-9b51-fdb49f03a4cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:32:28 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-12ee7d2d-faf4-441f-9851-9e4e7276b1df tempest-ProjectReaderTests-34452203 None] Created volume successfully. Nov 04 12:32:28 devstack sudo[108374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-374dd371-deb0-478a-aa26-f69bdf37687f Nov 04 12:32:28 devstack sudo[108374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:28 devstack sudo[108374]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-59392f1b-ed07-4af9-8a86-ff77df04e174 tempest-ProjectMemberTests-1539753999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-374dd371-deb0-478a-aa26-f69bdf37687f" returned: 0 in 0.353s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-59392f1b-ed07-4af9-8a86-ff77df04e174 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-374dd371-deb0-478a-aa26-f69bdf37687f.e2e4c7ec-0b21-4c94-8bde-4564adf7904e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:28 devstack sudo[108385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-374dd371-deb0-478a-aa26-f69bdf37687f.e2e4c7ec-0b21-4c94-8bde-4564adf7904e Nov 04 12:32:28 devstack sudo[108385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:29 devstack sudo[108385]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-59392f1b-ed07-4af9-8a86-ff77df04e174 tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-374dd371-deb0-478a-aa26-f69bdf37687f.e2e4c7ec-0b21-4c94-8bde-4564adf7904e" returned: 0 in 0.338s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-59392f1b-ed07-4af9-8a86-ff77df04e174 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-374dd371-deb0-478a-aa26-f69bdf37687f.e2e4c7ec-0b21-4c94-8bde-4564adf7904e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:29 devstack sudo[108390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-374dd371-deb0-478a-aa26-f69bdf37687f.e2e4c7ec-0b21-4c94-8bde-4564adf7904e Nov 04 12:32:29 devstack sudo[108390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:29 devstack sudo[108390]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-59392f1b-ed07-4af9-8a86-ff77df04e174 tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-374dd371-deb0-478a-aa26-f69bdf37687f.e2e4c7ec-0b21-4c94-8bde-4564adf7904e" returned: 0 in 0.249s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:29 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-59392f1b-ed07-4af9-8a86-ff77df04e174 tempest-ProjectMemberTests-1539753999 None] Lock "cinder-quobyte-e2e4c7ec-0b21-4c94-8bde-4564adf7904e" released by "_delete_snapshot" :: held 1.432s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:32:29 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-59392f1b-ed07-4af9-8a86-ff77df04e174 tempest-ProjectMemberTests-1539753999 None] Lock "cinder-quobyte-374dd371-deb0-478a-aa26-f69bdf37687f" released by "delete_snapshot" :: held 1.458s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:32:29 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-59392f1b-ed07-4af9-8a86-ff77df04e174 tempest-ProjectMemberTests-1539753999 None] Created reservations ['7efb1f75-ccc0-4907-9f7e-63e689f7dd3f', 'c6ef3aea-8159-417a-8141-c4839dc99f1b', 'a585fee1-29ae-47f0-b603-069c27bb05d9', '17271190-d3e0-4213-b9f3-9ac0d4ab1786'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:32:29 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-59392f1b-ed07-4af9-8a86-ff77df04e174 tempest-ProjectMemberTests-1539753999 None] Delete snapshot completed successfully. Nov 04 12:32:29 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-59392f1b-ed07-4af9-8a86-ff77df04e174 tempest-ProjectMemberTests-1539753999 None] Lock "cinder-e2e4c7ec-0b21-4c94-8bde-4564adf7904e-delete_snapshot" released by "delete_snapshot" :: held 1.623s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:32:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-17fdcddc-311a-4012-9963-999c135ff11e tempest-ProjectReaderTests-34452203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:32:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-17fdcddc-311a-4012-9963-999c135ff11e tempest-ProjectReaderTests-34452203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:32:29 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-17fdcddc-311a-4012-9963-999c135ff11e tempest-ProjectReaderTests-34452203 None] Creating offline snapshot 68b5b65f-4207-418a-b9f7-9af76467e761 of volume a9944c28-8743-4f51-897c-0ac25b879940 {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 12:32:29 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cce7d05-2546-4cb1-9890-fd2573491fe8]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:32:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-17fdcddc-311a-4012-9963-999c135ff11e tempest-ProjectReaderTests-34452203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a9944c28-8743-4f51-897c-0ac25b879940 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:29 devstack sudo[108393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a9944c28-8743-4f51-897c-0ac25b879940 Nov 04 12:32:29 devstack sudo[108393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:30 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-30f271aa-31af-45da-b9d6-cafda4c56656 tempest-ProjectMemberTests-1539753999 None] Acquiring lock "cinder-374dd371-deb0-478a-aa26-f69bdf37687f-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:32:30 devstack sudo[108393]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-17fdcddc-311a-4012-9963-999c135ff11e tempest-ProjectReaderTests-34452203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a9944c28-8743-4f51-897c-0ac25b879940" returned: 0 in 0.361s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-17fdcddc-311a-4012-9963-999c135ff11e tempest-ProjectReaderTests-34452203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a9944c28-8743-4f51-897c-0ac25b879940,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a9944c28-8743-4f51-897c-0ac25b879940.68b5b65f-4207-418a-b9f7-9af76467e761 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:30 devstack sudo[108398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a9944c28-8743-4f51-897c-0ac25b879940,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a9944c28-8743-4f51-897c-0ac25b879940.68b5b65f-4207-418a-b9f7-9af76467e761 1G Nov 04 12:32:30 devstack sudo[108398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:30 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-30f271aa-31af-45da-b9d6-cafda4c56656 tempest-ProjectMemberTests-1539753999 None] Lock "cinder-374dd371-deb0-478a-aa26-f69bdf37687f-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:32:30 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-30f271aa-31af-45da-b9d6-cafda4c56656 tempest-ProjectMemberTests-1539753999 None] Acquiring lock "cinder-quobyte-374dd371-deb0-478a-aa26-f69bdf37687f" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:32:30 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-30f271aa-31af-45da-b9d6-cafda4c56656 tempest-ProjectMemberTests-1539753999 None] Lock "cinder-quobyte-374dd371-deb0-478a-aa26-f69bdf37687f" acquired by "delete_volume" :: waited 0.017s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:32:30 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b5d06a7-f51c-4219-841c-052226190664]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:32:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-30f271aa-31af-45da-b9d6-cafda4c56656 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-374dd371-deb0-478a-aa26-f69bdf37687f {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:30 devstack sudo[108400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-374dd371-deb0-478a-aa26-f69bdf37687f Nov 04 12:32:30 devstack sudo[108400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:30 devstack sudo[108398]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-17fdcddc-311a-4012-9963-999c135ff11e tempest-ProjectReaderTests-34452203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a9944c28-8743-4f51-897c-0ac25b879940,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a9944c28-8743-4f51-897c-0ac25b879940.68b5b65f-4207-418a-b9f7-9af76467e761 1G" returned: 0 in 0.399s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-17fdcddc-311a-4012-9963-999c135ff11e tempest-ProjectReaderTests-34452203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9944c28-8743-4f51-897c-0ac25b879940 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a9944c28-8743-4f51-897c-0ac25b879940.68b5b65f-4207-418a-b9f7-9af76467e761 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:30 devstack sudo[108405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9944c28-8743-4f51-897c-0ac25b879940 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a9944c28-8743-4f51-897c-0ac25b879940.68b5b65f-4207-418a-b9f7-9af76467e761 Nov 04 12:32:30 devstack sudo[108405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:30 devstack sudo[108400]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-30f271aa-31af-45da-b9d6-cafda4c56656 tempest-ProjectMemberTests-1539753999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-374dd371-deb0-478a-aa26-f69bdf37687f" returned: 0 in 0.371s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-30f271aa-31af-45da-b9d6-cafda4c56656 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-374dd371-deb0-478a-aa26-f69bdf37687f {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:30 devstack sudo[108410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-374dd371-deb0-478a-aa26-f69bdf37687f Nov 04 12:32:30 devstack sudo[108410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:30 devstack sudo[108405]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-17fdcddc-311a-4012-9963-999c135ff11e tempest-ProjectReaderTests-34452203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9944c28-8743-4f51-897c-0ac25b879940 -F qcow2 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a9944c28-8743-4f51-897c-0ac25b879940.68b5b65f-4207-418a-b9f7-9af76467e761" returned: 0 in 0.301s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:30 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-17fdcddc-311a-4012-9963-999c135ff11e tempest-ProjectReaderTests-34452203 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a9944c28-8743-4f51-897c-0ac25b879940.68b5b65f-4207-418a-b9f7-9af76467e761 is being set with open permissions: ugo+rw Nov 04 12:32:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-17fdcddc-311a-4012-9963-999c135ff11e tempest-ProjectReaderTests-34452203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a9944c28-8743-4f51-897c-0ac25b879940.68b5b65f-4207-418a-b9f7-9af76467e761 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:30 devstack sudo[108415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a9944c28-8743-4f51-897c-0ac25b879940.68b5b65f-4207-418a-b9f7-9af76467e761 Nov 04 12:32:30 devstack sudo[108415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:30 devstack sudo[108410]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-30f271aa-31af-45da-b9d6-cafda4c56656 tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-374dd371-deb0-478a-aa26-f69bdf37687f" returned: 0 in 0.267s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:30 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-30f271aa-31af-45da-b9d6-cafda4c56656 tempest-ProjectMemberTests-1539753999 None] Lock "cinder-quobyte-374dd371-deb0-478a-aa26-f69bdf37687f" released by "delete_volume" :: held 0.713s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:32:31 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-30f271aa-31af-45da-b9d6-cafda4c56656 tempest-ProjectMemberTests-1539753999 None] Created reservations ['0d51e7bc-3df8-400b-9805-8fb5fa37f405', 'c0fae364-71e2-4e64-aedb-4cb1b6435d66', 'fb8f3811-9186-4e6f-9b09-bed59ee8bf2a', '72db540d-68fd-4ec3-b531-70cf790b78d6'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:32:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-30f271aa-31af-45da-b9d6-cafda4c56656 tempest-ProjectMemberTests-1539753999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:32:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-30f271aa-31af-45da-b9d6-cafda4c56656 tempest-ProjectMemberTests-1539753999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:32:31 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-30f271aa-31af-45da-b9d6-cafda4c56656 tempest-ProjectMemberTests-1539753999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:32:31 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-30f271aa-31af-45da-b9d6-cafda4c56656 tempest-ProjectMemberTests-1539753999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:32:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-30f271aa-31af-45da-b9d6-cafda4c56656 tempest-ProjectMemberTests-1539753999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:32:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-30f271aa-31af-45da-b9d6-cafda4c56656 tempest-ProjectMemberTests-1539753999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:31 devstack sudo[108418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:32:31 devstack sudo[108418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:31 devstack sudo[108415]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-17fdcddc-311a-4012-9963-999c135ff11e tempest-ProjectReaderTests-34452203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a9944c28-8743-4f51-897c-0ac25b879940.68b5b65f-4207-418a-b9f7-9af76467e761" returned: 0 in 0.268s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-17fdcddc-311a-4012-9963-999c135ff11e tempest-ProjectReaderTests-34452203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a9944c28-8743-4f51-897c-0ac25b879940.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:31 devstack sudo[108421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a9944c28-8743-4f51-897c-0ac25b879940.info Nov 04 12:32:31 devstack sudo[108421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:31 devstack sudo[108418]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-30f271aa-31af-45da-b9d6-cafda4c56656 tempest-ProjectMemberTests-1539753999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.265s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:31 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-30f271aa-31af-45da-b9d6-cafda4c56656 tempest-ProjectMemberTests-1539753999 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:32:31 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-30f271aa-31af-45da-b9d6-cafda4c56656 tempest-ProjectMemberTests-1539753999 None] Deleted volume successfully. Nov 04 12:32:31 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-30f271aa-31af-45da-b9d6-cafda4c56656 tempest-ProjectMemberTests-1539753999 None] Lock "cinder-374dd371-deb0-478a-aa26-f69bdf37687f-delete_volume" released by "delete_volume" :: held 1.184s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:32:31 devstack sudo[108421]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-17fdcddc-311a-4012-9963-999c135ff11e tempest-ProjectReaderTests-34452203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a9944c28-8743-4f51-897c-0ac25b879940.info" returned: 0 in 0.289s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:31 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-17fdcddc-311a-4012-9963-999c135ff11e tempest-ProjectReaderTests-34452203 None] /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a9944c28-8743-4f51-897c-0ac25b879940.info is being set with open permissions: ugo+rw Nov 04 12:32:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-17fdcddc-311a-4012-9963-999c135ff11e tempest-ProjectReaderTests-34452203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a9944c28-8743-4f51-897c-0ac25b879940.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:31 devstack sudo[108425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a9944c28-8743-4f51-897c-0ac25b879940.info Nov 04 12:32:31 devstack sudo[108425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:31 devstack sudo[108425]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-17fdcddc-311a-4012-9963-999c135ff11e tempest-ProjectReaderTests-34452203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a9944c28-8743-4f51-897c-0ac25b879940.info" returned: 0 in 0.240s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-17fdcddc-311a-4012-9963-999c135ff11e tempest-ProjectReaderTests-34452203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.946s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:32:31 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-17fdcddc-311a-4012-9963-999c135ff11e tempest-ProjectReaderTests-34452203 None] Create snapshot completed successfully Nov 04 12:32:31 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-aa36f4bd-c7bc-4850-8cfa-3e5af33430c0 tempest-ProjectReaderTests-34452203 None] Acquiring lock "cinder-68b5b65f-4207-418a-b9f7-9af76467e761-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:32:31 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-aa36f4bd-c7bc-4850-8cfa-3e5af33430c0 tempest-ProjectReaderTests-34452203 None] Lock "cinder-68b5b65f-4207-418a-b9f7-9af76467e761-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:32:31 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-aa36f4bd-c7bc-4850-8cfa-3e5af33430c0 tempest-ProjectReaderTests-34452203 None] Acquiring lock "cinder-quobyte-a9944c28-8743-4f51-897c-0ac25b879940" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:32:31 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-aa36f4bd-c7bc-4850-8cfa-3e5af33430c0 tempest-ProjectReaderTests-34452203 None] Lock "cinder-quobyte-a9944c28-8743-4f51-897c-0ac25b879940" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:32:31 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-aa36f4bd-c7bc-4850-8cfa-3e5af33430c0 tempest-ProjectReaderTests-34452203 None] Acquiring lock "cinder-quobyte-68b5b65f-4207-418a-b9f7-9af76467e761" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:32:31 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-aa36f4bd-c7bc-4850-8cfa-3e5af33430c0 tempest-ProjectReaderTests-34452203 None] Lock "cinder-quobyte-68b5b65f-4207-418a-b9f7-9af76467e761" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:32:31 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-aa36f4bd-c7bc-4850-8cfa-3e5af33430c0 tempest-ProjectReaderTests-34452203 None] Deleting offline snapshot 68b5b65f-4207-418a-b9f7-9af76467e761 of volume a9944c28-8743-4f51-897c-0ac25b879940 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 12:32:31 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-aa36f4bd-c7bc-4850-8cfa-3e5af33430c0 tempest-ProjectReaderTests-34452203 None] snapshot_file for this snap is: volume-a9944c28-8743-4f51-897c-0ac25b879940.68b5b65f-4207-418a-b9f7-9af76467e761 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 12:32:32 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[68464a9b-f7a2-4826-b276-b906c9a0c3fa]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:32:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-aa36f4bd-c7bc-4850-8cfa-3e5af33430c0 tempest-ProjectReaderTests-34452203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a9944c28-8743-4f51-897c-0ac25b879940.68b5b65f-4207-418a-b9f7-9af76467e761 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:32 devstack sudo[108428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a9944c28-8743-4f51-897c-0ac25b879940.68b5b65f-4207-418a-b9f7-9af76467e761 Nov 04 12:32:32 devstack sudo[108428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:32 devstack sudo[108428]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-aa36f4bd-c7bc-4850-8cfa-3e5af33430c0 tempest-ProjectReaderTests-34452203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a9944c28-8743-4f51-897c-0ac25b879940.68b5b65f-4207-418a-b9f7-9af76467e761" returned: 0 in 0.413s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:32 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-aa36f4bd-c7bc-4850-8cfa-3e5af33430c0 tempest-ProjectReaderTests-34452203 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a9944c28-8743-4f51-897c-0ac25b879940(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 12:32:32 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce224e95-d877-4f59-9f36-f73e90e273c5]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:32:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-aa36f4bd-c7bc-4850-8cfa-3e5af33430c0 tempest-ProjectReaderTests-34452203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a9944c28-8743-4f51-897c-0ac25b879940 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:32 devstack sudo[108433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a9944c28-8743-4f51-897c-0ac25b879940 Nov 04 12:32:32 devstack sudo[108433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:32 devstack sudo[108433]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-aa36f4bd-c7bc-4850-8cfa-3e5af33430c0 tempest-ProjectReaderTests-34452203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a9944c28-8743-4f51-897c-0ac25b879940" returned: 0 in 0.398s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-aa36f4bd-c7bc-4850-8cfa-3e5af33430c0 tempest-ProjectReaderTests-34452203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a9944c28-8743-4f51-897c-0ac25b879940.68b5b65f-4207-418a-b9f7-9af76467e761 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:32 devstack sudo[108438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a9944c28-8743-4f51-897c-0ac25b879940.68b5b65f-4207-418a-b9f7-9af76467e761 Nov 04 12:32:32 devstack sudo[108438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:33 devstack sudo[108438]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-aa36f4bd-c7bc-4850-8cfa-3e5af33430c0 tempest-ProjectReaderTests-34452203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a9944c28-8743-4f51-897c-0ac25b879940.68b5b65f-4207-418a-b9f7-9af76467e761" returned: 0 in 0.370s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-aa36f4bd-c7bc-4850-8cfa-3e5af33430c0 tempest-ProjectReaderTests-34452203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a9944c28-8743-4f51-897c-0ac25b879940.68b5b65f-4207-418a-b9f7-9af76467e761 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:33 devstack sudo[108443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a9944c28-8743-4f51-897c-0ac25b879940.68b5b65f-4207-418a-b9f7-9af76467e761 Nov 04 12:32:33 devstack sudo[108443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:33 devstack sudo[108443]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-aa36f4bd-c7bc-4850-8cfa-3e5af33430c0 tempest-ProjectReaderTests-34452203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a9944c28-8743-4f51-897c-0ac25b879940.68b5b65f-4207-418a-b9f7-9af76467e761" returned: 0 in 0.258s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:33 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-aa36f4bd-c7bc-4850-8cfa-3e5af33430c0 tempest-ProjectReaderTests-34452203 None] Lock "cinder-quobyte-68b5b65f-4207-418a-b9f7-9af76467e761" released by "_delete_snapshot" :: held 1.557s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:32:33 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-aa36f4bd-c7bc-4850-8cfa-3e5af33430c0 tempest-ProjectReaderTests-34452203 None] Lock "cinder-quobyte-a9944c28-8743-4f51-897c-0ac25b879940" released by "delete_snapshot" :: held 1.583s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:32:33 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-aa36f4bd-c7bc-4850-8cfa-3e5af33430c0 tempest-ProjectReaderTests-34452203 None] Created reservations ['03740b47-7f39-425e-8834-13e4f7161535', '64bd463e-7a33-44b2-a394-44c409605a75', '5bec3afd-c37d-4511-a1e3-b1368cc40daf', 'c16be365-fec8-43f4-9970-f16536287edf'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:32:33 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-aa36f4bd-c7bc-4850-8cfa-3e5af33430c0 tempest-ProjectReaderTests-34452203 None] Delete snapshot completed successfully. Nov 04 12:32:33 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-aa36f4bd-c7bc-4850-8cfa-3e5af33430c0 tempest-ProjectReaderTests-34452203 None] Lock "cinder-68b5b65f-4207-418a-b9f7-9af76467e761-delete_snapshot" released by "delete_snapshot" :: held 1.766s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:32:34 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-dccc01e2-760b-4d87-a650-496c7b861854 tempest-ProjectReaderTests-34452203 None] Acquiring lock "cinder-a9944c28-8743-4f51-897c-0ac25b879940-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:32:34 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-dccc01e2-760b-4d87-a650-496c7b861854 tempest-ProjectReaderTests-34452203 None] Lock "cinder-a9944c28-8743-4f51-897c-0ac25b879940-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:32:34 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-dccc01e2-760b-4d87-a650-496c7b861854 tempest-ProjectReaderTests-34452203 None] Acquiring lock "cinder-quobyte-a9944c28-8743-4f51-897c-0ac25b879940" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:32:34 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-dccc01e2-760b-4d87-a650-496c7b861854 tempest-ProjectReaderTests-34452203 None] Lock "cinder-quobyte-a9944c28-8743-4f51-897c-0ac25b879940" acquired by "delete_volume" :: waited 0.017s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:32:34 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb88b91d-5924-4e8b-926f-d053c8ace8fb]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:32:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-dccc01e2-760b-4d87-a650-496c7b861854 tempest-ProjectReaderTests-34452203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a9944c28-8743-4f51-897c-0ac25b879940 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:34 devstack sudo[108483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a9944c28-8743-4f51-897c-0ac25b879940 Nov 04 12:32:34 devstack sudo[108483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:34 devstack sudo[108483]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-dccc01e2-760b-4d87-a650-496c7b861854 tempest-ProjectReaderTests-34452203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a9944c28-8743-4f51-897c-0ac25b879940" returned: 0 in 0.368s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-dccc01e2-760b-4d87-a650-496c7b861854 tempest-ProjectReaderTests-34452203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a9944c28-8743-4f51-897c-0ac25b879940 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:34 devstack sudo[108488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a9944c28-8743-4f51-897c-0ac25b879940 Nov 04 12:32:34 devstack sudo[108488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:34 devstack sudo[108488]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-dccc01e2-760b-4d87-a650-496c7b861854 tempest-ProjectReaderTests-34452203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-a9944c28-8743-4f51-897c-0ac25b879940" returned: 0 in 0.245s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:34 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-dccc01e2-760b-4d87-a650-496c7b861854 tempest-ProjectReaderTests-34452203 None] Lock "cinder-quobyte-a9944c28-8743-4f51-897c-0ac25b879940" released by "delete_volume" :: held 0.686s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:32:34 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-dccc01e2-760b-4d87-a650-496c7b861854 tempest-ProjectReaderTests-34452203 None] Created reservations ['46c6f054-3446-4379-9894-14e0f9952ec5', '1c6c3e03-eb9a-4d8b-b4bb-a16d2929c0a9', 'e65b6883-e987-4fef-9abc-ec9fddb045d8', '145550e6-58dd-4fd0-b61d-89b8a5a25d52'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:32:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-dccc01e2-760b-4d87-a650-496c7b861854 tempest-ProjectReaderTests-34452203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:32:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-dccc01e2-760b-4d87-a650-496c7b861854 tempest-ProjectReaderTests-34452203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:32:34 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-dccc01e2-760b-4d87-a650-496c7b861854 tempest-ProjectReaderTests-34452203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:32:34 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-dccc01e2-760b-4d87-a650-496c7b861854 tempest-ProjectReaderTests-34452203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:32:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-dccc01e2-760b-4d87-a650-496c7b861854 tempest-ProjectReaderTests-34452203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:32:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-dccc01e2-760b-4d87-a650-496c7b861854 tempest-ProjectReaderTests-34452203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:35 devstack sudo[108491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:32:35 devstack sudo[108491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:35 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-f311d2dd-decd-4049-927a-df657efd7595 tempest-ProjectReaderTests-1960930353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:32:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f311d2dd-decd-4049-927a-df657efd7595 tempest-ProjectReaderTests-1960930353 None] Flow 'volume_create_manager' (b2d63415-b487-4740-a36a-2e268551300f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:32:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f311d2dd-decd-4049-927a-df657efd7595 tempest-ProjectReaderTests-1960930353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bc4490f-6946-4203-948a-ff42bea97d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:32:35 devstack sudo[108491]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f311d2dd-decd-4049-927a-df657efd7595 tempest-ProjectReaderTests-1960930353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bc4490f-6946-4203-948a-ff42bea97d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:32:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1997802198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19b31ed7-14fa-419a-873f-bbf9a74b04de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eab9dc5286ff45a1a5d89fd3a532d16f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:32:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:32:35Z,use_quota=True,user_id='fe75e1b8368b491ea64b33150ae423be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:32:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f311d2dd-decd-4049-927a-df657efd7595 tempest-ProjectReaderTests-1960930353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb006092-0492-4c71-8240-4ac90a7084aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:32:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f311d2dd-decd-4049-927a-df657efd7595 tempest-ProjectReaderTests-1960930353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb006092-0492-4c71-8240-4ac90a7084aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:32:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f311d2dd-decd-4049-927a-df657efd7595 tempest-ProjectReaderTests-1960930353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa61a82a-09e2-42e6-9fa0-2e8adbf38233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:32:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f311d2dd-decd-4049-927a-df657efd7595 tempest-ProjectReaderTests-1960930353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa61a82a-09e2-42e6-9fa0-2e8adbf38233) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19b31ed7-14fa-419a-873f-bbf9a74b04de', 'volume_name': 'volume-19b31ed7-14fa-419a-873f-bbf9a74b04de', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:32:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f311d2dd-decd-4049-927a-df657efd7595 tempest-ProjectReaderTests-1960930353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afc9ac8b-f334-4a9b-919c-8766b007fbaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:32:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f311d2dd-decd-4049-927a-df657efd7595 tempest-ProjectReaderTests-1960930353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afc9ac8b-f334-4a9b-919c-8766b007fbaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:32:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f311d2dd-decd-4049-927a-df657efd7595 tempest-ProjectReaderTests-1960930353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab452728-d331-4053-be0e-21b694a3acad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:32:35 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-f311d2dd-decd-4049-927a-df657efd7595 tempest-ProjectReaderTests-1960930353 None] Volume 19b31ed7-14fa-419a-873f-bbf9a74b04de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19b31ed7-14fa-419a-873f-bbf9a74b04de', 'volume_size': 1} Nov 04 12:32:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f311d2dd-decd-4049-927a-df657efd7595 tempest-ProjectReaderTests-1960930353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:32:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f311d2dd-decd-4049-927a-df657efd7595 tempest-ProjectReaderTests-1960930353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:32:35 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f311d2dd-decd-4049-927a-df657efd7595 tempest-ProjectReaderTests-1960930353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:32:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1997802198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19b31ed7-14fa-419a-873f-bbf9a74b04de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eab9dc5286ff45a1a5d89fd3a532d16f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:32:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:32:35Z,use_quota=True,user_id='fe75e1b8368b491ea64b33150ae423be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:32:35 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-f311d2dd-decd-4049-927a-df657efd7595 tempest-ProjectReaderTests-1960930353 None] Creating volume 19b31ed7-14fa-419a-873f-bbf9a74b04de {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:32:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f311d2dd-decd-4049-927a-df657efd7595 tempest-ProjectReaderTests-1960930353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:32:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f311d2dd-decd-4049-927a-df657efd7595 tempest-ProjectReaderTests-1960930353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:32:35 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f311d2dd-decd-4049-927a-df657efd7595 tempest-ProjectReaderTests-1960930353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:32:35 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f311d2dd-decd-4049-927a-df657efd7595 tempest-ProjectReaderTests-1960930353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:32:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f311d2dd-decd-4049-927a-df657efd7595 tempest-ProjectReaderTests-1960930353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:32:35 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f311d2dd-decd-4049-927a-df657efd7595 tempest-ProjectReaderTests-1960930353 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:32:35 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-f311d2dd-decd-4049-927a-df657efd7595 tempest-ProjectReaderTests-1960930353 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:32:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f311d2dd-decd-4049-927a-df657efd7595 tempest-ProjectReaderTests-1960930353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-19b31ed7-14fa-419a-873f-bbf9a74b04de 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-dccc01e2-760b-4d87-a650-496c7b861854 tempest-ProjectReaderTests-34452203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.335s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:35 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-dccc01e2-760b-4d87-a650-496c7b861854 tempest-ProjectReaderTests-34452203 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:32:35 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-dccc01e2-760b-4d87-a650-496c7b861854 tempest-ProjectReaderTests-34452203 None] Deleted volume successfully. Nov 04 12:32:35 devstack sudo[108494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-19b31ed7-14fa-419a-873f-bbf9a74b04de 1073741824 Nov 04 12:32:35 devstack sudo[108494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:35 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-dccc01e2-760b-4d87-a650-496c7b861854 tempest-ProjectReaderTests-34452203 None] Lock "cinder-a9944c28-8743-4f51-897c-0ac25b879940-delete_volume" released by "delete_volume" :: held 1.246s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:32:35 devstack sudo[108494]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f311d2dd-decd-4049-927a-df657efd7595 tempest-ProjectReaderTests-1960930353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-19b31ed7-14fa-419a-873f-bbf9a74b04de 1073741824" returned: 0 in 0.483s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f311d2dd-decd-4049-927a-df657efd7595 tempest-ProjectReaderTests-1960930353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-19b31ed7-14fa-419a-873f-bbf9a74b04de {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:35 devstack sudo[108500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-19b31ed7-14fa-419a-873f-bbf9a74b04de Nov 04 12:32:35 devstack sudo[108500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:36 devstack sudo[108500]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f311d2dd-decd-4049-927a-df657efd7595 tempest-ProjectReaderTests-1960930353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-19b31ed7-14fa-419a-873f-bbf9a74b04de" returned: 0 in 0.296s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:36 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f311d2dd-decd-4049-927a-df657efd7595 tempest-ProjectReaderTests-1960930353 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:32:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f311d2dd-decd-4049-927a-df657efd7595 tempest-ProjectReaderTests-1960930353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:32:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f311d2dd-decd-4049-927a-df657efd7595 tempest-ProjectReaderTests-1960930353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab452728-d331-4053-be0e-21b694a3acad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19b31ed7-14fa-419a-873f-bbf9a74b04de', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:32:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f311d2dd-decd-4049-927a-df657efd7595 tempest-ProjectReaderTests-1960930353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99f24d0b-8824-4bd3-8112-b0de001f4a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:32:36 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-f311d2dd-decd-4049-927a-df657efd7595 tempest-ProjectReaderTests-1960930353 None] Volume volume-19b31ed7-14fa-419a-873f-bbf9a74b04de (19b31ed7-14fa-419a-873f-bbf9a74b04de): created successfully Nov 04 12:32:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f311d2dd-decd-4049-927a-df657efd7595 tempest-ProjectReaderTests-1960930353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99f24d0b-8824-4bd3-8112-b0de001f4a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:32:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f311d2dd-decd-4049-927a-df657efd7595 tempest-ProjectReaderTests-1960930353 None] Flow 'volume_create_manager' (b2d63415-b487-4740-a36a-2e268551300f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:32:36 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-f311d2dd-decd-4049-927a-df657efd7595 tempest-ProjectReaderTests-1960930353 None] Created volume successfully. Nov 04 12:32:37 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-08f7cdd3-2757-4393-a48a-b6160ca5eb30 tempest-ProjectReaderTests-1960930353 None] Acquiring lock "cinder-19b31ed7-14fa-419a-873f-bbf9a74b04de-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:32:37 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-08f7cdd3-2757-4393-a48a-b6160ca5eb30 tempest-ProjectReaderTests-1960930353 None] Lock "cinder-19b31ed7-14fa-419a-873f-bbf9a74b04de-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:32:37 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-08f7cdd3-2757-4393-a48a-b6160ca5eb30 tempest-ProjectReaderTests-1960930353 None] Acquiring lock "cinder-quobyte-19b31ed7-14fa-419a-873f-bbf9a74b04de" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:32:37 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-08f7cdd3-2757-4393-a48a-b6160ca5eb30 tempest-ProjectReaderTests-1960930353 None] Lock "cinder-quobyte-19b31ed7-14fa-419a-873f-bbf9a74b04de" acquired by "delete_volume" :: waited 0.021s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:32:37 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4938ef-3acb-47cb-bf0e-dc70f19c4a4b]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:32:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-08f7cdd3-2757-4393-a48a-b6160ca5eb30 tempest-ProjectReaderTests-1960930353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-19b31ed7-14fa-419a-873f-bbf9a74b04de {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:37 devstack sudo[108504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-19b31ed7-14fa-419a-873f-bbf9a74b04de Nov 04 12:32:37 devstack sudo[108504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:38 devstack sudo[108504]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-08f7cdd3-2757-4393-a48a-b6160ca5eb30 tempest-ProjectReaderTests-1960930353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-19b31ed7-14fa-419a-873f-bbf9a74b04de" returned: 0 in 0.378s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-08f7cdd3-2757-4393-a48a-b6160ca5eb30 tempest-ProjectReaderTests-1960930353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-19b31ed7-14fa-419a-873f-bbf9a74b04de {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:38 devstack sudo[108510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-19b31ed7-14fa-419a-873f-bbf9a74b04de Nov 04 12:32:38 devstack sudo[108510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:38 devstack sudo[108510]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-08f7cdd3-2757-4393-a48a-b6160ca5eb30 tempest-ProjectReaderTests-1960930353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-19b31ed7-14fa-419a-873f-bbf9a74b04de" returned: 0 in 0.247s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:38 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-08f7cdd3-2757-4393-a48a-b6160ca5eb30 tempest-ProjectReaderTests-1960930353 None] Lock "cinder-quobyte-19b31ed7-14fa-419a-873f-bbf9a74b04de" released by "delete_volume" :: held 0.667s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:32:38 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-08f7cdd3-2757-4393-a48a-b6160ca5eb30 tempest-ProjectReaderTests-1960930353 None] Created reservations ['0da1726b-16d6-4397-926b-e6bb35da4b3a', 'f4454285-a024-497e-a3ea-ba5541b05d0b', '1499e69d-400e-4eca-8b4c-eafd7e9982ce', '1e74392f-228c-4e45-b46d-23df674482b5'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:32:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-08f7cdd3-2757-4393-a48a-b6160ca5eb30 tempest-ProjectReaderTests-1960930353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:32:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-08f7cdd3-2757-4393-a48a-b6160ca5eb30 tempest-ProjectReaderTests-1960930353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:32:38 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-08f7cdd3-2757-4393-a48a-b6160ca5eb30 tempest-ProjectReaderTests-1960930353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:32:38 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-08f7cdd3-2757-4393-a48a-b6160ca5eb30 tempest-ProjectReaderTests-1960930353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:32:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-08f7cdd3-2757-4393-a48a-b6160ca5eb30 tempest-ProjectReaderTests-1960930353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:32:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-08f7cdd3-2757-4393-a48a-b6160ca5eb30 tempest-ProjectReaderTests-1960930353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:38 devstack sudo[108513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:32:38 devstack sudo[108513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:38 devstack sudo[108513]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-08f7cdd3-2757-4393-a48a-b6160ca5eb30 tempest-ProjectReaderTests-1960930353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.258s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:38 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-08f7cdd3-2757-4393-a48a-b6160ca5eb30 tempest-ProjectReaderTests-1960930353 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:32:38 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-08f7cdd3-2757-4393-a48a-b6160ca5eb30 tempest-ProjectReaderTests-1960930353 None] Deleted volume successfully. Nov 04 12:32:38 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-08f7cdd3-2757-4393-a48a-b6160ca5eb30 tempest-ProjectReaderTests-1960930353 None] Lock "cinder-19b31ed7-14fa-419a-873f-bbf9a74b04de-delete_volume" released by "delete_volume" :: held 1.140s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:32:39 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d0eddd1-fded-46dd-80c6-b1008a2861f4 tempest-ProjectReaderTests-1960930353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 12:32:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1d0eddd1-fded-46dd-80c6-b1008a2861f4 tempest-ProjectReaderTests-1960930353 None] Flow 'volume_create_manager' (dc0d98a9-705a-41e8-948e-e697b1183d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:32:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1d0eddd1-fded-46dd-80c6-b1008a2861f4 tempest-ProjectReaderTests-1960930353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b03cdf07-b407-4842-bbb7-fe57b50bbd21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:32:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1d0eddd1-fded-46dd-80c6-b1008a2861f4 tempest-ProjectReaderTests-1960930353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b03cdf07-b407-4842-bbb7-fe57b50bbd21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:32:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1088834993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d770485-caf3-4f66-bd3f-b00a31cb4886,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eab9dc5286ff45a1a5d89fd3a532d16f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:32:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:32:39Z,use_quota=True,user_id='fe75e1b8368b491ea64b33150ae423be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:32:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1d0eddd1-fded-46dd-80c6-b1008a2861f4 tempest-ProjectReaderTests-1960930353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d4c190e-312f-4f3f-909f-b408efe6e412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:32:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1d0eddd1-fded-46dd-80c6-b1008a2861f4 tempest-ProjectReaderTests-1960930353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d4c190e-312f-4f3f-909f-b408efe6e412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:32:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1d0eddd1-fded-46dd-80c6-b1008a2861f4 tempest-ProjectReaderTests-1960930353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df3f5aff-a820-491e-963f-5fc671163423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:32:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1d0eddd1-fded-46dd-80c6-b1008a2861f4 tempest-ProjectReaderTests-1960930353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df3f5aff-a820-491e-963f-5fc671163423) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d770485-caf3-4f66-bd3f-b00a31cb4886', 'volume_name': 'volume-9d770485-caf3-4f66-bd3f-b00a31cb4886', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:32:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1d0eddd1-fded-46dd-80c6-b1008a2861f4 tempest-ProjectReaderTests-1960930353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83e787dd-866b-4199-933a-db47b9144174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:32:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1d0eddd1-fded-46dd-80c6-b1008a2861f4 tempest-ProjectReaderTests-1960930353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83e787dd-866b-4199-933a-db47b9144174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:32:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1d0eddd1-fded-46dd-80c6-b1008a2861f4 tempest-ProjectReaderTests-1960930353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a7920c7-4561-46f2-aa72-e5ad8b279271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:32:39 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-1d0eddd1-fded-46dd-80c6-b1008a2861f4 tempest-ProjectReaderTests-1960930353 None] Volume 9d770485-caf3-4f66-bd3f-b00a31cb4886: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d770485-caf3-4f66-bd3f-b00a31cb4886', 'volume_size': 1} Nov 04 12:32:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1d0eddd1-fded-46dd-80c6-b1008a2861f4 tempest-ProjectReaderTests-1960930353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:32:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1d0eddd1-fded-46dd-80c6-b1008a2861f4 tempest-ProjectReaderTests-1960930353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:32:39 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1d0eddd1-fded-46dd-80c6-b1008a2861f4 tempest-ProjectReaderTests-1960930353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T11:32:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1088834993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d770485-caf3-4f66-bd3f-b00a31cb4886,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eab9dc5286ff45a1a5d89fd3a532d16f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:32:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:32:39Z,use_quota=True,user_id='fe75e1b8368b491ea64b33150ae423be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(024dad9a-1caf-4ea6-8c42-876d03c61995),volume_type_id=024dad9a-1caf-4ea6-8c42-876d03c61995)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 12:32:39 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-1d0eddd1-fded-46dd-80c6-b1008a2861f4 tempest-ProjectReaderTests-1960930353 None] Creating volume 9d770485-caf3-4f66-bd3f-b00a31cb4886 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 12:32:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1d0eddd1-fded-46dd-80c6-b1008a2861f4 tempest-ProjectReaderTests-1960930353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:32:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1d0eddd1-fded-46dd-80c6-b1008a2861f4 tempest-ProjectReaderTests-1960930353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:32:39 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1d0eddd1-fded-46dd-80c6-b1008a2861f4 tempest-ProjectReaderTests-1960930353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:32:39 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1d0eddd1-fded-46dd-80c6-b1008a2861f4 tempest-ProjectReaderTests-1960930353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:32:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1d0eddd1-fded-46dd-80c6-b1008a2861f4 tempest-ProjectReaderTests-1960930353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:32:39 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1d0eddd1-fded-46dd-80c6-b1008a2861f4 tempest-ProjectReaderTests-1960930353 None] Selected osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 12:32:39 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-1d0eddd1-fded-46dd-80c6-b1008a2861f4 tempest-ProjectReaderTests-1960930353 None] casted to osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784 Nov 04 12:32:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1d0eddd1-fded-46dd-80c6-b1008a2861f4 tempest-ProjectReaderTests-1960930353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9d770485-caf3-4f66-bd3f-b00a31cb4886 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:39 devstack sudo[108516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9d770485-caf3-4f66-bd3f-b00a31cb4886 1073741824 Nov 04 12:32:39 devstack sudo[108516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:39 devstack sudo[108516]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1d0eddd1-fded-46dd-80c6-b1008a2861f4 tempest-ProjectReaderTests-1960930353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9d770485-caf3-4f66-bd3f-b00a31cb4886 1073741824" returned: 0 in 0.404s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1d0eddd1-fded-46dd-80c6-b1008a2861f4 tempest-ProjectReaderTests-1960930353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9d770485-caf3-4f66-bd3f-b00a31cb4886 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:39 devstack sudo[108521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9d770485-caf3-4f66-bd3f-b00a31cb4886 Nov 04 12:32:39 devstack sudo[108521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:40 devstack sudo[108521]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1d0eddd1-fded-46dd-80c6-b1008a2861f4 tempest-ProjectReaderTests-1960930353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9d770485-caf3-4f66-bd3f-b00a31cb4886" returned: 0 in 0.245s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:40 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1d0eddd1-fded-46dd-80c6-b1008a2861f4 tempest-ProjectReaderTests-1960930353 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 12:32:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1d0eddd1-fded-46dd-80c6-b1008a2861f4 tempest-ProjectReaderTests-1960930353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:32:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1d0eddd1-fded-46dd-80c6-b1008a2861f4 tempest-ProjectReaderTests-1960930353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a7920c7-4561-46f2-aa72-e5ad8b279271) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d770485-caf3-4f66-bd3f-b00a31cb4886', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:32:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1d0eddd1-fded-46dd-80c6-b1008a2861f4 tempest-ProjectReaderTests-1960930353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01237466-497e-4ae4-96fb-0a9da9dbe1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 12:32:40 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-1d0eddd1-fded-46dd-80c6-b1008a2861f4 tempest-ProjectReaderTests-1960930353 None] Volume volume-9d770485-caf3-4f66-bd3f-b00a31cb4886 (9d770485-caf3-4f66-bd3f-b00a31cb4886): created successfully Nov 04 12:32:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1d0eddd1-fded-46dd-80c6-b1008a2861f4 tempest-ProjectReaderTests-1960930353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01237466-497e-4ae4-96fb-0a9da9dbe1bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 12:32:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1d0eddd1-fded-46dd-80c6-b1008a2861f4 tempest-ProjectReaderTests-1960930353 None] Flow 'volume_create_manager' (dc0d98a9-705a-41e8-948e-e697b1183d19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 12:32:40 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-1d0eddd1-fded-46dd-80c6-b1008a2861f4 tempest-ProjectReaderTests-1960930353 None] Created volume successfully. Nov 04 12:32:40 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-4324ccc5-d43d-4c1b-bdce-523abf9d04d8 tempest-ProjectReaderTests-1960930353 None] Acquiring lock "cinder-9d770485-caf3-4f66-bd3f-b00a31cb4886-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:32:40 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-4324ccc5-d43d-4c1b-bdce-523abf9d04d8 tempest-ProjectReaderTests-1960930353 None] Lock "cinder-9d770485-caf3-4f66-bd3f-b00a31cb4886-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:32:40 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-4324ccc5-d43d-4c1b-bdce-523abf9d04d8 tempest-ProjectReaderTests-1960930353 None] Acquiring lock "cinder-quobyte-9d770485-caf3-4f66-bd3f-b00a31cb4886" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 12:32:40 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-4324ccc5-d43d-4c1b-bdce-523abf9d04d8 tempest-ProjectReaderTests-1960930353 None] Lock "cinder-quobyte-9d770485-caf3-4f66-bd3f-b00a31cb4886" acquired by "delete_volume" :: waited 0.025s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 12:32:40 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c54a4d91-ed88-47f8-ac85-8ac95d3d6476]: (4, 'qcow2') {{(pid=88720) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 12:32:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4324ccc5-d43d-4c1b-bdce-523abf9d04d8 tempest-ProjectReaderTests-1960930353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9d770485-caf3-4f66-bd3f-b00a31cb4886 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:40 devstack sudo[108524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9d770485-caf3-4f66-bd3f-b00a31cb4886 Nov 04 12:32:40 devstack sudo[108524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:40 devstack sudo[108524]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4324ccc5-d43d-4c1b-bdce-523abf9d04d8 tempest-ProjectReaderTests-1960930353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9d770485-caf3-4f66-bd3f-b00a31cb4886" returned: 0 in 0.385s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4324ccc5-d43d-4c1b-bdce-523abf9d04d8 tempest-ProjectReaderTests-1960930353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9d770485-caf3-4f66-bd3f-b00a31cb4886 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:40 devstack sudo[108529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9d770485-caf3-4f66-bd3f-b00a31cb4886 Nov 04 12:32:40 devstack sudo[108529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:41 devstack sudo[108529]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4324ccc5-d43d-4c1b-bdce-523abf9d04d8 tempest-ProjectReaderTests-1960930353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa/volume-9d770485-caf3-4f66-bd3f-b00a31cb4886" returned: 0 in 0.266s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:41 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-4324ccc5-d43d-4c1b-bdce-523abf9d04d8 tempest-ProjectReaderTests-1960930353 None] Lock "cinder-quobyte-9d770485-caf3-4f66-bd3f-b00a31cb4886" released by "delete_volume" :: held 0.695s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:32:41 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-4324ccc5-d43d-4c1b-bdce-523abf9d04d8 tempest-ProjectReaderTests-1960930353 None] Created reservations ['8d7c56b2-945d-4a00-98dd-1930983a7064', 'a866f8bc-2266-4ce2-b36e-9c0d75a4aa39', 'fea798e3-8f15-4234-a169-3b44a9b0d3ef', 'ba37bda2-d356-4825-8682-998352feec01'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 12:32:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4324ccc5-d43d-4c1b-bdce-523abf9d04d8 tempest-ProjectReaderTests-1960930353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:32:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4324ccc5-d43d-4c1b-bdce-523abf9d04d8 tempest-ProjectReaderTests-1960930353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:32:41 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4324ccc5-d43d-4c1b-bdce-523abf9d04d8 tempest-ProjectReaderTests-1960930353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:32:41 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4324ccc5-d43d-4c1b-bdce-523abf9d04d8 tempest-ProjectReaderTests-1960930353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:32:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4324ccc5-d43d-4c1b-bdce-523abf9d04d8 tempest-ProjectReaderTests-1960930353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:32:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4324ccc5-d43d-4c1b-bdce-523abf9d04d8 tempest-ProjectReaderTests-1960930353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:32:41 devstack sudo[108532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:32:41 devstack sudo[108532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:32:41 devstack sudo[108532]: pam_unix(sudo:session): session closed for user root Nov 04 12:32:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4324ccc5-d43d-4c1b-bdce-523abf9d04d8 tempest-ProjectReaderTests-1960930353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.233s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:32:41 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-4324ccc5-d43d-4c1b-bdce-523abf9d04d8 tempest-ProjectReaderTests-1960930353 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:32:41 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-4324ccc5-d43d-4c1b-bdce-523abf9d04d8 tempest-ProjectReaderTests-1960930353 None] Deleted volume successfully. Nov 04 12:32:41 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-4324ccc5-d43d-4c1b-bdce-523abf9d04d8 tempest-ProjectReaderTests-1960930353 None] Lock "cinder-9d770485-caf3-4f66-bd3f-b00a31cb4886-delete_volume" released by "delete_volume" :: held 1.143s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 12:32:51 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=46,cinder:INSERT=20,cinder:UPDATE=76,cinder:DELETE=7 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 12:32:51 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:INSERT=17,cinder:UPDATE=64,cinder:SELECT=51,cinder:DELETE=4 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 12:33:01 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 12:33:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 12:33:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 12:33:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 12:33:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ebcd28be-876c-4a5a-a295-e7c4957e5784'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 12:33:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 12:33:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 12:33:01 devstack sudo[108543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa Nov 04 12:33:01 devstack sudo[108543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 12:33:02 devstack sudo[108543]: pam_unix(sudo:session): session closed for user root Nov 04 12:33:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4756ba16a0301e2d7bb133efa4bdcaa" returned: 0 in 0.233s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 12:33:02 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 12:33:02 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] Running periodic task VolumeManager._thread_info {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 12:33:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] thread count: 28 {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 12:33:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3d473a99-3d1d-42b1-afcb-4197787d1821 None None] thread info: [<_MainThread(MainThread, started 140610387472512)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}